File Storage Deduplication - disk space recovery

[omlette brothers]

It would be great to have an OS based method for automatically removing duplicated, redundant data and thus free up valuable disk space. This type of technology is standard on high end systems like Netapp http://www.netapp.com/us/company/news/news-rel-20080331.html. Few if, any of us have the commitment to make sure that we dont duplicate data on our Readynas. An automated daemon which did this hard work for us would be great and delay the inevitable hard disk upgrade.

I floated the idea a few years ago, maybe now's a better time it's become mainstream http://www.readynas.com/forum/viewtopic.php?f=18&t=885

[NASman]

It would be great to have an OS based method for automatically removing duplicated, redundant data and thus free up valuable disk space. This type of technology is standard on high end systems like Netapp http://www.netapp.com/us/company/news/news-rel-20080331.html. Few if, any of us have the commitment to make sure that we dont duplicate data on our Readynas. An automated daemon which did this hard work for us would be great and delay the inevitable hard disk upgrade.

I floated the idea a few years ago, maybe now's a better time it's become mainstream http://www.readynas.com/forum/viewtopic.php?f=18&t=885

The question quoted above is highly relevant and it's a feature that's become mainstream in top tier NAS vendor products.

Would like to hear from NetGear ReadyNAS Product Management about the product roadmap for a (data deduplication) feature on the 1100, NV+, and Pro Business appliances.

HP has dedup: http://h71028.www7.hp.com/enterprise/ca ... p109281308
EMC has Avamar: http://www.emc.com/products/detail/software/avamar.htm
NetApp: http://www.netapp.com/us/products/platf ... edupe.html
NetApp: http://www.dedupecalc.com/
DataDomain's product line is well entrenched in Data Deduplication for backups
SNIA has a Special Interest Group for Data Dedup: http://www.snia.org/forums/dmf/programs ... it/ddsrsig

Thanks

[danet]

Yes and linux has lessFS

Regards
danet

[Richy_Boy]

I don't think lessfs support snapshots..

Rich