facebook rss twitter

Microsoft details new Windows Server 8 ReFS filesystem

by Alistair Lowe on 17 January 2012, 10:42

Tags: Microsoft (NASDAQ:MSFT), Windows 8

Quick Link: HEXUS.net/qabbg5

Add to My Vault: x

Firstly, to be clear, ReFS, which stands for 'Resilient File System' will only be available on Windows Server 8, however, will be accessible from clients supporting NTFS, as it supports the same APIs.

The first step Microsoft has taken with the new filesystem is to improve its ability to scale. Whilst NTFS at its core utilised B+ Tree structures to index data, ReFS uses only these structures throughout every element of the filesystem, ensuring that both directories and files can grow to large sizes with little impact on performance, a limitation of NTFS.

Windows Server 8 ReFS

Microsoft has also improved disk space allocation, providing three separate allocation tables that keep track of free space; the large, medium and small allocators, ensuring better cohesion of files and a more efficient use of space.

To prevent file damage stemming from power loss, the system now performs what's known as allocate-on-write, this means that the system will never simply overwrite existing data when updating a file and instead, writes to a new location on the hard disk, only making the new write part of the updated file once it has completed. By avoiding the need for journals to track changes and implementing writing that is not space constricted, it's also possible to perform many, larger data update tasks in fewer iops.

The new filesystem is also capable of detecting corruption, and provides checksums of all metadata, stored in a separate location, allowing for the detection of lost and misdirected writes, along with degradation of the storage media. Optionally, checksums may also be generated for file contents, a feature known as 'Integrity Streams'. When paired with the 'Storage Spaces' feature we spoke about previously, ReFS is capable of not only detecting corruption, but correcting it, by seamlessly working with the Space to call up all copies of the damaged data, comparing them with its checksum to determine which are intact and then using them in repairing the damaged data. In the event of a drive failure, ReFS will dynamically redirect writes to a new location on a working drive.

The core concept behind ReFS is that it can continue to function in the event of device failure or corruption. It's looking as though Microsoft intends to make RAID redundant in Windows Server 8, at least for smaller scale applications, a no doubt welcome feature for firms looking for the cheapest hardware possible, who don't wish to spend money on a costly SAS RAID controller. Whilst we can not say for sure until the performance figures role in, with CPU performance and core count rising, how this new filesystem performs against say, a RAID implementation of NTFS, may very well come down to how efficiently the filesystem has been implemented. It'll be an interesting game changer should benchmarks show the two approaches to be similar in performance.

For a more detailed list of features and workings, head on over to Microsoft's blog post.



HEXUS Forums :: 11 Comments

Login with Forum Account

Don't have an account? Register today!
allocate-on-write

Hallelujah!
shame windows 8 editions wont get this, it seems like a substantial improvement over NTFS… any reason as to why they arent adding it to the home releases? Seems bit silly to me!.
Hicks12
shame windows 8 editions wont get this, it seems like a substantial improvement over NTFS… any reason as to why they arent adding it to the home releases? Seems bit silly to me!.
I'll agree that this would be great for users of the “desktop” OS. I know they're doing it to maintain some advantages for WS8, but perhaps the “official” reason for not putting in the pleb versions of Windows8 is that RAID hardware is cheap and plentiful for the desktop - especially if you're able to use the features built into many medium and high end boards, (the last two Asus motherboards I've bought have both had RAID 0/1/5 support).
crossy
I'll agree that this would be great for users of the “desktop” OS. I know they're doing it to maintain some advantages for WS8, but perhaps the “official” reason for not putting in the pleb versions of Windows8 is that RAID hardware is cheap and plentiful for the desktop - especially if you're able to use the features built into many medium and high end boards, (the last two Asus motherboards I've bought have both had RAID 0/1/5 support).

RAID5 and Windows desktop don't always play nice mind you, if the hard disks aren't RAID compliant you can still lose data!

Microsoft did remind us in the blog post that NTFS was also introduced on the server only, it's perhaps likely that they'll see how it goes in a controlled environment where they can offer support and maybe we'll see ReFS in Windows desktop 9 or in a later service pack if there's enough demand.
Scribe
Microsoft did remind us in the blog post that NTFS was also introduced on the server only, it's perhaps likely that they'll see how it goes in a controlled environment where they can offer support and maybe we'll see ReFS in Windows desktop 9 or in a later service pack if there's enough demand.
I wouldn't consider a production server to be an experimental filesystem testbed. ;)