Nfs Version 3 Vs 4
- [Narrator] In this video, I'll break down the differences…between NFS version 3…and NFS version 4.1,…and as of vSphere 6,…NFS version 4.1 is now supported…for our NFS data stores.…So, NFS 4.1 comes with some additional functionality…that version 3 does not include.…That being said, there are also some limitations…that are specific to NFS version 4.1…that you need to be aware of, as well.…
NFS Version Upgrades. VSphere does not support automatic datastore conversions from NFS version 3 to NFS 4.1. If you want to upgrade your NFS 3 datastore, the following options are available: You can create a new NFS 4.1 datastore, and then use Storage vMotion to migrate virtual machines from the old datastore to the new one. ESXi does not support automatic datastore conversions from NFS version 3 to NFS 4.1. If you want to upgrade your NFS 3 datastore, the following options are available: Create the NFS 4.1 datastore, and then use Storage vMotion to migrate virtual machines from the old datastore to the new one. Use conversion methods provided by your NFS storage.
So, number one:…With NFS version 3,…storage traffic is strictly unencrypted.…So, we can only use NFS…on networks that we 100% trust.…The other limiting factor is,…as you can see here, there's only one IP address…on our network-attached storage device.…So, because of that,…the ESXi host uses only one TCP connection…for IO to the NFS storage device.…
Only a single IP address can be used for the NFS server…for data store, and this can make load balancing difficult,…because we typically use IP Hash for load balancing…this type of traffic.…If we have the same IP for all of our traffic,…IP Hash isn't gonna do us any good.…And the final limitation, actually not really a limitation,…
The Network File System (NFS) protocol has been around since the ’80s which is quite ancient in the realm of technology, and yet is still used widely. How has the performance of NFS changed over the years between the different versions?
Here we are going to compare the performance of NFS versions 2, 3, 4, and 4.1 to get idea of how things have progressed over time, the results are quite surprising.
Deed plotting software. Please give us your feedback in what works, what doesnt, and what features you would like added. Multiplottr allows you to plot multiple locations on a map, save and share on Google Maps.Customization is easy and on the fly!While plotting many locations, you have the ability to define each markers's description with text, images, hyperlinks and video, use your own customized markers and maps and assign markers to groups for easy on and off batch viewing.Currently Multiplottr 3.0 is in Beta and the site is changing almost every day.
While there are lots of other notable changes between these versions, our testing is only concerned with the performance aspects of sequential read/write and random read/write speeds.
To help give you an idea of how far NFS has come, below are the RFCs which indicate the month and year of each protocol.
With over 20 years of difference between version 2 and version 4.1 of NFS we would definitely expect to see performance improvements, let’s take a look!
The test environment
Nfs Version 3 Versus 4
Out test environment contains four servers, two running CentOS 6.6 and two running CentOS 7.1.1503. The CentOS 6.6 servers were used to benchmark NFS version 2, one acting as the NFS server and the other as the NFS client. The CentOS 7 servers were also set up to act as an NFS server and NFS client, they were used for the NFS version 3, 4 and 4.1 tests.
The NFS version 2 results should therefore be taken with a grain of salt as they were run on a different operating system which still had support for version 2. This was done to help illustrate how far things have come since version 2, as CentOS 7 and above no longer support NFS version 2.
The NFS clients are mounting the mount points from the NFS server with the version specified in each test to ensure that they are mounting as the correct version for the particular test. Once mounted ‘nfsstat -m’ was run to verify that the mount point was mounted with the correct version specified for the test.
Government in america ap edition. When not writing, speaking, or advising, he prefers to spend time with his wife, Carmella, sailing, skiing, scuba diving, traveling, or attending art auctions.Martin P. Presidential transitions.
The NFS servers had dedicated 40GB disks attached which were used for the NFS mount, this disk was not being used for anything else except the NFS benchmark. A secondary disk was used to rule out any actions that the running OS may be performing during the benchmark.
The benchmarking process
The benchmarks were run using IOzone, a file system benchmarking tool that I found had a good reputation for NFS benchmarking.
In this instance we are going to benchmark, sequential read, sequential write, random read, and random write with IOzone, these are defined as below from the IOzone documentation.
- Read: This test measures the performance of reading an existing file.
- Write: This test measures the performance of writing a new file. When a new file is written not only does the data need to be stored but also the overhead information for keeping track of where the data is located on the storage media. This overhead is called the “metadata” It consists of the directory information, the space allocation and any other data associated with a file that is not part of the data contained in the file. It is normal for the initial write performance to be lower than the performance of re-writing a file due to this overhead information.
- Random Read: This test measures the performance of reading a file with accesses being made to random locations within the file. The performance of a system under this type of activity can be impacted by several factors such as: Size of operating system’s cache, number of disks, seek latencies, and others.
- Random Write: This test measures the performance of writing a file with accesses being made to random locations within the file. Again the performance of a system under this type of activity can be impacted by several factors such as: Size of operating system’s cache, number of disks, seek latencies, and others.
As the documentation was not clear if the read/write tests were sequential, I sent a message to one of the IOzone developers who was able to confirm that those tests are indeed sequential.
Nfs 3 Vs 4 Security
Below is the command that was run over the NFS mount, which was mounted to /mnt
Results
Below are four images outlining the results as a series of graphs for sequential read/write and random read/write speeds, click them to open as full size.
NFS Sequential Write
NFS Random Write
Additionally if you would like to see the raw data, you can download it here:
Performance differences and comparison
Lets start with the obvious, in all tests NFS version 2 is coming last by a significant amount. This should be expected given the age of the protocol, I do not believe that this is due to the difference between CentOS 6.6 and CentOS 7.1.1503 operating systems in use, as this is the only other difference between the NFS version 2 test compared with the others.
In the sequential read tests, NFS versions 3 and 4 appear to be more stable with a larger amount of the graph in the dark blue 120-140 MBps area. This is interesting as NFS version 4.1 on the other hand has a few more dips, however it does seem to have slightly better results with small file sizes.
The sequential writes appear almost identical between NFS versions 3, 4 and 4.1. Versions 4 and 4.1 appear to perform slightly better with the smaller file sizes however, with 4 even outperforming 4.1 around the 512K – 2MB file size point.
Random reads are very similar between versions 3, 4 and 4.1, there isn’t much more to say as the results are so close. Random writes are also pretty similar throughout this test and even with the sequential write test where all tests perform similar, with versions 4 and 4.1 performing slightly better with smaller file types.
Conclusion
While NFS version 2 is obviously performing the poorest as expected, in general the performance of NFS versions 3, 4 and 4.1 are fairly similar, at least in these tests. I expected 4.1 with pNFS to clearly dominate the results however this was not the case, at least not under these particular synthetic workloads.
These tests seem to indicate that after version 3 there isn’t much to gain in practical performance for sequential read/write and random read/write workloads. Of course, there are plenty of other differences between NFS versions so using the newest available version is generally recommended, however from a pure performance standpoint after version 3 there does not seem to be significant performance differences under these particular test scenarios.