Storage Server Project 2 - Successful But Slow

A short update on the home server because it isn't to a finished point so there can't be too much to tell.

The first thing I tried was creating a virtual hard drive and using iSCSI to connect it to my Mac Pro. There isn't a native iSCSI client in Mac OS X so 3rd party solutions are the only option. They weren't very stable and using a fixed volume size I lost a lot of the benefits.

The second thing was SMB transfer. This worked very well and was very stable but it used 100% of the server's CPU which limited file transfers to 30-40 MB/sec reads and 20-30 MB/sec writes. If I got a faster CPU this would be just about right.

The third thing I tried was NFS transfer. This was great at reading files from the server and was able to go over 100 MB/sec approaching the limit of gigabit ethernet. (125 MB/sec) Write speed wasn't so great. Sometimes it would be 30 MB/sec but after a while or if another write or read was started the speed would drop to around 4 MB/sec. NFS is probably the best if the Mac OS X to Solaris issues get sorted out. This solution also used around 20% of the server CPU so I had enough headroom to enable compression of the data on the server with no performance hit.

So for now I will go with the second method, SMB and upgrade the CPU to something with a few more cores and a higher clock speed.

Update: After some more tweaks I was able to get a little under 50 MB/sec for both reads and writes for most situations. Lots of tiny files still dropped to lower transfer speeds. The processor is still maxed out most of the time.

Update Again: Actually I may not have changed anything. Sometimes it just seems to go faster. I haven't figured that out yet.