Allspark MK2 ESXi All In One Setup

Napp-it Log:
www.napp-it.org/doc/downloads/all-in-one.pdf

  1. Flash SAS card to IT mode (http://www.napp-it.org/doc/manuals/flash_x9srh-7tf_it.pdf)
  2. Disable Active State Power Management in BIOS
  3. Download from napp-it.org:
    • all-in-one.pdf
    • napp-it_13b_vm_for_ESXi_5.5.zip
  4. Download from VMWare:
    • vmware-vmvisor-installer
    • vmware-viclient
    • vmware-tools-linux
  5. Convert esxi iso into USB:
    • hdiutil convert -format UDRW -o output.dmg input.iso
    • sudo dd if=output.dmg of=/dev/rdisk1 bs=1m
  6. Install ESXI
  7. Install ESXI Client on Windows and run it to manage all things related to vM
  8. Configuration > Advanced settings > Add passthru (your LSI SAS storage controller)
  9. Unzip and upload napp-it_13b_vm_for_ESXi_5.5.zip via ESXI client
  10. Add napp-it-13b.vmx to inventory
  11. Edit Virtual Machine Settings and add new PCI hardware (your LSI SAS storage controller), modify CPU/Mem allowance
  12. Run the VM, select “I copied it” when asked on Summary tab
  13. In “Console” tab, log in as root no password, run “ifconfig” to grab the ip address (e.g. 10.0.0.x)
  14. Manage napp-it via browser: http://ip:81. Use VMXNET3 as NIC instead of E1000 (E1000 has stability issue)
  15. In napp-it now, “Disks” > “Initialize”, initialise all storage hdds
  16. “Pools” > “Create Pool”: create the raidz pool with hdds (leave overflow protection on)
  17. “ZFS Filesystems” > “Create”: select the just created pool from dropdown, type a name for it, leave everything default and submit (from now on samba share should be available)
  18. “ZFS Filesystems”: turn on “NFS” share for the zfs folder just created (nfs should be available now, the path is ZFS_SERVER/ZFS_FOLDER, for example, server/filesystem)
  19. IMPORTANT: need to run this line in napp-it server’s console (via ESXi) to fix OSX mount issue (otherwise you won’t be able to copy file into nfs share in Finder):
    • zfs set aclinherit=discard ZFS_SERVER
  20. Back to ESXI client
  21. Host’s “Configuration” > “Storage” > “Add Storage” > add “Network File System” with the host ip, folder and give it any name
  22. Host’s “Configuration” > “Virtual Machine Startup/Shutdown” > “Properties”: move the storage vm up from manual startup to automatic start up, then “Edit” to reduce start up delay to 10seconds, and shut down delay to 180 seconds (so it starts first, shut down last)
  23. Add new hosts

Update:

The following command line on Napp-it may help solve NFS share permission issue:

/usr/bin/chmod -R A=everyone@:rwxpdDaARWcCos:df:allow /PATH/TO/YOUR/ZFS

Allspark MK2

4 Western Digital WD Red 4TB WD40EFRX $996
1 Seasonic P-400 Fanless Platinum 400W V2 $189
1 Intel Xeon E3 1230 V3 $299
1 Samsung 840 Pro Series 128GB SSD Retail Box $145
1 Noctua NT-H1 Thermal Compound $12
2 Noctua NF-S12A ULN 120mm Fan $58
1 Supermicro X10SL7-F Motherboard $399
4 Kingston DDR3 1600 8GB ECC $340
1 Cooler Master Hyper 212 EVO CPU Cooler $39

1 Silverstone TJ08-E Black M-ATX/ITX Case $99 (Case too small to fit HDD cage + Cpu Fan)
1 Fractal Design Define Mini Case $129 (Used the case for Allspark MK1 instead)
2 LSI Molex MiniSAS SFF 8087 to 4xSATA 100cm $25 (Don’t need this since the connectors on motherboard is SATA already)