~$1000 EXSI Build?

A

AnotherUser

Limp Gawd
Joined
Oct 7, 2011
Messages
137
I'm looking to setup an EXSI box that I can use to host Windows and linux servers for labs. I don't plan on doing a lot on these but I'd like to get started.

I'd prefer to have this in an ATX case since I already have extra. Other than that though I don't have much extra hardware. I have storage space but it's just WD Green drives on another Windows host, probably would function very slow.

Is a decent build possible with $1k? What should I look for?
 
Get hardware with VT-d/IOMMU support. Better to have your storage done by another host, even if it's slow. Here's 32GB of DDR3 for less than $200 if you don't care about ECC (not really necessary for a lab, but depends on what motherboard/CPU you go with).
 
CEpeep said:
Get hardware with VT-d/IOMMU support. Better to have your storage done by another host, even if it's slow. Here's 32GB of DDR3 for less than $200 if you don't care about ECC (not really necessary for a lab, but depends on what motherboard/CPU you go with).
Click to expand...

I did see these sticks, not concerned with ECC at this time. I'm just not sure what proc/mobo to go with here and if the RAM was worth it. At first, I'd like to stick with the disk I have now, even if it is slow just so I can buy into that later.
 
 
AnotherUser said:
I did see these sticks, not concerned with ECC at this time. I'm just not sure what proc/mobo to go with here and if the RAM was worth it. At first, I'd like to stick with the disk I have now, even if it is slow just so I can buy into that later.
Click to expand...

Do you have your heart set on AMD vs Intel? AMD is cheaper for lower-end IOMMU-capable hardware, but Intel has more features available on the high-end like IPMI/embedded VNC if you go with server hardware. With your budget, you can probably get batter bang-for-the-buck by going AMD, or at least save money that you can invest into network equipment or storage. This is a list of which CPU/mobo combos support VT-d/IOMMU, and should be a good starting point for your build:
http://wiki.xensource.com/xenwiki/VTdHowTo

Again, if you can leave your storage disk in another machine and connect to it over NFS/iSCSI, that's the way to go as far as inexpensive storage is concerned. Your other main option is to do an all-in-one ZFS build, but that requires the purchase of a PCI-E storage controller, which may inflate the build beyond your budget when drives are included.
 
CEpeep said:
Do you have your heart set on AMD vs Intel? AMD is cheaper for lower-end IOMMU-capable hardware, but Intel has more features available on the high-end like IPMI/embedded VNC if you go with server hardware. With your budget, you can probably get batter bang-for-the-buck by going AMD, or at least save money that you can invest into network equipment or storage. This is a list of which CPU/mobo combos support VT-d/IOMMU, and should be a good starting point for your build:
http://wiki.xensource.com/xenwiki/VTdHowTo

Again, if you can leave your storage disk in another machine and connect to it over NFS/iSCSI, that's the way to go as far as inexpensive storage is concerned. Your other main option is to do an all-in-one ZFS build, but that requires the purchase of a PCI-E storage controller, which may inflate the build beyond your budget when drives are included.
Click to expand...

I've never run any AMD machines in my home until my HTPC and I don't have any reason not to.

I'm not sure if I wan to use existing disk as they are WD green so they are already slow and this is one of my current issues when I try to virtualize on my desktop.

Are there any CPU/Mobo combos that are common for these setups? I'll need all components except case and ROM drive but I don't want to spend any more than $1k right now. Being able to upgrade would be great though.
 
I'll be keeping an eye on this thread as I'm also looking to build a decently priced ESXI box.
 
I just sen't him a pm :)

I'm about to put up my Asus 1U server ITS VERY VERY QUIET!

has a Quad Core xeon inside
32gigs DDR3 ECC memory
2 x 500gig hot swap drives
Rails
DVD drive
All manuals & original Boxing / Packaging

800$ plus 125$ shipped with insurance to USA! has 2 years left on warranty.

can see it at my blog address below..
 
dashpuppy said:
I just sen't him a pm :)

I'm about to put up my Asus 1U server ITS VERY VERY QUIET!

has a Quad Core xeon inside
32gigs DDR3 ECC memory
2 x 500gig hot swap drives
Rails
DVD drive
All manuals & original Boxing / Packaging

800$ plus 125$ shipped with insurance to USA! has 2 years left on warranty.

can see it at my blog address below..
Click to expand...

a 1U is not what I was looking for but it is interesting for specs and price. How would this CPU do for VMs?
 
AnotherUser said:
a 1U is not what I was looking for but it is interesting for specs and price. How would this CPU do for VMs?
Click to expand...

im running 6-9 vm's and its running fine.

2 rdp session boxes sbs & exchange & website in another 2 debian test vm's and many more..
 
I recently built two of these:
1 x ($189.99) SUPERMICRO MBD-X8SIL-F-O
2 x ($69.99) Kingston 8GB (2 x 4GB) KVR1333D3E9SK2/8G
1 x ($99.99) LIAN LI PC-A04B Black Aluminum MicroATX Mini Tower
1 x ($44.99) Antec NEO ECO 400C 400W Continuous Power
1 x ($5.99) Mushkin Enhanced Prospector 4GB USB 2.0
1 x ($204.99) Intel Xeon X3430 Lynnfield 2.4GHz LGA 1156 95W Quad-Core BX80605X3430
---------------------
Total: $685.93

I have a third server of lesser specs running my iscsi storage, but you could easily throw an SSD in this box and still keep it under $1k.

So far I'm up to 6 win 2k8 vm's + some linux distros on each server and there's room for more.

Very happy with the build and love supermicro's IPMI!
 
shnelson said:
I recently built two of these:
1 x ($189.99) SUPERMICRO MBD-X8SIL-F-O
2 x ($69.99) Kingston 8GB (2 x 4GB) KVR1333D3E9SK2/8G
1 x ($99.99) LIAN LI PC-A04B Black Aluminum MicroATX Mini Tower
1 x ($44.99) Antec NEO ECO 400C 400W Continuous Power
1 x ($5.99) Mushkin Enhanced Prospector 4GB USB 2.0
1 x ($204.99) Intel Xeon X3430 Lynnfield 2.4GHz LGA 1156 95W Quad-Core BX80605X3430
---------------------
Total: $685.93

I have a third server of lesser specs running my iscsi storage, but you could easily throw an SSD in this box and still keep it under $1k.

So far I'm up to 6 win 2k8 vm's + some linux distros on each server and there's room for more.

Very happy with the build and love supermicro's IPMI!
Click to expand...

I will look into this also. Still weighing my options and trying to find the best config for me.

More recommendations are appreciated.
 
Here is what I'm looking to build my esxi host with.

CPU 239.99 Intel Xeon E3-1230 http://www.newegg.com/Product/Product.aspx?Item=N82E16819115083
Motherboard 199.99 SuperMicro MBD-X9SCM-F-O http://www.newegg.com/Product/Product.aspx?Item=N82E16813182253
Memory 139.98 Kingston ValueRam http://www.newegg.com/Product/Product.aspx?Item=N82E16820139262
Case/PSU 79.99 Apevia X-QPack (Black), MicroATX Desktop, 420W http://www.newegg.com/Product/Product.aspx?Item=N82E16811144162
NIC 317.98 2x Intel EXPI9402PT Dual Port Server Adapter 10/100/1000Mbps PCI-Express http://www.newegg.com/Product/Product.aspx?Item=N82E16833106014
Boot Device 10.99 Patriot Xporter XT Boost 4GB Flash Drive http://www.newegg.com/Product/Product.aspx?Item=N82E16820220251

Comes out to $988 that doesn't include shipping. I'm sure other sites might have these items for cheaper as well.
 
Hey NCFire, I would check your NIC card i was able to get 2x 4-Port Pci-Express Dell Nics [YT674] (Used all be it) for like 125/each on ebay but that was a few months back, you might be able to get a pair of em for 150/ea still more nic ports == more fun unless you were picking these nics for a specific reason.. just wanted to throw that out. also if this is going in 1 box then u dont waste PCI-Express port space...

its a shame your bord doesnt use ECC/Registered memory that has been going cheap 65-75/ 8GB DImm at least for the ones i use...
 
NCFireRescu said:
Here is what I'm looking to build my esxi host with.

CPU 239.99 Intel Xeon E3-1230 http://www.newegg.com/Product/Product.aspx?Item=N82E16819115083
Motherboard 199.99 SuperMicro MBD-X9SCM-F-O http://www.newegg.com/Product/Product.aspx?Item=N82E16813182253
Memory 139.98 Kingston ValueRam http://www.newegg.com/Product/Product.aspx?Item=N82E16820139262
Case/PSU 79.99 Apevia X-QPack (Black), MicroATX Desktop, 420W http://www.newegg.com/Product/Product.aspx?Item=N82E16811144162
NIC 317.98 2x Intel EXPI9402PT Dual Port Server Adapter 10/100/1000Mbps PCI-Express http://www.newegg.com/Product/Product.aspx?Item=N82E16833106014
Boot Device 10.99 Patriot Xporter XT Boost 4GB Flash Drive http://www.newegg.com/Product/Product.aspx?Item=N82E16820220251

Comes out to $988 that doesn't include shipping. I'm sure other sites might have these items for cheaper as well.
Click to expand...


I'm looking at doing something similar as you, and I'm wondering, why are you buying those Intel network adapters? Do the ports on that motherboard not work with esxi, or do you just want more ports?
 
They'll serve different purposes. Some will be dedicated for ISCSI, one for management network, others for regular traffic. I intend to convert my home network to an AD environment to have working practice for the MCITP. I chose those adapters because they are server class network cards. They have outstanding reviews.

Ultimately I'll have two ESX hosts for redundancy in case one host goes down.
 
I forgot to mention the add in quad port nics I'm using in my builds, as I had them laying around it wasn't something I needed to include in the purchase.

For a standalone ESXi box, I wouldn't worry about having anything more than a pair of gig ports available.

If you are planning on network (iscsi) storage, it's absolutely essential to seperate that traffic for best performance.

NCFireRescu your build & purpose sounds identical to mine. Just getting started on the MCITP here :)
 
It's a slow build in progress :) Got to wait for the tax fairy to drop a deposit in my bank account. Plus I want to build the storage server first. ESX host won't do me any good without a storage server :p

Also trying to get work to pay for a technet subscription. If that falls through I'll ultimately pay for it myself, but if I can get them to chip in for that it's one less thing I have to worry about.
 
I sprung for the technet sub a few weeks ago, though I am finding it cool it definitely is not needed for the mcitp track. You get something like 180 days before you need to activate server 2008 r2, if can't finish my lab work in that time I'm doing something wrong lol. Also hear you on waiting the the funds, I was in the same boat until I realized my newegg card was at zero balance and ready for another year of no interest :). Whatever I can't get covered through work, I'm hoping will help me with next years deductions (if done right).

I started my storage server build first, and I'm glad I did. 4 weeks into building it I'm still piecing in the final parts & making upgrades here and there lol. Have two more 1tb drives on order and am working ebay for a pair of SSDs to use as redundant ZIL on my raidz storage. I threw an extra NIC in this box and am running a LAGG interface for 2gbps, noticed a substantial iscsi improvement after implementing this.
 
My set-up cost me way less than $1000. May not be quite as capable as some of the listed systems but it has been rock solid so far.

x6 1045T $110 from Microcenter
Asus 970x $100 (IOMMU supported)
16GB cheap DDR3 $65 (I wish I had gone for 32GB but I was going for cheap as possible)

I already had a spare Intel gb nic, heatsink, case and a non-expensive psu. Decided to also pick up a 120GB SSD as a datastore. I posted a SS of my client summary in the esxi thread.
 
dashpuppy said:
do you need rack mount or tower ?
Click to expand...

It don't really matter really. I have the space for both, just no rack.

In addition to the Asus Dashpuppy was showing off, I was looking at this Dell:
http://www.ebay.com/itm/DELL-POWERE..._EN_Servers&hash=item58922ed75a#ht_8087wt_952
Or what about this HP? I don't know much about the HPs but it looks like the specs are the same, not sure about the CPUs?
http://www.ebay.com/itm/HP-PROLIANT..._EN_Servers&hash=item27c30c6321#ht_5586wt_952

Problem with that is it's going to be much louder compared to the Asus, although I'm told it can be modded.
 
Last edited:
As an eBay Associate, HardForum may earn from qualifying purchases.
AnotherUser said:
It don't really matter really. I have the space for both, just no rack.

In addition to the Asus Dashpuppy was showing off, I was looking at this Dell:
http://www.ebay.com/itm/DELL-POWERE..._EN_Servers&hash=item58922ed75a#ht_8087wt_952
Or what about this HP? I don't know much about the HPs but it looks like the specs are the same, not sure about the CPUs?
http://www.ebay.com/itm/HP-PROLIANT..._EN_Servers&hash=item27c30c6321#ht_5586wt_952

Problem with that is it's going to be much louder compared to the Asus, although I'm told it can be modded.
Click to expand...

Unless you've got a utility room or garage to put those in, I'd avoid it. Even running off one psu in balanced mode they are very loud. Expect a higher electric bill as well. The DL360 I was running consumed more kwh than the three consumer class systems I replaced it with.

Don't get me wrong - enterprise class systems are a lot of fun to play with and very powerful... but if you don't need the high availability and redundancy it makes no sense for a home lab... in my opinion.
 
As an eBay Associate, HardForum may earn from qualifying purchases.
shnelson said:
Unless you've got a utility room or garage to put those in, I'd avoid it. Even running off one psu in balanced mode they are very loud. Expect a higher electric bill as well. The DL360 I was running consumed more kwh than the three consumer class systems I replaced it with.

Don't get me wrong - enterprise class systems are a lot of fun to play with and very powerful... but if you don't need the high availability and redundancy it makes no sense for a home lab... in my opinion.
Click to expand...

That's kind of what I figured, for the cost I was not sure how they would go up agains't that Asus box or something I can build.

Something ATX may work better for space and noise, I just need to find the hardware that is best.
 
AnotherUser said:
That's kind of what I figured, for the cost I was not sure how they would go up agains't that Asus box or something I can build.

Something ATX may work better for space and noise, I just need to find the hardware that is best.
Click to expand...

the box i have sits in my room that i work in, i don't hear the box at all, unless it gets rebooted.

ONE MAIN REASON why i bought the asus, its dead silent, once and a while you can hear the fan purr a little but nothing that would distract you.

if i have to or to show everyone, this unit's quietness, i can take a video and put it on you tube.

Dash.


here is a screen shot of it working :)

xen-rams.jpg
 
Last edited:
Wish there were more details about newer AMD boards and ESXI floating around out there. I've got a Microcenter nearby and the 8 core Bulldozer + motherboard for ~$200 (w/ tax) is tempting.
 
Part of me wishes I went for the 8 core bulldozer, but for my needs this thing is more than adequate. I am planning to do some streaming and transcoding with it but never more than 1-2 streams most likely.

^What motherboards were you looking at in particular? From my understanding all AMD boards from the 970X+ should support IOMMU.
 
SkuLLy|RT said:
Wish there were more details about newer AMD boards and ESXI floating around out there. I've got a Microcenter nearby and the 8 core Bulldozer + motherboard for ~$200 (w/ tax) is tempting.
Click to expand...

just have to look at ram and the boards max...
 
I keep thinking about that Asus Dash has but I also keep thinking it would be nice to keep things in an ATX desktop style PC.

There dosen't seem to be much consensus on what CPU/MOBO to run, I'll keep my eye out and continue reading though.

Thanks for all the help.
 
I'm liking the 8 cores but the 125 watts is the killer vs. an 8 thread (4 core + HT) Xeon at 80 watts. The AMD is so much cheaper but you'll just pay it out to the power company of the next couple years.
 
netwerkz101_lab2.jpg


It's a good starter host that supports:
- Intel vPro
- Intel VT-x
- Intel VT-d

Later you can add:
- Multiport gigabit NIC for storage link.
- 16GB memory if your VMs need it.
 
I'm back at this again. Now I'm looking at an IBM System x3950 w/ 32Gig of RAM, a handful of 73gig SAS drives and 2x 3Ghz Dual core 7120M Xeons.

Would this be a decent setup for EXSI? I would assume this would work well along with dual Intel Pro/100 Nics.
 
AnotherUser said:
I'm back at this again. Now I'm looking at an IBM System x3950 w/ 32Gig of RAM, a handful of 73gig SAS drives and 2x 3Ghz Dual core 7120M Xeons.

Would this be a decent setup for EXSI? I would assume this would work well along with dual Intel Pro/100 Nics.
Click to expand...

that's going to be one PIG of a power sucking machine, and 800fsb :( booooooooo

http://ark.intel.com/products/27283/Intel-Xeon-Processor-7120M-(4M-Cache-3_00-GHz-800-MHz-FSB)


Probably going to be LOUD too!

This must be the system your looking at,

http://www.ebay.com/itm/IBM-System-...EN_Servers&hash=item3376ac3dcd#ht_1724wt_1064

Id say PASS!! on it.
 
As an eBay Associate, HardForum may earn from qualifying purchases.
AnotherUser said:
I'm back at this again. Now I'm looking at an IBM System x3950 w/ 32Gig of RAM, a handful of 73gig SAS drives and 2x 3Ghz Dual core 7120M Xeons.

Would this be a decent setup for EXSI? I would assume this would work well along with dual Intel Pro/100 Nics.
Click to expand...

Are your requirements from the original post still the same? Windows and Linux VMs?
Still a $1000 budget?

Are those VMs for learining the OS or are you going to be loading some heavy duty apps on them that demand high CPU, RAM, and storage IO requirements?

If all you want is simple virtualization of the OSs for learning them, then you'd be fine with a desktop system that will be easier on your wallet and ear drums.

PS ... is the "Pro/100" a typo? or is it really 100Mbit NICs?
 
You must log in or register to reply here.
Back
Top