Most casual crypto miners use a conventional motherboard, especially if they have a PC/case/power supply with sufficient PCIe slots for their GPUs. But when you get beyond 2-4 GPUs, you either need a rat’s nest of riser extenders, or maybe (just maybe) a dedicated mining motherboard.
I recently got a new-to-me mining motherboard, and found it painful to find some information and resources I needed. I’m aggregating this information in this post, and it will get updated as I get more relevant experience with the ONDA motherboard in question. If you have any info to share, feel free to comment below and I’ll update. (Last update 2021-03-14)
I’ve mined with an Octominer 8-slot motherboard for 3 years now. In addition to an onboard Celeron 3855U and a single DDR3 SODIMM RAM slot (max of 8GB), it has eight PCIe x16 slots, so you don’t need to use the common x1-to-x16 risers. It’s complicated in that you have to power the motherboard with a number of additional power connectors (in this case, 6-pin PCIe power leads from the power supply). But it sits flat on a custom frame I ordered in 2018, and it doesn’t have much that I don’t need (like lots of drive controllers, extra memory slots, audio, etc). And if you get a custom mining power supply (or breakout board) with only 6-pin connectors, you’re in good shape.
Octominer has discontinued their 8-slot boards, and the boards may not support the latest GPUs on the market (much like the Ethos mining distro I used on it until this past week). I couldn’t get the board to boot with an AMD 5500XT GPU (Amazon, eBay) in the first slot, for example. So it’s chugging along with eight Sapphire Nitro+ RX580 8GB cards (Amazon, eBay), seven of which have been chugging for almost three years now.
While they still make custom boards, the only ways to get their products are either to find the rare used item on a marketplace, or to buy the one integrated rig they currently sell in quantities less than 10 (their x12 rig with everything but the GPUs, which runs almost $1,000 shipped to the US).
Another company making custom boards is ONDA. You can usually find them on eBay or other marketplaces for a couple hundred dollars, with a range of slot support. I found a good deal on the B250 D8P-D4 recently, and since I wanted to aggregate a mess of old GPUs, it was an easy way to go. Continue reading →
As you saw in my 3D Printing series, after years of pondering a 3D printer, I was finally inspired to buy one when a pile of clusters came up on eBay from the defunct rabb.it video streaming service.
In this series, I’ll take you through turning a rabbit door into some useful computing resources. You can do something similar even after the clusters are sold out; a lot of people have probably bought the clusters and ended up not using them, or you can adjust the plans here to other models.
The first thing I will put out there is that these are not latest-and-greatest state-of-the-art computers. If you’re looking for a production environment or DDR4 high density memory, keep looking. But if you want an inexpensive modular cluster that’s only about 5 years out of date, there’s hope for you in here.
The original cluster
eBay seller “tryc2” has sold several hundred of these “door clusters” from rabb.it, a now-defunct video streaming service that closed up shop in mid-2019. As of this writing, they still have a couple dozen available. I call it a “door cluster” as the 42 inch by 17 inch metal plate resembles a door, and gives you an idea of the ease of manipulating and fitting the environment into your home/homelab as it is delivered.
The cluster bundle will set you back US$300, plus tax where applicable. While they’re available, you can get one at this link and I’ll get a couple of dollars in commission toward my next purchase.
The cluster includes 10 Intel NUC quad-core boards (mine were NUC5PPYB quad-core Pentium; my friend Stephen Foskett got some that were newer NUC6CAYB Celeron boards which took more RAM). These boards feature one DDR3L SODIMM slot (max of 8GB), one SATA port with a non-standard power connector (more on this later), Gigabit Ethernet, HDMI out with a headless adapter (to fool the computer into activating the GPU despite no monitor being connected), four USB ports, and a tiny m.2 slot originally intended for wireless adapters.
In the center of the “door” are five NVIDIA Jetson TK1 boards. These were NVIDIA’s first low-end foray into GPU development, sold to let individuals try out machine learning and GPU computing. There are much newer units, including the Jetson Nano (whose 2GB version is coming this month), if you really want modern AI and GPU testing gear, but these are reasonably capable machines that will run Ubuntu 14 or 16 quite readily. You get 2GB of RAM and a 32GB onboard eMMC module, plus a SATA port and an SD slot as well as gigabit Ethernet.
The infrastructure for each cluster includes a quality Meanwell power supply, a distribution board assembly I haven’t unpacked yet, two automotive-style fuse blocks with power cords going to the 15 computers, and a 16 port Netgear unmanaged Gigabit Ethernet switch. With some modifications, you can run this entire cluster off one power cord and one network cord.
So there is a catch to a $300 15-node cluster. The Jetson nodes are component complete, meaning they have RAM and storage. However, the NUCs are barebones, and you’ll need some form of storage and some RAM.
For the Jetson nodes, you’ll need an older Ubuntu machine and the NVIDIA Jetpack software loader. For the installation host, Ubuntu 14.04 is supported, 16.x should work, and later versions are at your own risk. You’ll also need an Ethernet connection to a network shared with your Ubuntu machine, as well as a MicroUSB connection between your Ubuntu host and the Jetson, to load the official software bundle.
If you do get a cluster bundle with the two-memory-slot NUC boards, you have two options beyond the above. The easy and documented option is to look for 4GB SODIMMs instead of 8GB; you may save a buck or two, or if you’re like me, you may have a box of 4GB SODIMMs from various upgrades and not have to buy anything. The other option is to update your BIOS on the NUC and try out 2x 8GB. For some uses, 16GB will be worth the cost (vSphere or other virtualization clusters). I’d suggest going with a known quantity to update the BIOS to the latest version, and then trying 2x 8GB.
There are two paths to take once you have your gear collected and connected.
How do we lay out the gear?
What do we do with it?
I’ll look at my journey on both paths in upcoming episodes of this series. Spoiler: I’ve 3d-printed stacking plates for both the NUCs and the Jetsons, and am still working on how to mount the remaining pieces so I can e-waste the door piece. And as I write part 1, I still haven’t figured out what to do with the clusters.
Where do we go from here?
If you’ve bought one of these clusters (or more than one), feel free to chime in on the comment section and let me know what you’ve done with it. And stay tuned to this post (or @rsts11 on Twitter or Facebook) for updates on the next installments.
This is a post I’ve started three or four times, with different aims and detail, but since I haven’t gotten it posted and people keep asking, I thought I’d start with a simple build plan and some caveats and considerations.
Where I refer to a ‘rig’ here, it’s simply a system dedicated to, or purposed for, mining cryptocurrency of some sort. It might be a single board computer, or a dedicated device, or a PC with one video card (or just a good cpu), or an open frame build with lots of GPUs and a beefy power supply.
Big Hairy Audacious Caveats
The numbers in this article, from prices to currency rates, are based on the time of writing (which may have been a while before the time of posting). They are not guaranteed to last even as long as it takes for this article to post. I am not advising on the value or prospects of any mining or cryptocurrency. You may gain money, lose money, or break even, or your entire city may sink into the ground like a big ole glowing gopher, if you engage in cryptocurrency mining on any level. Do so at your own risk.
Two ODROID HC1 single board computers, next to a Transporter NAS device.
There are a lot of options out there, from multi-thousand-dollar ASIC miners for Bitcoin to sub-$50 single board computers that can mine Verium or the like. Your budget will determine a lot of the details of your rig, and your power cost may influence it as well. It’s also worth keeping family approval requirements in mind, since an Antminer may be noisy and generate a lot of heat, whereas a Raspberry Pi or ODROID might fit better behind something in your living room.
You can build a starter rig with one GPU, and depending on the GPU, you might be able to bring in $10-20 a week or more from that. Considering that you can do this with an existing PC and operating system, it may be an economical way to get your feet wet, and it won’t require messing with special power supplies, excessive cooling, or riser cards.
If you’re looking to impress people or make a lot of money, well, good luck. But you’ll be looking at open frame systems with riser cables or even multiplexers for PCIe. That’s beyond the scope of this post. Continue reading →