Tag Archives: chia

A quick Chia plotting note and a future searchable tip

Posted on by
16

2022-10-07: Updated with dual Xeon v4 bladebit.
2023-02-11: Updated with a madmax cuda plotter invalid ndevices error
2023-02-20: Updated with madmax cuda plotting with 128GB RAM 

The backlog is getting more interesting, but in an attempt to compare a Xeon Silver processor to one or two E5-2620v4 processors for some future Chia plotting, I’ve arrived at some benchmarks and a bladebit caveat for the new diskplotter.

The idea is to replace my OG plots with NFT-style plots, while still self-pooling them. At some point I will probably expand my storage again as well. 

Links are to original manufacturer specifications. If you find this document useful, feel free to send me a coffee. It might help with the memory upgrades on one or both machines too.

The systems involved:

System one:

Quick observation: On my Monoprice Stitch power meter, this system goes from about 60W at idle to 160W while plotting with Madmax or Bladebit. Not surprising, but noisy and blowy. 

System two:

Quick observation: This storage is very suboptimal for plotting, but it’s what came with the systems. I will dig into whether I have a larger faster SSD. Unfortunately this system only has USB 2.0 externally, and one low profile PCIe slot, so I’m a bit limited. Might put a 1TB NVMe drive in the PCIe slot though and see how that goes. 

System three (I’ve written about this one before):

  • Dell Precision Workstation T7910
  • Dual Xeon E5-2650Lv4 (each 14c28t)
  • 128GB RAM
  • 4x 1TB Samsung NVMe drives on the Ultra Quad (PCIe 3.0 x4 per drive) in software RAID-0
  • Ubuntu 22.04.1 LTS with current updates as of February 2023

Plotters:

Metrics so far:

System one, Chiapos with 12200MB memory assigned

Time for phase 1 = 10876.922 seconds. CPU (147.640%) Sun Oct 2 19:31:42 2022
Time for phase 2 = 4247.395 seconds. CPU (97.160%) Sun Oct 2 20:42:29 2022
Time for phase 3 = 9153.365 seconds. CPU (95.640%) Sun Oct 2 23:15:03 2022
Time for phase 4 = 635.266 seconds. CPU (97.980%) Sun Oct 2 23:25:38 2022

Total time = 24912.949 seconds. CPU (118.660%) Sun Oct 2 23:25:38 2022

System one, Madmax with -r 10

Phase 1 took 1461.93 sec
Phase 2 took 773.745 sec
Phase 3 took 1241.66 sec, wrote 21866600944 entries to final plot
Phase 4 took 61.6523 sec, final plot size is 108771592628 bytes
Total plot creation time was 3539.07 sec (58.9845 min)

System one, Bladebit with 16GB cache configured

Bladebit plot with 16G cache
Finished Phase 1 in 1744.37 seconds ( 29.1 minutes ).
Finished Phase 2 in 174.39 seconds ( 2.9 minutes ).
Finished Phase 3 in 1501.98 seconds ( 25.0 minutes ).
Finished plotting in 3420.74 seconds ( 57.0 minutes ).

System two with SN_750 NVMe drive (500GB), Bladebit with 24G cache

Finished Phase 1 in 1376.37 seconds ( 22.9 minutes ).
Finished Phase 2 in 148.09 seconds ( 2.5 minutes ).
Finished Phase 3 in 970.59 seconds ( 16.2 minutes ).
Finished plotting in 2495.06 seconds ( 41.6 minutes ).

Gigahorse metrics so far:

System three:

./cuda_plot_k32 -C 5 -n 5 -t /nvme/chia/ -2 /nvme/chia/ -d /plots/gigahorse-cuda/ -c xch1xxxxx -f a00fcxxxxx

Total plot creation time was 380.192 sec (6.33654 min)
Total plot creation time was 336.725 sec (5.61209 min)
Total plot creation time was 355.188 sec (5.9198 min)
Total plot creation time was 374.554 sec (6.24257 min)
Total plot creation time was 388.424 sec (6.47374 min)

The bladebit diskplot quirk:

If you get this error, there’s a good chance you didn’t specify the destination for the plot. 

 Allocating memory
terminate called after throwing an instance of 'std::logic_error'
what(): basic_string::Mconstruct null not valid
Aborted (core dumped)

So for example:

./bladebit -n 3 -f <farmerkey> -c <poolcontract> diskplot -t1 /nvme/tmp/ --cache 16G 

would give this error. Unlike the other plotters, it does *not* assume that your temp path is your output path if you only specify the temp path. So you’d use:

./bladebit -n 3 -f <farmerkey> -c <poolcontract> diskplot -t1 /nvme/tmp/ --cache 16G /nvme/plots/

instead. 

The gigahorse cuda plotter error:

With GPU-enhanced plotting now available in released (binary-only) code from Madmax, I decided to throw a modern GPU into my T7910, repair the post-22.04-upgrade mount failures, and give it a try. 

As a reminder from previous posts, this is a dual E5-2650L v4 system with 128GB RAM and 4x 1TB NVMe on the Ultra Quad card. It boots from a 256GB NVMe drive on a PCIe card, and has 4x 8TB SAS drives that don’t seem to be recognized after a few months off. Probably a SATA controller or cable issue, but life goes on. 

So I put one of my RTX 3060 LHR cards in, fixed up the NVMe stuff a bit, and went to run cuda_plotter_k32. It should do the partial memory plot, but alas, I got an error:

Invalid -r | --ndevices, not enough devices: 0

The card showed up in lspci, but then I realized it needed NVIDIA drivers. So I installed the 530 server bundle and tools, and then the plotter worked. 

Alas, the first GPU enhanced plot seems to have wedged the machine against interactive use. Looks like that’s a memory issue that I’ll have to work out, probably by adding memory. 

I will update this with further stats, and maybe make a comparison chart, as testing progresses. I’m also giving serious thought to upgrading the SSD in the dual-E5 machine. 

Obligatory disclosure:

While I work for Supermicro at the time of this writing, the servers and all other elements of my home labs and workspaces are my own and have no association with my employer. This post is my own, and my employer probably doesn’t even remember I have a blog, much less approve of it. 

Revisiting Flexfarmer five months later – efficient Chia farming on Raspberry Pi and more

Posted on by
1

This is another piece on a part of the Chia and cryptocurrency landscapes. See previous posts at https://rsts11.com/crypto

Back in August 2021, I wrote here about Increasing Chia farmer efficiency with Flexpool’s new FlexFarmer. I was alpha testing on Windows, Linux, and a Rock64 Pi-like computer before that, and I found that it was quite efficient, handling my 90TB farm easily on any platform without breaking a sweat, and carving around 100 watts off the power I needed to keep a dedicated farmer going.

Five months and several versions later, I wanted to come back with my experience and observations since then. I’ll also answer a couple of frequently answered questions here, for those of you who have common questions.

Disclosure: I still work for Flexpool as of this writing, but this post is based on my experience, not a press release or the pool admin’s expectations. Some of the testing I did was “on the clock” alongside support tasks, but I was not paid or asked to write this post.

Quick Flexfarmer recap

The basics are the same. With a tiny distributed binary and config file (under 10MB download) and the specifics of your PlotNFT in Chia (farmer secret key, launcher ID, payout address), at least one plot, you can start farming Chia without a fully synced node (which could save you over a week on a Pi-class machine, and at least a day or more on a more full-size PC).

Want to build a compact, inexpensive machine for farming? Read my three suggestions from a January 2022 post.

Continue reading →

Three ways to build low profile Chia (and forks) nodes

Posted on by
1

This is another piece on a part of the Chia and cryptocurrency landscapes. See previous posts at https://rsts11.com/crypto

Need to set up a lightweight VPN to get into your low profile node remotely? Check out Stephen Foskett’s writeup on Zerotier. I’m using it on my Pi nodes to reduce NAT layers.

Many if not most Chia farmers run a full node on their farming / plotting machine. Some larger farms will use the remote harvester model, with a single full node and several machines farming plots on local storage. 

If you’re using Flexfarmer from Flexpool, or just want a supplemental node (maybe to speed up your own resyncing, or to supplement decentralization on the Chia network), you might want a dedicated node that doesn’t farm or plot. And for that use case, you don’t really need dual EPYC or AMD Threadripper machines. 

In fact, a well-planned Raspberry Pi 4B 4GB or 8GB system, with an external USB drive, will do quite well for this use. If you want to do a few forks as well, or another blockchain full node, a moderately-recent Intel NUC would do quite well for not much more. 

So here we’ll look at three builds to get you going. Note that any of these can run a full node plus Flexfarmer if you want, or just a full node. 

If you don’t already have Chia software and a full node installed, go ahead and install and sync the node on a full scale PC. it may save you five days of waiting. My original build for this use case was to test the blockchain syncing time from scratch.

Syncing from a semi-optimal Pi 4B from scratch took about 8 days, for what it’s worth. One member of the Chia public Keybase forum reported about 28 hours to sync on an Intel Core i5 12600k. 

Caveat: Raspberry Pi boards are a bit more challenging to find and even harder to find anywhere near the frequently-touted $35 price point, or even under $150. And for Chia nodes, you want a minimum of the 4GB Pi 4B (8GB wouldn’t hurt). So while it’s possible to run on older hardware, it’s not recommended.

 

You might also be able to run on a Pi400 (the Raspberry Pi 4B in a keyboard case, which is much easier to find for $100 or so, complete). I plan to test this soon.

 

Raspberry Pi with external USB SSD. 

This was my initial build, and today it’s running at the Andromedary Instinct providing an accessible full node for about 10-15 watts maximum. 

Continue reading →

Turnkey Chia farming with Evergreen Miner, and making your own compact farmer

Posted on by
Reply

Disclosures at the end, as usual

The Evergreen site and product line have evolved since this post was made in late 2021. I’m planning to update the coverage soon, but don’t be surprised if product names and prices have changed since then.

If you’ve bought your Evergreen Miner, you may have questions answered at my unofficial FAQ.

In the mean time, I have (as of January 2023) joined the Evergreen Systems Co. affiliate program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to the partner site. If you’d like to buy some of their gear, use the link https://evergreenminer.com/?ref=g2vkXM2BkDi2m, or use the referral code RSTS11 for a $10 discount, and I may receive a commission.

A few years ago, a turnkey desktop container/VM platform from Antsle came along, and I thought “this is cool, but I bet I could make one myself.” You can read about that here on rsts11.

Earlier this month I saw a low power Pi-based project similar to the Antsle Nano (which I did build on my own) come out for Chia farming. The project, Evergreen Miner (evergreenminer.com), is the brainchild of a young geek named Dylan Rose who’s worked with Amazon and other companies and has begun an interesting forward-looking Chia project to really bring Chia farming to the masses.

I’ve written about building your own Chia system, and lots of people (tens of thousands at least) have done so. But some people aren’t up for the space, expense, time, tuning, software building, and so forth to make a node and farm.

However, a lot of people could benefit from the technology and platform and even more into the future as the ecosystem matures. So the idea of a turnkey platform that’s relatively easy to build and maintain and expand, even without plotting on your own, sounds pretty good.

Think all of the functionality and potential of Chia, with the ease of setup and management of a typical mobile app, and of course the power draw of an LED light bulb or two. No hardware or Linux or filesystem or SAS knowledge required.

Continue reading →

Increasing Chia farmer efficiency with Flexpool’s new ‘FlexFarmer’

Posted on by
7

There’s an updated Flexfarmer post aso f January 2022. Check out Revisiting Flexfarmer five months later.

You’ve probably seen my previous Chia posts, including how to build an efficient but sufficiently beefy plotter/farmer. As a long-time datacenter guy, I like building affordable, powerful servers.

Chia-specific cryptocurrency posts

However, as many farmers have found, if you plot and farm on the same machine, I/O can impact your farming performance, whether it’s disk I/O within the box, or writing off to a network share somewhere.

On top of that, you have to maintain a full Chia node, and optimally set up distributed harvesting with a somewhat complicated process. The full node currently requires about 13GB of local storage and frequent writes, so a Raspberry Pi or the like with an SD card is suboptimal. This also requires up to two days (for most computers) to sync the node initially, during which time you’re not at your best as a farmer.

Imagine if you could farm with the plots you have, using a tiny computer with very little CPU / RAM / storage requirements, without running and maintaining a full node, and saving 100W or more in the process.

Flexpool has just released their ‘FlexFarmer’ program which does just that.

Disclosure: I do work for Flexpool, but this post is based on my experience, not a press release or the pool admin’s expectations. Some of the testing I did was “on the clock” alongside support tasks, but I was not paid or required to write this post.

What does FlexFarmer do?

At a high level, FlexFarmer communicates with a node proxy on the pool server to communicate work and space, instead of requiring a local full node to operate. This means that anything that would require a full Chia node is handled on a powerful, resilient node at the Flexpool end.

You do still need to install the full Chia software to create your wallet. There will probably be ways around this in the future. You will also want a more formidable system for plotting, as the Raspberry Pi isn’t good for more than 1-2 plots a day.

Continue reading →