Experimenting with Intel Optane at home with the Intel NUC 7th Generation PC

Welcome back to rsts11 for the summer. We’ve got a lot to cover in the next few weeks.

I haven’t really done a build report in a while, so when I realized I was getting double-dinged for high power usage, I started looking around for ways to save power. One was my desktop PC, which while very nice (with 8 dimm slots and lots of features I don’t use), is using around 250-300W for a 3rd gen core i7 processor.

I decided, based on availability and curiosity, to build out a 7th gen Intel NUC (Next Unit of Computing) PC, which conveniently supports Intel Optane memory. You can read a lot about the Optane technology, but in this application it’s a turbo-charged cache for internal storage. The newer NUCs support it in place of a more conventional m.2/NVMe SSD (used alongside a 2.5″ SSD or HDD), and of course you can use it as an overpriced SSD if you don’t want to use the Optane software.

See my earlier post about an Intel NUC for use with VMware. That NUC is currently running Ubuntu and Splunk for training in the home lab.

I’ll take you through the build manifest and process, and then we’ll look at benchmarks for five configuration permutations.

Build manifest and current prices (July 6, 2018)

  • Intel NUC (NUC7i7BNH) tall mini PC, $450 at Amazon
  • (Optional: NUC kit with preinstalled 16GB Optane module, $489 at Amazon)
  • Intel Optane Memory flash module (16GB $34 – $39 at Amazon, 32GB $58 for Prime members or $72 otherwise at Amazon)
  • Crucial CT2K16G4SFD824A 32GB DDR4 memory kit is currently $310 (it was $172 when I bought it a year and a half ago, ouch).
  • HGST Travelstar 7K1000 1TB 7200rpm SATA drive is $57.
  • Seagate FireCuda 2TB SSHD is $92, with the 1TB version available for $60.
  • Keyboard, mouse, USB flash drive for Windows install, and living room television with HDMI were already in house, but if you’ve read this far, you probably have them and/or know how to choose them. After installation you can use a Logitech Unifying device or a Bluetooth device, but for installation I’d suggest a USB cabled device.
  • Windows 10 Professional can be had for $150 give or take. The actual software can be downloaded from Microsoft but you will need a license key if building a new system without entitlement.

You’re looking at about $1,000 for the full system at today’s prices. If you don’t need 32GB of RAM, stepping down to 16GB should save you at least $100.

Building the NUC

I’ve used Intel NUCs going back to the 3rd gen Intel core processors, so they’re fairly easy to get around. The system I chose, NUC7i7BNH, has the following features:

  • Intel Core i7-7567U processor (2 cores, 4 threads, 3.5-4.0GHz, 4MB cache, 28W TDP)
  • two DDR4 sodimm slots (max 32GB)
  • storage slots:
    • an M.2 (PCIe x4 2242/2280)
    • a 2.5″ SATA (SSD/HDD)
    • a MicroSDXC storage slot exposed on the side (unused by me so far)
  • integrated Intel AC8265 + Bluetooth 4.2 wireless module (unused by me)
  • Gigabit Ethernet
  • Thunderbolt 3 / USB-C (usable for any USB function, Displayport, Thunderbolt 3)
  • four available USB 3.0 ports (including a rapid charge port on the front)
  • two USB 2.0 headers on the board (more on that later)
  • dual microphones for Windows Hello etc
  • two configurable LED indicators on the front panel

I loaded it up with a 2400MHz 32GB DDR4 kit from Crucial. You can get by with 2133, but this was what I had on hand. You can probably get by with less than 32GB, but only you know for sure.

Likewise, I probably did a bit of overkill with the 32GB Optane module, and a 2TB 2.5″ Seagate FireCuda gaming drive (2TB spinning disk plus onboard flash memory). I do tend to keep a lot of downloads locally, including my entire Dropbox folder, and want to have the best acceleration possible.

Notably, the current generation of NUC doesn’t require you to buy a localized power cable; once you have RAM, storage, and a keyboard/mouse/display, you’re good to go.

Getting Optane drivers ready to go

Any of you who built systems in the first decade of SATA will get flashbacks from this, but you will probably need to install additional drivers to make use of Optane. Even with the 1803 release of Windows 10 (downloaded in the last three days from Microsoft), an Intel Rapid Storage Technology (RST) driver is required, as is the Optane application to enable/monitor/disable Optane technology.

Intel does have good documentation (pdf) on this, whether adding Optane to an existing Windows 10 installation, or installing fresh. You obviously need a motherboard and CPU that support the Optane technology. This will be 7th gen or newer Core processors, and motherboards that explicitly call out Optane support (just having an m.2 slot isn’t enough).

Five configuration options

I tested five storage options to get a feel for relatively objective performance.

The benchmark software I used included current versions as of July 5, 2018:

PCMark10 from Underwriters Labs – an application-style benchmark simulating various regular PC tasks
NovaBench from Novawave – a more component-based test that delves into applications a bit, but less than PCMark10
Crystal DiskMark – A pure storage test, using sequential and random read and write tests

Note that the results are for comparison only, and may not be validated with the benchmark sites. They are definitely not endorsed or even known by the benchmark software makers.

The storage options included:

1a. Travelstar 7200RPM 1TB SATA drive, no Optane
1b. Travelstar 7200RPM 1TB SATA drive, Optane enabled
2a. FireCuda SSHD 2TB SATA drive, no Optane
2b. FireCuda SSHD 2TB SATA drive, Optane enabled
3. Optane module itself (Crystal Diskmark test alone)

Tests 1a/1b were performed on the same OS install (fresh with no updates, offline, no network connectivity). Tests 2a/2b/3 were done on a new OS install, again no updates or network connectivity.

Results

Note that benchmarks are often worth less than the paper they’re printed on. I like to use them for comparison within a system over time, or to get some level of comparison between systems, but depending on what you’re doing, your results may be much better or much worse than these.

Novabench tests

Unsurprisingly, CPU, RAM, and GPU tests didn’t show a distinction between the four storage options. Also unsurprisingly, disk performance with Optane was much better than without. I was a bit surprised that unaccelerated writes were better on the standard 7200rpm disk compared to FireCuda.

NovaBench (graph above) showed 2-4x better writes with Optane, and 7-9x better reads, roughly speaking. PCMark10 (graph below) had less shocking results, but Optane improved the 7200rpm disk by 20% on “Essentials,” but only 3% on Digital Content Creation. With FireCuda, Optane only improved Essentials by 5% or so, and the other two tests were similar to the 7200rpm tests

PCMark10 tests

CrystalDiskMark showed similar jumps in performance, with sequential reads going up by 10x and writes 3x. The results for the 4KiB queued tests were absurdly higher, with the worst results being 250x higher on reads and 98x faster on writes.

You’ll notice that on some of the rows, the 7200rpm and FireCuda drives don’t even show up. The random read and writes came in around 1 MB/sec for each, whereas with acceleration via Optane, they came in 93 MB/sec at worst, 621 MB/sec at best.

CrystalDiskMark results

 

I also ran Crystal DiskMark against the Optane disk as an SSD with NTFS filesystem (disabled Optane technology with the app, and then partitioned/formatted with Disk Management in Windows). Effectively this was the result of an NVMe SSD; I would probably not bother with a 32GB SSD for Windows, but I wanted to see how those results would compare with an accelerated HDD.

Turns out, with the exception of the 4KiB Q8T8 read (which was 49% faster than the accelerated FireCuda and 74% faster than the accelerated 7200rpm disk), results were between 2% slower and 9% faster than the accelerated FireCuda.

Give your NUC a hat?

There are two USB 2.0 headers on the NUC motherboard that don’t go anywhere. There are no extra holes in the case to let you use them anywhere either. However, if you don’t plan to stack your devices and want an extra USB option or two, there are companies like GoRite who make feature lids for the 5th generation and later NUCs. Some of the options include a supplemental fan, USB 2.0 ports, audio, video (HDMI, DVI, VGA), external wifi antennas, serial ports, memory card readers, Fast Ethernet, TV tuners, and more. You can also just pick a different color for the lid if that’s all you need.

So where do we go from here?

I’ll be putting some time this weekend into migrating my files and apps to the new system so I can retire/migrate my power-hungry desktop.

The testing I’ve done, while rather generic and not exhaustive, definitely shows that an Optane module will improve your disk i/o performance. An SSD (whether M.2 or 2.5″ or both) will still be the best performance choice, but I was able to get a 2TB SSHD and the 32GB Optane module for less than the price of a good 1TB SSD.

Do you need the 32GB module? Maybe not, but for a larger spinning disk it may be worth it. You’ll see similar performance improvement with a 16GB module, though, so if you need the extra $30 for something else, go for it.

Have you tried Optane yet? If so, let us know what you think in the comments.

Update after two weeks use

I wrote this post, and sat on it for about two weeks so I could see how the Optane acceleration felt during my regular usage pattern over time.

The first couple of days were painful. Switching browser tabs would often lock up, and boot-up was not as fast as a pure SSD. I ordered an M.2 NVMe SSD in case I needed to scrap the Optane experiment, but as time went on, it got more stable.

I decided to disable Optane caching while I synced half a terabyte of Dropbox data. This may have been more superstition than actual benefit, but I figured the caching would not help me on sustained write, and I bought myself another write cycle in the process.

I later realized that part of the degradation may have been from a radical core count reduction. My previous system was a 3rd gen core i7 with 6 cores/12 threads, whereas this one is a 7th gen core i7 with 2 cores/4 threads. RAM is the same quantity (was 8x4GB DDR3, now 2x16GB DDR4), and I’d say the storage is a definite upgrade.

As I wrap up this post, I’ve been running on the Optane system for about 16 days, and it’s quite livable. I did export some of the peripheral connections to an OWC USB-C 10-port dock, which provides some additional charging capability as well as getting some of the USB-A connections off the NUC itself. I’ve plugged my Drobo into the dock, along with my Fitbit Ionic charger and a couple of other items. I could also run a second monitor this way (or even a third), but that would require some more desk space that I’m running short on.

All things considered, it’s a very viable desktop system, and I’m mostly happy with the performance and capacity. It will shortly be mounted on the back of my monitor (to help with airflow and free up some shelf space). And I am a bit tempted to replace the Optane with the ADATA NVMe drive I bought, but I think that may do better in another tiny PC that can’t use Optane (like an HP Elitedesk 800 G2 Mini I have in the home office).

Advertisements

Coming back to the NetBeez monitoring service – a gigabit agent and more

[Disclosures at the end, as usual. Also, since this post was begun, NetBeez has announced discontinuation of their free tier of service. There is still a 30-day trial, though, so if you’re looking at deploying a paid option, you can still try it out first.]

At Cisco Live this year, I won a NetBeez monitoring agent (in the form of a Raspberry Pi 2 model B). It took a couple months, but I finally got it plugged in and running. NetBeez were kind enough to offer me an expanded license for a couple of devices, so I could run them from my home, my workshop, and possibly even a mobile rig.

See the previous article for how I started using the gear, and why I wanted to upgrade almost as soon as I got the first agent going.

B is for Banana – Pro, that is

With a 200mbit+ connection at home, and a 100mbit Ethernet port on my agent, I hit an obvious bottleneck.

Luckily, though, I’d stocked up on a couple of Banana Pi Pro devices, and had a Raspberry Pi 3 Model B as well. Since the only device I have a case for is the Banana, that’s what I ran with. I later realized the Raspberry Pi 3 is also a 10/100 device, so it would not fix the problem, although it worked fine as an agent on my backup DSL connection (which maxes at 20Mbps). Continue reading

Quick Take: Antsle coming out with Xeon-D models with 10GbE in December

Welcome back to rsts11. Earlier this year you saw us post a first look at the Antsle “personal cloud” development systems, which provide a fanless, silent development and desktop cloud-style provisioning environment with the KVM hypervisor and Linux Containers (LXC).

Later, we built a system that approximated our view of the obvious evolution of Antsle’s model, albeit not fanless (thus not completely silent), and not as compact. We used the SuperMicro X10SDV-4C-TLN2F-O 4-core, 8-thread board that featured dual 10GbE copper ports and support for 64GB non-registered or 128GB registered memory.

Well, Antsle announced today that they will be releasing Xeon-D based models in mid December.

antsle-announcement-tweet

Their low-end machine, with similar specs to the 4-Core board we used, starts at $1,349. Models with 8-Core and 12-Core boards are also available.

antsle-xd-models

The prices jump more than the difference in board cost because the base RAM/SSD configurations also grow, as do the uplift options.

  • antsle one XD: $1,349 for 4-core, 16GB (upgradable to 32GB), 2x 256GB Samsung 850 Pro SSD
  • antsle one XD Pro: $2,499 for 8-core, 32GB (upgradable to 64GB), 2x 512GB Samsung 850 Pro SSD
  • antsle one XD Ultra: $4,499 for 12-core, 64GB (upgradable to 128GB), 2x 1TB Samsung 850 Pro SSD
  • The Avoton-based systems are still listed, starting at $759, and if you register for their mailing list, you will probably get occasional promotions and discount offers. You can also watch their social media profiles (Twitter, Facebook) for some of these offers.

We still haven’t ordered one of the Antsle boxes due to shifting project budgeting, but the idea still has promise. And they don’t seem to do eval boxes (although if they change their minds, we’d love to try one out).

As we noted in our original take on the antsle model, you can probably build something similar on your own, and if you find it worthwhile and/or practical to spend time building the hardware and software platform, you’ll probably have lower capital expense building it yourself. If you just want to plug a silent box in, plop it onto your desk, and go to work, the nominal added cost for the pre-built appliance is probably worth spending.

Have you tried the antsle platform, or built your own similar system? Let us know in the comments.

 

Disclosure: While I’ve had an email exchange with the CMO of antsle prior to writing the original antsle post in March 2017, I don’t get any consideration from antsle for discussing their product. And while it is relatively resilient (mirrored SSDs, ECC RAM), I wouldn’t recommend it for an enterprise deployment into production. But then, it’s explicitly not aimed at that market.

 

What verse are we on? The fifth! Back at Interop ITX Las Vegas

I’m back in Las Vegas for my fourth time this MLife season, and my fifth time at Interop (now Interop ITX). And it’s a little bit different this year. [Disclosures below]

Quick takes:

The most obvious change is the venue; they announced at the end of Interop 2016 that the event would move to MGM Grand’s Conference Center, one  Las Vegas block down the Strip from its previous home at Mandalay Bay. This means a smaller, more focused event, as MGM has a smaller facility than Mandalay, but it likely also means more affordable accommodations at the event hotels. (I would have enjoyed an extra Amex FHR stay at Delano, but Signature at MGM is good enough.)

Some staff changes have happened, particularly Meghan Reilly taking the reins of the event from Jennifer “JJ” Jessup, who moved on to a different company and role after last year’s event. JJ and the team encouraged me to stay involved with the event even after going to the Dark Side, and I’m grateful for her influence over the past few years. But I haven’t seen any fallout from the transition yet. The staff keeps things going, even with the traditional Monday hiccups on food and beverage logistics.

There also seems to be more of a focus on the educational content as opposed to the expo floor. Well over a dozen in-depths events will occupy each day Monday and Tuesday, with prominent names from various corners of the IT ecosystem. The “Business Hall” is still there, and will have about a hundred exhibitors according to the Interop website, but people have noticed many of the big names of past years scaled back or passing on the event altogether.  I’ve also seen some of my perennial favorites sit this one out.

I would say both of these items are good, for various reasons. While it was beneficial to have the Monsters of IT(tm) on the floor pitching their latest wares, I would expect this year to allow more of a focus on new, more agile, more adaptable players in the market. And with what seems (to me at least) to be a stronger focus on content vs exhibitors, the event becomes even more of a unique, substantially community-driven, substantially vendor-independent tech conference.

It’s true that if you want to see Cisco, Dell, and HP side by side, you’re mostly out of luck unless you find a third party proprietary conference (like VMworld or SAP Sapphire), but I expect that increased exposure to the new and rising players will have a positive effect on some of the larger companies. As each of the giants realizes they can’t differentiate based on their own true believers alone–and to be honest, that’s the core of each vendor’s own conference–perhaps they’ll come back to the table.

It’s also true that, if you are looking for more general IT and technology coverage than the USENIX events offer, especially around the business and culture side of IT, Interop ITX is pretty much the only game left in town.

Where do we go from here?

I’ll be heading into some content today and tomorrow, in between working on some other slides and writing. If you’re brave, follow me on Twitter at @gallifreyan for realtime observations, or if you’re attending Interop ITX, follow me on the app.

Disclosure: I attend Interop as independent media, on personal vacation time, not under the auspices of my day job. Tech Field Day generously brought me here my first two years, but for the past three years inclusive, I have attended on my own dime (although Interop does provide media attendees with lunch and coffee as well as full access to the conference). Any opinions in my coverage of the event are mine alone, and have not seen prior review by anyone involved in the event.

Further disclosure: autocorrect is being religious as I write this on my iPad. JJ’s last name became Jesus quite often, and apparently Apple wants Interop to have a stronger focus on convent. I’ll have nun of that, thank you.

System Build Report: A Xeon-D “HTPC” for FreeBSD Corral or VMware vSphere

I’ve been planning to do some network testing and deploy some new storage for VMware vSphere in the home lab. My Synology NAS boxes (DS1513+ and DS1813+) have good performance but are limited to four 1GbE ports each, and my budget won’t allow a 10GbE-capable Synology this spring. [See below for a note on those $499 Synology systems on Amazon.] Continue reading