Share this
What is NVMe? A Guide to Non-Volatile Memory Express
by Will Shirley on May 13, 2021 11:30:00 AM
Photo: An M.2 NVMe SSD, for used high-speed, PCIe-based reading and writing of data
Non-volatile storage media has long been one of the most restrictive bottlenecks in high-performance computing.
Humanity generates 2.5 quintillion bytes of data daily. That data has to be stored somewhere, and in the modern computing ecosystem, consumers expect to be able to access it instantaneously.
The speed increases afforded from the movement to flash storage from traditional HDDs in the last decade quickly saturated contemporary storage interfaces, such as SATA and SAS. Thus, the industry has defined new standards, such as Non-Volatile Memory Express (NVMe), to outline how new storage devices should communicate over the PCIe bus.
The PCI Express bus’ serial nature, high speed, and low latency make it an ideal candidate for superseding Serial Advanced Technology Attachment (SATA) or Serial Attached Small Computer Systems Interface (SAS) for storage interconnectivity.
Photo: A closeup of a Samsung 970 PRO M.2 NVMe SSD
What is NVMe?
NVMe, which stands for Non-Volatile Memory Express, is a computer storage interface that uses the Peripheral Component Interconnect Express (PCIe) bus to transfer data to and from solid-state drives (SSDs) at high speeds.
The NVMe specification is the industry standard for PCIe-based SSDs and is known for its lower latency, higher input/output per second (IOPS), lower power consumption, lower total cost of ownership, and improved scalability when compared to aging interfaces like SATA or SAS.
The NVMe specification is owned and maintained by the non-profit consortium NVM Express, which comprises dozens of members in the technology and high-performance computing sectors, including IBM, Intel, NVIDIA, Microsoft, Micron, NGD Systems, and many others.
The most recent version of the NVMe specification, NVMe 1.4b, was released on September 20, 2020.
Before NVMe, SSDs relied on SATA or SAS for data transfer, and both SATA and SAS are still widely used today. But NVMe revolutionized data storage by increasing the speeds at which information on SSDs is accessed. Its developers accomplished this goal by exploiting the concept of parallel computing.
Today, the NVMe interface is implemented in SSDs of various form factors, most notably the M.2 and U.2 form factors. Other NVMe form factors include the add-in card (AIC) and Enterprise and Data Center SSD Form Factor (EDSFF).
What is an NVMe SSD?
An NVMe solid-state drive, or SSD, is a high-speed storage device that implements the NVMe specification, which allows SSDs to use the PCIe bus to read and write data from and to the SSD.
NVMe SSDs are much faster than SSDs using older but still widely used storage interfaces like SATA and SAS.
The U.2 form factor is one of the most common SSD form factors and is typically found in high-performance workstations, servers, and storage systems. U.2 NVMe SSDs can usually be found connected to the PCIe bus via a miniSAS connector or an NVMe RAID controller.
The M.2 form factor is usually reserved for internally mounted NVMe SSDs often found in small-form-factor computers, such as mini PCs and laptops. M.2 NVMe SSDs are often placed directly onto the motherboard, but they can also be installed using an NVMe RAID controller.
One example of an NVMe RAID controller that supports both U.2 and M.2 NVMe SSDs is the HighPoint 7500 Series PCIe Gen 4 M.2 NVMe RAID controller.
Photo: NVMe takes full advantage of multi-core processors' parallel processing capabilities.
How does NVMe work?
Here's the simple explanation: NVMe allows SSDs to be connected directly to the CPU via the PCIe bus to read and write data at high speeds. The NVMe logic is executed within a given SSD using an NVMe controller chip.
Here's a more technical explanation: NVMe exploits the parallelism potential of today's SSDs and significantly improves command queueing, allowing SSDs to manage more requests for data at once. It breaks apart single tasks into smaller tasks and runs them in parallel.
Let's keep going: NVMe SSDs can support up to 64,000 queues and commands, respectively, compared to their SATA or SAS counterparts, which support up to 32 and 256 pending commands, respectively, in one queue. What does this mean? Basically, NVMe uses fewer CPU cycles to manage data requests than SATA and SAS.
You can fathom the performance improvements resulting from the support of up to 65,000 queues and 65,000 commands. Learn more about the performance benefits of NVMe queues in Western Digital's NVMe Queues Explained.
In a nutshell, NVMe SSDs can more efficiently handle more data compared to their SATA or SAS counterparts.
Photo: NVme SSDs are much faster than SATA/SAS HDDs and SSDs.
Are NVMe SSDs faster than HDDs and other SSDs?
NVMe SSDs are significantly faster than HDDs and SSDs using older SATA and SAS interfaces.
For example, a typical SATA III SSD can achieve up to 600MB/s read and write speeds, whereas an NVMe SSD can achieve up to 3,500MB/s and 3,300MBs read and write speeds, respectively, using PCIe Gen 3.
Using PCIe Gen 4, an NVMe SSD can achieve up to 7,000MB/s and 5,000MB/s read and write speeds, respectively.
As you can see, the performance gains provided by connecting an embedded system's non-volatile storage media directly to the CPU via the PCIe bus are nothing short of exponential.
Check out these performance benchmarks of a hard disk drive (HDD), a SATA solid-state drive (SSD), four SATA SSDs using RAID 0, and an M.2 NVMe SSD.
Transfer Speeds: SATA HDD, SATA SSD, SSD RAID, & NVMe M.2 SSD
Graph: SATA SSD vs. NVMe SSD performance benchmarks
So, according to some benchmarks, an M.2 NVMe SSD is up to 806 percent faster than a SATA HDD, up to 237 percent faster than a SATA SSD, and up to 79 percent faster than four SATA SSDs in a RAID 0 configuration.
Still not convinced that NVMe SSDs are faster? Let's look at some examples of popular NVMe and SATA III SSDs currently on the market.
Samsung's 980 PRO PCIe Gen 4 M.2 NVMe SSD boasts sequential read speeds of up to 7,000MB/s and sequential write speeds of up to 5,100MB/s. Contrastingly, Samsung's 860 PRO SATA III SSD boasts sequential read speeds of up to 560MB/s and sequential write speeds of up to 530MB/s.
Okay, so we've proven that NVMe SSDs are faster, but surely these ridiculously fast speeds come with a much heftier price tag, right?
Let's find out.
Photo: Are NVMe SSDs more expensive? Generally, yes, but there are other factors to consider.
Are NVMe SSDs more expensive than SATA and SAS SSDs?
Demand and manufacturing scales have quickly diminished the price of NVMe SSDs, but they're still generally more expensive than SATA and SAS SSDs.
Let's take a look at some examples of some popular NVMe and SATA III SSDs currently on the market.
A 512GB Samsung 860 Pro SATA III SSD retails on Newegg at $99. A 500GB Samsung 980 PRO PCIe Gen 4 M.2 NVMe SSD retails on Newegg at $119.99.
Naturally, choosing higher storage capacities will typically increase the prices of both SSDs, but interestingly, as of May 2021, a 1TB Samsung 860 PRO SATA III SSD and a 1TB 980 PRO PCIe Gen 4 M.2 NVMe SSD both retail at $199 on Newegg.
As you can see, price parity is between NVMe SSDs, SATA SSDs, and SAS SSDs is slowly being achieved.
Photo: Depending on your requirements, NVMe SSDs may be the right choice for you.
Do you really need an NVMe SSD?
Ah, yes, the ultimate question: Should I buy an NVMe SSD for my high-performance computer? Do I really need an NVMe SSD?
That depends on your program's or application's storage requirements and whether your server or workstation supports NVMe.
You can start by checking whether your motherboard has any M.2 slots since this is one of the most common NVMe SSD form factors. If not, don't worry, you can always buy a PCIe M.2 adapter and make use of any M.2 NVMe SSDs that way. If you're using a U.2 NVMe SSD, look for a miniSAS connector, since U.2 NVMe SSDs use this connector to interface with the PCIe bus.
We recommend consulting your motherboard manual to find out if this is a possibility for you. You can also ask your high-performance computer manufacturer.
If you're managing exorbitant amounts of data and need read and write speeds to be as fast as possible, an NVMe SSD may be right for you, but your motherboard needs to support the NVMe interface.
If you're managing moderate amounts of data and speed is less important than price or storage capacity, stick with a SATA or SAS SSD for now until your needs warrant an upgrade to something faster.
Photo: Trenton Systems' NVMe JBOF Enclosure
Conclusion: Trenton Systems can help you decide if NVMe SSDs are right for you.
Trenton Systems' host-agnostic NVMe JBOF Enclosure is a popular choice for the customer needing lots of high-capacity NVMe SSDs for their program or application.
Our JBOF can be populated with 24 of NGD Systems' 32TB U.2 NVMe computational storage drives (CSDs), totaling 768TB of NVMe storage. There are no adapters or switches that convert signals, which reduces latency and provides you with a much faster storage solution than traditional SATA or SAS drive setups.
Pair it with one of our servers, such as the 3U BAM Server, boasting a whopping 11 PCIe Gen 4 slots, and you're ready to take on all your data storage and management challenges.
In fact, the BAM/JBOF storage server solution has already been tested and discussed in a Trenton case study here.
We have other options for incorporating both U.2 and M.2 NVMe SSDs into your Trenton computing solution. Let's figure this out together.
Share this
- High-performance computers (42)
- Military computers (38)
- Rugged computers (32)
- Cybersecurity (25)
- Industrial computers (25)
- Military servers (24)
- MIL-SPEC (20)
- Rugged servers (19)
- Press Release (17)
- Industrial servers (16)
- MIL-STD-810 (16)
- 5G Technology (14)
- Intel (13)
- Rack mount servers (12)
- processing (12)
- Computer hardware (11)
- Edge computing (11)
- Rugged workstations (11)
- Made in USA (10)
- Partnerships (9)
- Rugged computing (9)
- Sales, Marketing, and Business Development (9)
- Trenton Systems (9)
- networking (9)
- Peripheral Component Interconnect Express (PCIe) (7)
- Encryption (6)
- Federal Information Processing Standards (FIPS) (6)
- GPUs (6)
- IPU (6)
- Joint All-Domain Command and Control (JADC2) (6)
- Server motherboards (6)
- artificial intelligence (6)
- Computer stress tests (5)
- Cross domain solutions (5)
- Mission-critical servers (5)
- Rugged mini PCs (5)
- AI (4)
- BIOS (4)
- CPU (4)
- Defense (4)
- Military primes (4)
- Mission-critical systems (4)
- Platform Firmware Resilience (PFR) (4)
- Rugged blade servers (4)
- containerization (4)
- data protection (4)
- virtualization (4)
- Counterfeit electronic parts (3)
- DO-160 (3)
- Edge servers (3)
- Firmware (3)
- HPC (3)
- Just a Bunch of Disks (JBOD) (3)
- Leadership (3)
- Navy (3)
- O-RAN (3)
- RAID (3)
- RAM (3)
- Revision control (3)
- Ruggedization (3)
- SATCOM (3)
- Storage servers (3)
- Supply chain (3)
- Tactical Advanced Computer (TAC) (3)
- Wide-temp computers (3)
- computers made in the USA (3)
- data transfer (3)
- deep learning (3)
- embedded computers (3)
- embedded systems (3)
- firmware security (3)
- machine learning (3)
- Automatic test equipment (ATE) (2)
- C6ISR (2)
- COTS (2)
- COVID-19 (2)
- Compliance (2)
- Compute Express Link (CXL) (2)
- Computer networking (2)
- Controlled Unclassified Information (CUI) (2)
- DDR (2)
- DDR4 (2)
- DPU (2)
- Dual CPU motherboards (2)
- EW (2)
- I/O (2)
- Military standards (2)
- NVIDIA (2)
- NVMe SSDs (2)
- PCIe (2)
- PCIe 4.0 (2)
- PCIe 5.0 (2)
- RAN (2)
- SIGINT (2)
- SWaP-C (2)
- Software Guard Extensions (SGX) (2)
- Submarines (2)
- Supply chain security (2)
- TAA compliance (2)
- airborne (2)
- as9100d (2)
- chassis (2)
- data diode (2)
- end-to-end solution (2)
- hardware security (2)
- hardware virtualization (2)
- integrated combat system (2)
- manufacturing reps (2)
- memory (2)
- mission computers (2)
- private 5G (2)
- protection (2)
- secure by design (2)
- small form factor (2)
- software security (2)
- vRAN (2)
- zero trust (2)
- zero trust architecture (2)
- 3U BAM Server (1)
- 4G (1)
- 4U (1)
- 5G Frequencies (1)
- 5G Frequency Bands (1)
- AI/ML/DL (1)
- Access CDS (1)
- Aegis Combat System (1)
- Armed Forces (1)
- Asymmetric encryption (1)
- C-RAN (1)
- COMINT (1)
- CPUs (1)
- Cloud-based CDS (1)
- Coast Guard (1)
- Compliance testing (1)
- Computer life cycle (1)
- Containers (1)
- D-RAN (1)
- DART (1)
- DDR5 (1)
- DMEA (1)
- Data Plane Development Kit (DPDK) (1)
- Defense Advanced Research Projects (DARP) (1)
- ELINT (1)
- EMI (1)
- EO/IR (1)
- Electromagnetic Interference (1)
- Electronic Warfare (EW) (1)
- FIPS 140-2 (1)
- FIPS 140-3 (1)
- Field Programmable Gate Array (FPGA) (1)
- Ground Control Stations (GCS) (1)
- Hardware-based CDS (1)
- Hybrid CDS (1)
- IES.5G (1)
- ION Mini PC (1)
- IP Ratings (1)
- IPMI (1)
- Industrial Internet of Things (IIoT) (1)
- Industry news (1)
- Integrated Base Defense (IBD) (1)
- LAN ports (1)
- LTE (1)
- Life cycle management (1)
- Lockheed Martin (1)
- MIL-S-901 (1)
- MIL-STD-167-1 (1)
- MIL-STD-461 (1)
- MIL-STD-464 (1)
- MOSA (1)
- Multi-Access Edge Computing (1)
- NASA (1)
- NIC (1)
- NIC Card (1)
- NVMe (1)
- O-RAN compliant (1)
- Oil and Gas (1)
- OpenRAN (1)
- P4 (1)
- PCIe card (1)
- PCIe lane (1)
- PCIe slot (1)
- Precision timestamping (1)
- Product life cycle (1)
- ROM (1)
- Raytheon (1)
- Remotely piloted aircraft (RPA) (1)
- Rugged computing glossary (1)
- SEDs (1)
- SIM Card (1)
- Secure boot (1)
- Sensor Open Systems Architecture (SOSA) (1)
- Small form-factor pluggable (SFP) (1)
- Smart Edge (1)
- Smart NIC (1)
- SmartNIC (1)
- Software-based CDS (1)
- Symmetric encryption (1)
- System hardening (1)
- System hardening best practices (1)
- TME (1)
- Tech Partners (1)
- Total Memory Encryption (TME) (1)
- Transfer CDS (1)
- USB ports (1)
- VMEbus International Trade Association (VITA) (1)
- Vertical Lift Consortium (VLC) (1)
- Virtual machines (1)
- What are embedded systems? (1)
- Wired access backhaul (1)
- Wireless access backhaul (1)
- accredidation (1)
- aerospace (1)
- air gaps (1)
- airborne computers (1)
- asteroid (1)
- authentication (1)
- autonomous (1)
- certification (1)
- cognitive software-defined radios (CDRS) (1)
- command and control (C2) (1)
- communications (1)
- cores (1)
- custom (1)
- customer service (1)
- customer support (1)
- data linking (1)
- data recording (1)
- ethernet (1)
- full disk encryption (1)
- hardware monitoring (1)
- heat sink (1)
- hypervisor (1)
- in-house technical support (1)
- input (1)
- integrated edge solution (1)
- international business (1)
- licensed spectrum (1)
- liquid cooling (1)
- mCOTS (1)
- microelectronics (1)
- missile defense (1)
- mixed criticality (1)
- moving (1)
- multi-factor authentication (1)
- network slicing (1)
- neural networks (1)
- new headquarters (1)
- next generation interceptor (1)
- non-volatile memory (1)
- operating system (1)
- output (1)
- outsourced technical support (1)
- post-boot (1)
- pre-boot (1)
- private networks (1)
- public networks (1)
- radio access network (RAN) (1)
- reconnaissance (1)
- secure flash (1)
- security (1)
- self-encrypting drives (SEDs) (1)
- sff (1)
- software (1)
- software-defined radios (SDRs) (1)
- speeds and feeds (1)
- standalone (1)
- storage (1)
- systems (1)
- tactical wide area networks (1)
- technical support (1)
- technology (1)
- third-party motherboards (1)
- troposcatter communication (1)
- unlicensed spectrum (1)
- volatile memory (1)
- vpx (1)
- zero trust network (1)
- August 2024 (1)
- July 2024 (1)
- May 2024 (1)
- April 2024 (3)
- February 2024 (1)
- November 2023 (1)
- October 2023 (1)
- July 2023 (1)
- June 2023 (3)
- May 2023 (7)
- April 2023 (5)
- March 2023 (7)
- December 2022 (2)
- November 2022 (6)
- October 2022 (7)
- September 2022 (8)
- August 2022 (3)
- July 2022 (4)
- June 2022 (13)
- May 2022 (10)
- April 2022 (4)
- March 2022 (11)
- February 2022 (4)
- January 2022 (4)
- December 2021 (1)
- November 2021 (4)
- September 2021 (2)
- August 2021 (1)
- July 2021 (2)
- June 2021 (3)
- May 2021 (4)
- April 2021 (3)
- March 2021 (3)
- February 2021 (9)
- January 2021 (4)
- December 2020 (5)
- November 2020 (5)
- October 2020 (4)
- September 2020 (4)
- August 2020 (6)
- July 2020 (9)
- June 2020 (11)
- May 2020 (13)
- April 2020 (8)
- February 2020 (1)
- January 2020 (1)
- October 2019 (1)
- August 2019 (2)
- July 2019 (2)
- March 2019 (1)
- January 2019 (2)
- December 2018 (1)
- November 2018 (2)
- October 2018 (5)
- September 2018 (3)
- July 2018 (1)
- April 2018 (2)
- March 2018 (1)
- February 2018 (9)
- January 2018 (27)
- December 2017 (1)
- November 2017 (2)
- October 2017 (3)
No Comments Yet
Let us know what you think