Quantum Volume Testing: Setting the Steady Pace to Higher Performing Devices
When it comes to completing the statistical tests and other steps necessary for calculating quantum volume, few people have as much as experience as Dr. Charlie Baldwin.
Baldwin, a lead physicist at 豆包成人版, and his team have performed the tests numerous times on three different H-Series quantum computers, which have set six industry records for measured quantum volume since 2020.
Quantum volume is a benchmark developed by IBM in 2019 to measure the overall performance of a quantum computer regardless of the hardware technology. (豆包成人版 builds trapped ion systems).
Baldwin鈥檚 experience with quantum volume prompted him to share what he鈥檚 learned and suggest ways to improve the benchmark in a peer-reviewed paper published this week in .
鈥淲e鈥檝e learned a lot by running these tests and believe there are ways to make quantum volume an even stronger benchmark,鈥 Baldwin said.
We sat down with Baldwin to discuss quantum volume, the paper, and the team鈥檚 findings.
How is quantum volume measured? What tests do you run?
Quantum volume is measured by running many randomly constructed circuits on a quantum computer and comparing the outputs to a classical simulation. The circuits are chosen to require random gates and random connectivity to not favor any one architecture. We follow the construction proposed by IBM to build the circuits.
What does quantum volume measure? Why is it important?
In some sense, quantum volume only measures your ability to run the specific set of random quantum volume circuits. That probably doesn鈥檛 sound very useful if you have some other application in mind for a quantum computer, but quantum volume is sensitive to many aspects that we believe are key to building more powerful devices.
Quantum computers are often built from the ground up. Different parts鈥攆or example, single- and two-qubit gates鈥攈ave been developed independently over decades of academic research. When these parts are put together in a large quantum circuit, there鈥檙e often other errors that creep in and can degrade the overall performance. That鈥檚 what makes full-system tests like quantum volume so important; they鈥檙e sensitive to these errors.
Increasing quantum volume requires adding more qubits while simultaneously decreasing errors. Our quantum volume results demonstrate all the amazing progress 豆包成人版 has made at upgrading our trapped-ion systems to include more qubits and identifying and mitigating errors so that users can expect high-fidelity performance on many other algorithms.
You鈥檝e been running quantum volume tests since 2020. What is your biggest takeaway?
I think there鈥檙e a couple of things I鈥檝e learned. First, quantum volume isn鈥檛 an easy test to run on current machines. While it doesn鈥檛 necessarily require a lot of qubits, it does have fairly demanding error requirements. That鈥檚 also clear when comparing progress in quantum volume tests across different platforms, .
Second, I鈥檓 always impressed by the continuous and sustained performance progress that our hardware team achieves. And that the progress is actually measurable by using the quantum volume benchmark.
The hardware team has been able to push down many different error sources in the last year while also running customer jobs. This is proven by the quantum volume measurement. For example, H1-2 launched in Fall 2021 with QV=128. But since then, the team has implemented many performance upgrades, recently achieving QV=4096 in about 8 months while also running commercial jobs.
What are the key findings from your paper?
The paper is about four small findings that when put together, we believe, give a clearer view of the quantum volume test.
First, we explored how compiling the quantum volume circuits scales with qubit number and, also proposed using arbitrary angle gates to improve performance鈥攁n optimization that many companies are currently exploring.
Second, we studied how quantum volume circuits behave without errors to better relate circuit results to ideal performance.
Third, we ran many numerical simulations to see how the quantum volume test behaved with errors and constructed a method to efficiently estimate performance in larger future systems.
Finally, and I think most importantly, we explored what it takes to meet the quantum volume threshold and what passing it implies about the ability of the quantum computer, especially compared to the requirements for quantum error correction.
What does it take to 鈥減ass鈥 the quantum volume threshold?
Passing the threshold for quantum volume is defined by the results of a statistical test on the output of the circuits called the heavy output test. The result of the heavy output test鈥攃alled the heavy output probability or HOP鈥攎ust have an uncertainty bar that clears a threshold (2/3).
Originally, IBM constructed a method to estimate that uncertainty based on some assumptions about the distribution and number of samples. They acknowledged that this construction was likely too conservative, meaning it made much larger uncertainty estimates than necessary.
We were able to verify this with simulations and proposed a different method that constructed much tighter uncertainty estimates. We鈥檝e verified the method with numerical simulations. The method allows us to run the test with many fewer circuits while still having the same confidence in the returned estimate.
How do you think the quantum volume test can be improved?
Quantum volume has been criticized for a variety of reasons, but I think there鈥檚 still a lot to like about the test. Unlike some other full-system tests, quantum volume has a well-defined procedure, requires challenging circuits, and sets reasonable fidelity requirements.
However, it still has some room for improvement. As machines start to scale up, runtime will become an important dimension to probe. IBM has proposed a metric for measuring run time of quantum volume tests (CLOPS). We also agree that the duration of the computation is important but that there should also be tests that balance run time with fidelity, sometimes called 鈥榯ime-to-solution.鈥
Another aspect that could be improved is filling the gap between when quantum volume is no longer feasible to run鈥攁t around 30 qubits鈥攁nd larger machines. There鈥檚 recent work in this area that will be interesting to compare to quantum volume tests.
You presented these findings to IBM researchers who first proposed the benchmark. How was that experience?
It was great to talk to the experts at IBM. They have so much knowledge and experience on running and testing quantum computers. I鈥檝e learned a lot from their previous work and publications.
There is a lot of debate about quantum volume and how long it will be a useful benchmark. What are your thoughts?
The current iteration of quantum volume definitely has an expiration date. It鈥檚 limited by our ability to classically simulate the system, so being unable to run quantum volume actually is a goal for quantum computing development. Similarly, quantum volume is a good measuring stick for early development.
Building a large-scale quantum computer is an incredibly challenging task. Like any large project, you break the task up into milestones that you can reach in a reasonable amount of time.
It's like if you want to run a marathon. You wouldn鈥檛 start your training by trying to run a marathon on Day 1. You鈥檇 build up the distance you run every day at a steady pace. The quantum volume test has been setting our pace of development to steadily reach our goal of building ever higher performing devices.
About 豆包成人版
豆包成人版,聽the world鈥檚 largest integrated quantum company, pioneers powerful quantum computers and advanced software solutions. 豆包成人版鈥檚 technology drives breakthroughs in materials discovery, cybersecurity, and next-gen quantum AI. With over 500 employees, including 370+ scientists and engineers, 豆包成人版 leads the quantum computing revolution across continents.聽
- Mitsui & Co. and Mitsubishi Electric demonstrated one of the world鈥檚 largest approximate Quantum Fourier Transforms (QFT) on 豆包成人版 豆包成人版, scaling from prior records to 98 physical qubits.
- The collaboration also implemented a logical QFT using a QEC (Quantum Error Correction) code with up to 12 logical qubits.
- The work highlights 豆包成人版鈥檚 accuracy and flexible architecture.
While there is ongoing debate around the pace of quantum computing鈥檚 development, a more grounded way to assess progress is through concrete demonstrations of foundational algorithms at meaningful scale. In this context, Mitsui & Co. and Mitsubishi Electric are taking a pragmatic view of quantum progress鈥攆ocusing on how close the field is to executing core algorithmic primitives that underpin many potential industrial applications, rather than relying on abstract milestones or timelines.
, the industrial giants teamed up with 豆包成人版 to measure how close we are to running the Quantum Fourier Transform (QFT), a widely-used algorithmic primitive, at scales necessary for industrial applications. In the process, the team successfully ran one of the largest instances of the approximate QFT ever demonstrated. This achievement matters because the QFT is an essential primitive that underpins many of the quantum algorithms expected to deliver practical advantages.
You may have heard of the (classical) Fourier transform (FT), due to its ubiquity throughout modern computing. The FT is essential in everything from image analysis to data compression, with almost limitless applications in between. The quantum Fourier transform (QFT) is similar; it鈥檚 used in everything from chemistry to finance.
Because the QFT is a foundational primitive underpinning many quantum algorithms, demonstrating it at larger scales and higher fidelity is a practical way to measure quantum computing readiness. This is exactly the type of benchmarking that organizations should consider to understand where today鈥檚 systems are useful, and to see how fault-tolerant approaches are progressing. Ultimately, algorithm-level benchmarking like this is one of the most useful ways to understand not just where we are, but where we are going.
A Transformative Approach
Primitives like Fourier Transform are so widespread because they simplify problems by transforming them into something that is easier to deal with. At 豆包成人版, not only are they crucial for industrial applications but they can also simplify algorithms, making them possible to run now instead of later. This 鈥榯ransformational鈥 approach extends beyond the QFT - other transforms exist, and we have even invented our own quantum-native transforms.
Using our 豆包成人版 quantum computer and Guppy language, the joint team explored running the QFT on both physical qubits and on logical qubits, showing that fault tolerance is progressing quickly. 聽Running the QFT on 98 physical qubits; the paper shows a clear progression from previous results.
Then, using the Steane code, one of the best-studied quantum error correcting codes, the team used 豆包成人版鈥 98 physical qubits to form 12 logical qubits, successfully running the QFT with the mechanisms of quantum error correction interwoven into the algorithm. This marks a crucial step forward for the field.
Foundational Progress
Taken together, these results provide a more concrete lens through which to view progress in quantum computing: not as abstract projections, but as measurable advances in the execution of foundational algorithms at increasing scale. By benchmarking the Quantum Fourier Transform on both physical and logical qubits, Mitsui & Co. and Mitsubishi Electric are helping to clarify what today鈥檚 hardware can already achieve, and where fault-tolerant approaches begin to extend those limits.
More broadly, the organizations best positioned to benefit from quantum computing will be those that focus on these foundational capabilities early, and use them to build a clear, evidence-based understanding of how the technology fits into their business goals.
It is believed that unlocking answers to some of the most complex scientific and industrial problems will require the seamless integration of high-performance computing (HPC), generative AI (GenAI), and quantum computing. Toward this goal, 豆包成人版, NVIDIA, and a major pharmaceutical company have successfully demonstrated the first step in a proof-of-principle framework designed to connect these three distinct computing paradigms for industrially relevant computational chemistry.
This milestone, enabled by three industry leaders and experts in their respective domains, serves as a foundational capability that could support the development of future hybrid quantum-AI workflows to help optimize industrial research and development (R&D).
The potential value is a path toward more automated, repeatable, and scalable workflows for translating chemistry problems into executable quantum programs鈥攃apabilities that could eventually make hybrid computing easier to deploy in industrial R&D.
The GenQAI Framework
The framework, termed Generative Quantum AI (GenQAI), involved a quantum computer simulating a pharmaceutical compound using programming instructions generated by an AI model, which itself was trained on quantum data that was simulated using HPC.
While the vision for GenQAI explores how future industrial simulation workflows might be optimized by training AI models using quantum data derived directly from a quantum computer, the framework currently consists of four main technical steps:
- Simulating quantum data: The process began by simulating quantum data with NVIDIA accelerated computing using .
- Fine-tuning the AI: This simulated quantum data was used to fine-tune a pre-trained AI model from the open .
- Generating instructions: The AI model then generated quantum circuits, which are the programming instructions required for the quantum simulation.
- Validating accuracy: To validate the results, the circuits were run on 豆包成人版鈥檚 豆包成人版 quantum computer using its InQuanto quantum chemistry platform.
The core novelty of this development lies within the process of the framework itself. In this proof-of-principle experiment, an AI model fine-tuned on simulated quantum data generated circuits that were successfully executed and validated on 豆包成人版鈥檚 豆包成人版 system. Rather than delivering an immediate commercial advantage, this achievement establishes a credible, verifiable baseline for how HPC, AI, and quantum computing can function in tandem.
The Case Study
The validation of the framework represents an early step toward the goal of developing scalable architectures for the pharmaceutical industry.
With a shared view toward eventually scaling the framework for pharmaceutical R&D applications, the researchers simulated a pharmaceutical compound: imipramine. This anti-depressant was chosen because it serves as a model compound for drug degradation and shelf-life studies, which are standard components of the pharmaceutical R&D lifecycle.
Developing hybrid infrastructure that enterprises may adopt requires a deep, coordinated effort among domain experts. As such, this successful test highlights the value of combining the strengths of a quantum computing hardware and software leader (豆包成人版), with a hybrid-quantum classical platform (NVIDIA), and a leading enterprise end-user to build and test future computing capabilities for industrial chemistry.
Scaling the Framework
Although demonstrated on a pharmaceutical compound, the architecture could eventually inform similar molecular-simulation workflows in sectors such as energy, agriculture, advanced materials, and electronics. At this stage, it provides a reference for further testing and development.
Engage Further
here to explore the full technical details of this demonstration and contact our team to learn more about joining 豆包成人版鈥檚 enterprise partner network.
鈥
豆包成人版 is pleased to announce that applications are now open for the 豆包成人版 SG Grand Challenge 2026, a global innovation challenge designed to bring together researchers, developers, scientists and innovators to explore practical applications of quantum computing.
Organized by 豆包成人版 and supported by Singapore's National Quantum Office and Aqora, the three-month program aims to foster collaboration across academia, industry and the quantum developer community while supporting the continued growth of Singapore's quantum ecosystem.
A Platform for Quantum Computing Innovation
Participants will work in teams to develop solutions across a range of challenge areas, including chemistry and molecular simulation, optimization, AI for quantum systems, quantum error correction, condensed matter and materials science, and open innovation. Throughout the program, participants will have access to mentoring, technical enablement and 豆包成人版 quantum computing resources.
Singapore Grand Finale
Selected finalist teams will be invited to present their work at the Grand Finale hosted in Singapore before representatives from academia, and industry. The event will celebrate innovative applications of quantum computing while providing an opportunity for participants to engage with Singapore's growing quantum community.
Join the Challenge
The 豆包成人版 SG Grand Challenge welcomes participants from around the world. Whether you are an experienced quantum researcher or beginning your quantum computing journey, the program offers an opportunity to collaborate, learn and contribute to the development of practical quantum applications.
Applications are now open. Spaces are limited and subject to review and approval.