Open data: If you can’t measure it, how can you manage it?

DARPA aims to find out how good quantum computers really are

Defense Advanced Research Projects Agency want benchmarking information it can use to quantify the long-term utility of quantum computers.

The Quantum Benchmarking program has two main goals, according to an April 1 broad agency announcement from DARPA’s Defense Sciences Office. First, it aims to create new hardware-agnostic benchmarks that will measure progress addressing specific challenges where quantum computers will likely be needed, such as molecular simulation or materials discovery.

The plan for addressing this goal is to compile a large list of likely applications, group them according to the metrics or the mathematical operations that would be required for a successful solution. Researchers would then have to develop tests for all the metrics associated with a particular benchmark using classical computer or specially designed quantum systems.

To develop the benchmarks, scientists must “quantify the gap between proposed quantum approaches and the existing best classical approach,” the BAA said. Identifying these gaps will require collaboration between quantum computing experts who understand the former and application-domain experts who understand the latter. 

With that information, DARPA aims to develop “scalable, robust multi-dimensional benchmarks” for research and development of long-term, real-world applications and that can also provide robust, detailed debugging information.

The second goal involves creating tools for estimating what combination of quantum and classical hardware will produce a specific level of performance. The simplest tools would provide estimates showing how quantum computing delivers an exponential advantage over classical tools, DARPA said, but by the end of the program it wants estimates to address not only the number of resources required but also their specifications and configuration.

The BAA is also asking for various output parameters, including the number and type of quantum hardware that is needed for a particular configuration, the amount and type of ancillary classical computing resources required was well as the time and energy the solution requires.

Final proposals for the two-phase, 36-month program are due June 22.

About the Author

Connect with the GCN staff on Twitter @GCNtech.


  • Records management: Look beyond the NARA mandates

    Pandemic tests electronic records management

    Between the rush enable more virtual collaboration, stalled digitization of archived records and managing records that reside in datasets, records management executives are sorting through new challenges.

  • boy learning at home (Travelpixs/

    Tucson’s community wireless bridges the digital divide

    The city built cell sites at government-owned facilities such as fire departments and libraries that were already connected to Tucson’s existing fiber backbone.

Stay Connected