Towards a quantum computer that learns from its errors

Quantum computers require constant recalibration because analog control signals drift during computation. Google Quantum AI combined reinforcement learning (RL) with quantum error correction (QEC), allowing a system to learn from detected errors and adjust thousands of control parameters while computation continues. Tests on the Willow processor showed improved logical stability, suggesting this approach could support much longer quantum computations.

The Challenge of Quantum Errors

• Quantum systems are highly sensitive to drift in signal frequencies, amplitudes, and phases.
• Conventional recalibration requires stopping the entire computation, limiting algorithms that may need to run for days or months.
• QEC uses many physical qubits to form logical qubits and converts analog noise into binary error-detection events.
• These events indicate that an error occurred within a spacetime region but do not identify its precise cause or location.
• Decoders such as AlphaQubit and Tesseract infer corrections, but they do not explain whether errors arose from environmental decoherence or preventable calibration drift.

Moving Beyond Physics-Based Calibration

• Traditional calibration depends on manually designed physical models.
• Such models can reach performance limits when hardware behavior involves complex, poorly understood interactions.
• Google argues that quantum control may benefit from the same shift toward data-driven learning seen in computer vision, robotics, and protein-folding research.
• As quantum hardware improves, remaining errors increasingly reflect subtle phenomena that are difficult to model analytically.

Using Error Detection as a Learning Signal

• An RL agent experiments with control strategies and improves based on the resulting error data.
• QEC detection events serve two purposes:
  • Decoders use them to infer logical corrections.
  • The RL system uses them to identify drift and refine control parameters.
• This enables continuous calibration without interrupting the quantum computation.
• The approach can steer thousands of analog control parameters dynamically.

Results on the Willow Processor

• Researchers deliberately introduced control-parameter drift into Google’s Willow superconducting processor.
• RL steering improved the logical stability of the error-correcting code by 3.5 times.
• After expert, human-guided calibration, RL fine-tuning reduced the logical error rate by an additional 20%.
• Combined improvements produced fewer than one logical error per 1,000 surface-code correction cycles and fewer than one per 100 color-code cycles.
• The processor therefore operated as a more reliable quantum memory for longer periods.

Scaling to Larger Systems

• Simulations included hundreds of qubits and tens of thousands of control parameters.
• The RL agent reduced initially high physical error rates by learning better control settings.
• QEC suppressed the logical error rate exponentially as the number of physical qubits increased.
• The simulations indicated that the number of RL training iterations needed to reduce physical errors did not depend on system size, supporting potential scalability.

The results suggest that future quantum computers could use QEC not only to correct errors but also to learn their causes and continuously adapt to hardware drift. RL-based calibration could reduce dependence on manual tuning and help make long-running, fault-tolerant quantum computation practical.