Discovering a Local Fluctuation Theorem with Machine Learning
© The Physical Society of Japan
This article is on
Machine learning a time-local fluctuation theorem for nonequilibrium steady states
(PTEP Editors' Choice)
Prog. Theor. Exp. Phys.
2023,
083A01
(2023)
.
A groundbreaking study reveals a new time-local fluctuation theorem using machine learning, revolutionizing our understanding of deterministic nonequilibrium steady state systems.

The second law of thermodynamics states that for large systems, there is a direction associated with their evolution over large time scales. However, in the realm of nonequilibrium dynamics, especially where a system is driven far from equilibrium, understanding and quantifying thermodynamic relations is challenging.
In this regard, fluctuation theorems (FTs), which quantify the thermodynamic reversibility of a system in terms of a dissipation function, have emerged as an essential tool for characterizing the probability of observing events in small systems during short timescales that violate the second law of thermodynamics. However, these theorems have only been formulated for a limited class of systems.
Consequently, our understanding of deterministic nonequilibrium steady states—a system with unknown phase space distribution for which only asymptotic FTs hold— remains limited. This is because all attempts to evaluate their dissipation function require either the trajectory segment of interest to be relatively long or information about the entire trajectory around that segment.
In this study, we addressed this long-standing problem in statistical mechanics by utilizing a simple machine learning model. The model was trained to minimize the binary cross-entropy loss function and discern whether a segment of a steady state trajectory progresses forward or backward in time. This yielded a function that satisfied an FT and relied only upon the information within the segment of interest.
Remarkably, this time-local FT is applicable even to extremely short trajectory segments and holds true for systems far from equilibrium as well as for various nonequilibrium dynamics, surpassing all previously known theoretical approximations.
We further demonstrated that any model reaching the global minimum of the binary cross-entropy loss function must be a well-calibrated predictor of time’s arrow and satisfy an FT. This leads us to a new derivation for local-time FTs: an FT can be exactly satisfied for an arbitrarily small set of local information provided the correlation function between that information and the unknown, non-local information is known.
Since our theoretical treatment is applicable to feasible real-world measurements, which only capture information from a local region and for a finite duration, it could potentially have wide-ranging applications in computational modeling as well as real-world data collection.
Consequently, this study could eventually lead to an enhanced understanding of nonequilibrium steady state systems across diverse fields, including fluid dynamics, heat transfer, semiconductor operation, ion transport, biology, and climate modeling.
Machine learning a time-local fluctuation theorem for nonequilibrium steady states
(PTEP Editors' Choice)
Prog. Theor. Exp. Phys.
2023,
083A01
(2023)
.
Share this topic
Fields
Related Articles
-
Symmetry and AI: Building the Future of Physics Simulations
Magnetic properties in condensed matter
Measurement, instrumentation, and techniques
2025-2-18
Generative artificial intelligence (AI) has gained considerable attention in scientific fields. By embedding physical symmetry into AI before training, we created a faster and lighter model. Scaling improves the accuracy and unlocks the potential of physics research and applications.
-
Bayesian Insights into X-ray Laue Oscillations: Quantitative Surface Roughness and Noise Modeling
Measurement, instrumentation, and techniques
Structure and mechanical and thermal properties in condensed matter
2025-2-14
This study adopts Bayesian inference using the replica exchange Monte Carlo method to accurately estimate thin-film properties from X-ray Laue oscillation data, enabling quantitative analysis and appropriate noise modeling.
-
Hyperuniform and Multifractal States in Bosonic Quasicrystalline Systems
Statistical physics and thermodynamics
Structure and mechanical and thermal properties in condensed matter
2025-2-10
Quantum states can be categorized as hyperuniform or multifractal based on electronic characteristics. This study demonstrates that bosonic quasicrystalline systems exhibit hyperuniform or multifractal quantum states.
-
Exploring Materials without Data Exposure: A Bayesian Optimizer using Secure Computation
Cross-disciplinary physics and related areas of science and technology
Measurement, instrumentation, and techniques
2025-2-6
Secure computation allows the manipulation of material data without exposing them, thereby offering an alternative to traditional open/closed data management. We recently reported the development of an application that performs Bayesian optimization using secure computation.
-
Revival of JRR-3: A New Frontier in Neutron Scattering Research
Cross-disciplinary physics and related areas of science and technology
Elementary particles, fields, and strings
Magnetic properties in condensed matter
Measurement, instrumentation, and techniques
Nuclear physics
2024-11-12
This Special Topics edition of JPSJ details the capabilities and upgrades made to the instruments at JRR-3, since its shutdown after the Great East Japan Earthquake and 2011.