How Do Transformers Model Physics? Investigating the Simple Harmonic Oscillator

How Do Transformers Model Physics? Investigating the Simple Harmonic Oscillator

How do transformers model physics? Do transformers model systems with interpretable analytical solutions or do they create an “alien physics” that is difficult for humans to decipher? We have taken a step towards demystifying this larger puzzle by investigating the simple harmonic oscillator (SHO),...

Full description

Saved in:

Bibliographic Details
Main Authors:	Subhash Kantamneni, Ziming Liu, Max Tegmark
Format:	Article
Language:	English
Published:	MDPI AG 2024-11-01
Series:	Entropy
Subjects:	mechanistic intepretability AI for science physics
Online Access:	https://www.mdpi.com/1099-4300/26/11/997
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Student and AI responses to physics problems examined through the lenses of sensemaking and mechanistic reasoning
by: Amogh Sirnoorkar, et al.
Published: (2024-12-01)

Opening the AI Black Box: Distilling Machine-Learned Algorithms into Code
by: Eric J. Michaud, et al.
Published: (2024-12-01)

Die Bestudering van gewysigde bewussynstate se moontlike bydrae tot die veld van kommunikasie
by: Linda Venter
Published: (2022-11-01)

Herbicide resistance prediction: a mechanistic model vs. a random forest model
by: Otto Richter, et al.
Published: (2025-01-01)

Finding Solutions to Undamped and Damped Simple Harmonic Oscillations via Kashuri Fundo Transform
by: Haldun Alpaslan Peker, et al.
Published: (2023-07-01)

Optimization, Kinetics and thermodynamic modeling of pulp production from plantain stem using the kraft process
by: Effi Evelyn, et al.
Published: (2025-12-01)

Mechanistic Analysis of Anodic Oxidation of Gold in KOH (0.1 M) Solution Using the Point Defect Model
by: Zahed Ghelichkhah, et al.
Published: (2024-10-01)

Improved Mechanistic Degradation Modes Modeling of Lithium and Sodium Plating
by: David Beck, et al.
Published: (2024-11-01)

Soil Science-Informed Machine Learning
by: Budiman Minasny, et al.
Published: (2024-12-01)

Mechanistic modelling of allergen-induced airways disease in early life
by: Hannah J. Pybus, et al.
Published: (2025-01-01)

Feed additives for methane mitigation: Modeling the impact of feed additives on enteric methane emission of ruminants—Approaches and recommendations
by: Jan Dijkstra, et al.
Published: (2025-01-01)

A modern approach to intermittent illumination for the characterization of chain-propagation in photoredox catalysis
by: K.A. Viraj Miyuranga, et al.
Published: (2024-12-01)

Exploring the neural landscape: Visual analytics of neuron activation in large language models with NeuronautLLM
by: Ollie Woodman, et al.
Published: (2024-12-01)

Pressure and Temperature Prediction of Oil Pipeline Networks Based on a Mechanism-Data Hybrid Driven Method
by: Faming Gong, et al.
Published: (2024-11-01)

Modelling physical processes in higher plants using leaf replicas for space applications
by: Kuzma, Joanna, et al.
Published: (2023-03-01)

Artificial intelligence (AI) or augmented intelligence? How big data and AI are transforming healthcare: Challenges and opportunities
by: K Moodley
Published: (2023-12-01)

Exploring advanced nanostructures and functional materials for efficient hydrogen storage: a theoretical investigation on mechanisms, adsorption process, and future directions
by: Gourhari Jana, et al.
Published: (2025-02-01)

Highly Regioselective 1,3-Dipolar Cycloaddition of Nitrilimines and Thioaurones Towards Spiro-2-Pyrazolines: Synthesis, Characterization, and Mechanistic Study
by: Mohamed Bakhouch, et al.
Published: (2024-12-01)

Diabetes mellitus: The pathophysiology as a canvas for management elucidation and strategies
by: Franklyn Nonso Iheagwam, et al.
Published: (2025-03-01)

Mechanistic concepts involved in biofilm associated processes of Campylobacter jejuni: persistence and inhibition in poultry environments
by: Iulia A. Bundurus, et al.
Published: (2024-12-01)

Base-free transfer hydrogenation of carbonyl substrates catalysed by neutral ruthenium(salicylaldimine) complexes: Inhibitory effect of visible light
by: N. Visagie, et al.
Published: (2024-12-01)

The second wave of formose research
by: Akihito Hashidzume
Published: (2025-01-01)

Article RETRACTED due to manipulation by the authors AI and Thinkable-Assisted learning media for physical education: a descriptive study on collaborative lecturer education
by: Yarmani Yarmani, et al.
Published: (2024-12-01)

Implicit quantile networks for emulation in jet physics
by: Braden Kronheim, et al.
Published: (2024-01-01)

Scaling up uncertain predictions to higher levels of organisation tends to underestimate change
by: James A. Orr, et al.
Published: (2021-08-01)

Decoupling Volatile and Nonvolatile Response in Reliable Halide Perovskite Memristors
by: Naresh‐Kumar Pendyala, et al.
Published: (2025-01-01)

Evaluation of Climatic Factors Based on the Mechanistic -Empirical Pavement Design Guide
by: Daiva Žilionienė, et al.
Published: (2013-09-01)

DEBEcoMod: A dynamic energy budget R tool to predict life-history traits of marine organisms across time and space
by: A. Giacoletti, et al.
Published: (2024-12-01)

Recent advances of Copper- BTC metal-organic frameworks for efficient degradation of organic dye-polluted wastewater: Synthesis, mechanistic insights and future outlook
by: Saptarshi Roy, et al.
Published: (2024-11-01)

Harmonizing AI governance regulations and neuroinformatics: perspectives on privacy and data sharing
by: Roba Alsaigh, et al.
Published: (2024-12-01)

Mechanistic modelling of water–oxygen bubbly flow in horizontal pipes: Deviation analysis from experimental correlations and performance comparison with CFD
by: Montadhar Guesmi, et al.
Published: (2025-01-01)

Resolution of depression: Antidepressant actions of resolvins
by: Satoshi Deyama, et al.
Published: (2025-02-01)

Interaction between opium use and cigarette smoking on bladder cancer: An inverse probability weighting approach based on a multicenter case-control study in Iran
by: Rahim Akrami, et al.
Published: (2025-06-01)

Different dietary branched-chain amino acid ratios, crude protein levels, and protein sources can affect the growth performance and meat yield in broilers
by: Doyun Goo, et al.
Published: (2024-12-01)

Innovative zero-valent cobalt decoration on MIL-88 A(Fe)@β-CD for high-efficiency and reusable cr(VI) removal
by: Eman M. Abd El-Monaem, et al.
Published: (2025-02-01)

Implementation of management science in physical education subjects: A systematic literature review
by: Sahbana Ridha, et al.
Published: (2024-08-01)

A system approach to the modeling of fungal infections of the wheat leaf
by: S. V. Nikolaev, et al.
Published: (2019-02-01)

Social demonstration of colour preference improves the learning of associated demonstrated actions
by: Noam Zurek, et al.
Published: (2024-04-01)

From theory to practice: Harmonizing taxonomies of trustworthy AI
by: Christos A. Makridis, et al.
Published: (2024-12-01)

The DAOs to AI for Science by DeSci: the state of the art and perspective
by: Fei-Yue WANG, et al.
Published: (2023-03-01)