How Do Transformers Model Physics? Investigating the Simple Harmonic Oscillator

How do transformers model physics? Do transformers model systems with interpretable analytical solutions or do they create an “alien physics” that is difficult for humans to decipher? We have taken a step towards demystifying this larger puzzle by investigating the simple harmonic oscillator (SHO),...

Full description

Saved in:
Bibliographic Details
Main Authors: Subhash Kantamneni, Ziming Liu, Max Tegmark
Format: Article
Language:English
Published: MDPI AG 2024-11-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/26/11/997
Tags: Add Tag
No Tags, Be the first to tag this record!