Text this: How Do Transformers Model Physics? Investigating the Simple Harmonic Oscillator