Text this: No Need to Know: Toward Astrophysics-free Gravitational-wave Cosmology