Text this: Event-driven bi-fidelity control for efficient and reliable robotic manipulation