MedGym

MedGym is a simulated emergency department for testing and training medical AI agents. Patients get better or worse over hours, based on what the agent does. Every decision is scored against an expert reference.

Frontier models pass medical exams. In MedGym, they still make mistakes an expert would not, and some of their patients die. MedGym finds those mistakes and trains them out.

Careers

We’re hiring researchers and engineers. Email us at hi@medgym.ai.

Our work

MedGym ED

Four patients. In each, a frontier model and our 32B model, trained in MedGym, treat the same patient. Each panel shows what the model sees, thinks and does. See all results.

The kidney stone that was an aneurysm

A 68-year-old man has flank pain and blood in his urine. It looks like a kidney stone. It is a leaking aneurysm.

Illustrative.

The motorcycle crash

A 24-year-old is struggling to breathe after a motorcycle crash. Air trapped in his chest is squeezing his lung and heart. He needs a needle in his chest now, before any X-ray.

Illustrative.

Sepsis in the waiting room

A 79-year-old woman with a fever looks well enough to wait. She has sepsis. Every hour without antibiotics raises her risk of dying.

Illustrative.

The stroke that smelled of alcohol

A 58-year-old man slurs his words and smells of alcohol, so he is left to sleep it off. He is having a stroke. Treated within hours, it can often be reversed.

Illustrative.

Writing


Email us at hi@medgym.ai.