MedAssist — AI Medication Verification & Dispensing
Robotic dispensing agent that closes the sense-reason-act loop for medication safety.
MedAssist addresses a critical healthcare problem: approximately 1.5 million people are harmed by medication errors in the US each year. The system closes the full sense-reason-act loop — a camera sees what's on the tray, an AI agent reasons about what should be there for a specific patient, and a robotic arm physically executes the verified pick or refuses to move if anything is wrong.
The Sense stage uses the SO-101 robotic arm's camera to scan the medication tray, with Claude Vision identifying each vial by drug name, dosage, expiry, and tray position. The Reason stage runs a Toolhouse agent that performs a 10-check safety sequence in strict priority order against the patient medication record. The Act stage calls the Cyberwave robot skill to execute the verified pick, with ElevenLabs providing real-time voice narration.
Built at the Robotic Agents Hackathon (March 2026) in the Cyberwave × Toolhouse track, with teammates Aaryan Mahipal, Anna Saltveit, and Gayatri Patil.
- Complete sense-reason-act loop: camera vision, AI reasoning, and robotic arm execution
- 10-check safety sequence with strict priority ordering — first failure halts the process
- Claude Vision for medication identification: drug name, dosage, expiry, tray position
- Toolhouse agent integration with Cyberwave robot skills for autonomous picking
- Real-time ElevenLabs voice narration of dispensing actions