Helpy
An assistant that watches an expert work, listens to their narration and asks about decisions at natural pauses. The session becomes a Work Map of steps, rules and reasons. A new colleague then practices with it, and mistakes get caught before saving. Screenshots are OCR'd and redacted right in the browser. Started at Hack-Nation 7.
Capture
- Screen and voice
- OCR and redaction in the browser
- Questions at pauses
Teach
- Debrief and teach-back
- Work Map
- Practice with guardrails
| Screenshot pipeline (sparse screen) | 378 ms end to end |
|---|---|
| Screenshot pipeline (dense screen) | 1,512 ms end to end |
| Capture | every 2 s, full-resolution frame |
TypeScript · React · TanStack Start · Convex · Claude · ElevenLabs · Tesseract.js