Voice Agent for Knowledge Workers
Learn how we built a real‑time voice assistant with persistent user state, safe tool access and interruptible dialogue.
CHALLENGE
Frontline employees technicians, warehouse workers and other field staff needed to look up information, schedule tasks and log activities without stopping to type or click. The solution had to be hands‑free, responsive and capable of maintaining user‑specific context across sessions. Dialogue needed to be interruptible so users could correct commands on the fly, and all actions had to execute safely and reliably.
SOLUTION
We created a real‑time voice agent that streams live audio and uses a large‑language‑model reasoning loop. The system maintains a persistent user profile, synchronizes live conversation with tool execution and memory updates, and defines clear tool schemas to control access to search, scheduling and task logging. The agent validates every tool call before updating state, ensuring safety and consistency.
Impact
Frontline employees now interact naturally with a hands‑free assistant that schedules meetings, searches information and logs tasks. They can interrupt to correct commands, and their data persists across sessions. The framework has become a template for other high‑consequence domains needing reliable voice interfaces.
