STT-LLM-TTS Agent
Deepgram · GPT-4.1 mini · Cartesia
adds latency
The notches that work today are voice and a face.
Voice + face is the only notch with mature SDKs, sub-second latency, and a working price model today.
Overview of the Embodied AI Agent architecture[1]
Give a system a voice, a face, or a name: users run their social OS on it.
They will deny it. The record will not.
“Computers don’t have feelings.”
Rated the computer higher when it asked about itself.[1]
Gendered voices trigger stereotypic topic-expertise judgments, especially with male evaluators.[2]
Full-body agents beat talking heads on three of four formats.
Pointing gestures drive the gains.
Free recall is the exception. Talking heads finally pull ahead, and facial cues join pointing as significant gesture moderators.
Human turn-taking sits at ~200 ms. Voice AI just met it.
A voice (and a face) can flip the switch.
Voice is the easy part. The system around it is the product.
Concentric safeguards around every multimodal interaction.
For a writer with dyslexia, AI didn't teach her to spell. It made spelling obsolete.
— Voice and a face stop excluding by default. The same lever that includes can be misused.
Can two AIs hold a conversation?
Mohammad
Petri
Press start to begin
Open and run the notebooks in Colab.
Deepgram · GPT-4.1 mini · Cartesia
OpenAI gpt-realtime · speech-in, speech-out
github.com/soltaniehha/ODSC-2026
—