Skip to main content
An Agent is a customizable AI voice character built for a particular task or audience. Each Agent is defined by a few attributes:
  • Description and Purpose: the prompt that sets the Agent’s role and how it behaves within the chosen LLM.
  • Voice: the voice the Agent speaks with, selected from the Marketplace or from a voice you created yourself.
  • Dynamic Feedback: OpenHome’s DynamicAgentConstructor carries conversation history and stated preferences forward, so an Agent’s later responses take earlier conversations into account. See Memory and Context Injection for how that context is stored and reused.

How Agents Work

An Agent runs on three modules: STT Transcription (Speech-to-Text), TTT Processing (Text-to-Text), and Voice TTS (Text-to-Speech). Each turn of a conversation passes through all three.

Workflow

  1. Speech Input: The system listens for voice commands, initiated by a cold start message.
  2. STT Transcription: The Speech-to-Text (STT) module converts speech into text.
  3. LLM Processing: The transcribed text is processed by the designated LLM (the “brains” of the assistant, the large language model), which generates a relevant response based on the user’s input and conversation history. OpenHome supports over 20 different LLMs.
  4. TTS Synthesis: Once a response is generated, it is converted back into speech using customizable voices, creating a natural, interactive experience. This module brings the conversation to life with fluent, human-like speech.

The Agents Page

The Agents page lists every Agent you can access. Agents page Agents page
  • Tabs: All, My agents, Installed agents, Default agents.
  • History: opens a Shared Agents dialog with a search box for finding Agents that have been shared with you.
  • Explore more: opens the Marketplace.
  • Filters: narrow the list. Grid / List view: switch the layout.
  • Each Agent card shows its avatar, name, tagline, author, chat count, and tags, with a Chat button and a More actions menu for editing or deleting it.

Creating an Agent

Click Create Agent to open the creation dialog, which offers two ways to build one: Create Agent dialog Create Agent dialog

Design Agent with AI

Describe the Agent you want in your own words. This opens the Agent workspace immediately, empty, with the AI chat pane on the left ready for your description. Agent workspace opened from Design Agent with AI, empty and ready for a description Agent workspace opened from Design Agent with AI, empty and ready for a description Type what you want to build. The assistant fills in the form on the right as you go, confirms each change with Updated the form, and asks follow-up questions to refine the Agent. Design Agent with AI chat, with the assistant filling in the Agent name and Marketplace description Design Agent with AI chat, with the assistant filling in the Agent name and Marketplace description Answer its questions to build the Agent out. It generates the Key tags, Starting message, and Description prompt for you, and each section heading gets a checkmark once it has everything it needs. Generated Key tags, Starting message, and Description in the Behavior and Identity section Generated Key tags, Starting message, and Description in the Behavior and Identity section You can edit any generated field by hand before saving.

Pick from a Template

Start from a pre-configured personality and customize it. Templates are grouped by theme, for example Hearth (a smart home assistant) or Kindred (a companion). Choose a template for your Agent Choose a template for your Agent Picking a template opens the same Agent workspace, pre-filled with everything the template set.

The Agent Workspace

Both paths land on the same workspace: an AI chat pane on the left for describing changes in plain language, and an editable form on the right. A red dot marks a section with required fields still outstanding, and the section heading gets a checkmark once it’s complete. Agent Information section Agent Information section Agent Information:
  • Avatar: upload an image (PNG/JPG, 500KB max) or click Generate to create one with AI.
  • Agent name: a unique, identifiable name shown in the dashboard and Marketplace. Has its own Generate button.
  • Visibility & Sharing: Private (only visible to you) or Submit to Marketplace (submits for admin review, then appears in the Marketplace once approved).
  • Marketplace description: a short summary, only shown if published to the Marketplace.
  • Category: pick one, Companion, Education, Famous People, Games, Home, or Role Play.
  • Key tags: add tags to help others find your Agent in the Marketplace.
Behavior and Identity section Behavior and Identity section Behavior & Identity:
  • Starting message: the greeting spoken or shown at the start of a conversation.
  • Language: the language the Agent communicates in.
  • Description: the foundation prompt defining behavior, traits, and interaction style. Has an AI Rewrite button.
  • Prompt Modification: toggle whether OpenHome can adapt your prompt for the user-interaction flow.
Voice and Speech section Voice and Speech section Voice & Speech:
  • Voice: search or pick from Suggested for you, with a play button to preview each one, or click Create Voice. See Voices below.
  • Gender: the gender identity that shapes the Agent’s interaction style.
Model section Model section Model:
  • Base Ability: an Ability that auto-triggers when a call starts. See Abilities.
  • Text-to-Text Platform / Text-to-Text Model: the LLM provider and model.
  • Randomness (Temperature): slide right for more creative, less deterministic responses.
At minimum, fill in name, description, and category, then click Save Agent. Saving opens the Agent’s conversation view, with Agent Settings (Conversation, Behavior, and Identity controls) on the right, ready to talk to right away. An Agent answering a question in its conversation view, with Agent Settings on the right An Agent answering a question in its conversation view, with Agent Settings on the right

Voices

The Voices page lists every voice you can use for an Agent. Voices page Voices page
  • Tabs: All, My voices, OpenHome voices, Public voices, Bookmarked.
  • Explore more: opens the Marketplace.
  • Each voice card shows a preview play button, its traits (for example young, confident), tone (for example calm - male), and language, with a bookmark toggle.
Create Voice offers two paths:
  • Design your voice with AI: describe the sound you want in your own words to create a brand-new voice.
  • Create voice with audio: upload audio files to build a voice, or clone your own.
Create Voice dialog Create Voice dialog For a fast, guided first pass at creating an Agent, see Quickstart. For every other dashboard screen, see Dashboard.