Voice workflows for commerce and service

Voice assistants that can search, verify and hand over

We build voice workflows for shop and service channels. They use approved catalog and order data, verify identity before account-specific answers and pass complete context to a person when the request leaves the safe path.

  • Web and phone channels
  • Identity before account data
  • Human handover with context
Live voice session Account service
Customer request
“Where is my order, and can I still change the delivery address?”
01 · HearTranscribe
02 · VerifyConfirm identity
03 · ReadOrder API
04 · ResolveAnswer or hand over
Safe response

The shipment status can be read aloud. The address change is passed to an agent for confirmation.

No account data before verification · no silent write action
A useful voice assistant manages turn-taking, permissions and escalation—not just speech recognition.

Choose the channel deliberately

Voice is valuable when speaking is easier than navigating

Not every chatbot needs a microphone. We first identify the channel, environment and task where speech removes friction without hiding important information.

Voice should complement a visual or human route. It should not become the only way to complete an essential task.

A strong fit

  • Hands or attention are occupiedA caller, warehouse worker or field employee cannot comfortably navigate a screen.
  • The request is short and boundedProduct availability, order status or initial support triage has a clear result.
  • Natural language is the fastest inputPeople know what they need but not the catalog terms, menu path or filter structure.

Prefer another interface

  • The answer needs visual comparisonDense specifications, prices or several alternatives are easier to scan than to hear.
  • The environment is private or noisySpeaking customer details in public or transcribing poor audio creates avoidable risk.
  • A consequential action cannot be confirmedPayments, contract changes and destructive actions need a stronger verification path.

Voice system architecture

The model sits inside a controlled conversation pipeline

Good voice UX depends on more than transcription. Each stage needs a measurable role and an explicit control before business data or actions become available.

01 Channel and audio

Capture

Accept audio from the selected web, app or phone channel and establish consent.

Channel context · recording policy
02 Speech recognition

Understand

Transcribe language, numbers and product terms while preserving uncertainty.

Correction path · domain vocabulary
03 Identity and policy

Authorize

Verify the user before retrieving customer-specific or protected information.

Least privilege · session scope
04 Retrieval and tools

Resolve

Search approved knowledge or call typed business APIs for the bounded task.

Tool allowlist · validated inputs
05 Speech or service

Respond

Read a concise answer, show a visual result or hand the context to a person.

Confirmation · full handover trace
The exact speech and model providers can change. Identity, tool boundaries and the handover contract remain application responsibilities.

Conversation design

Show the system path, not just a polished answer

Each dialogue makes data access, confirmation and fallback visible. There is no autoplay: the user chooses the scenario they want to inspect.

Evaluation before rollout

Measure the complete task, not only speech recognition

A transcript can be correct while the workflow still fails. We evaluate understanding, task outcome, response time and the quality of the human handover together.

Each row shows the decision the measure supports.

MeasureWhat it revealsRelease evidence
Task completionWhether the customer reached the correct bounded outcomeReviewed conversations across normal and difficult requests
Correction burdenHow often names, numbers or product terms need to be repeatedTests with relevant accents, devices and background noise
Response latencyWhether turn-taking still feels usable at realistic loadLatency distribution for transcription, tools and speech output
Containment qualityWhether self-service resolves suitable cases without hiding bad outcomesSuccessful resolution separated from false or premature containment
Handover qualityWhether an agent receives enough verified context to continueTransfer tests covering transcript, identity and unresolved intent

Privacy and control

Voice creates obligations that text interfaces can avoid

Audio, transcripts and spoken account details need an explicit policy. The interface should explain what is happening without forcing the customer through legal copy mid-conversation.

Controls are designed with the customer experience, not added after the pilot.

AreaSystem controlCustomer experience
Recording and consentDefine when audio or transcripts are stored and for how longState recording clearly and provide a route without recording
Identity and accessVerify before customer-specific retrieval and scope each tool callExplain why verification is needed before asking for it
Consequential actionsRequire deterministic validation and explicit confirmationRepeat the exact change before it is submitted
Sensitive dataRedact protected fields and block unsuitable spoken collectionMove payment or credential entry to a secure visual channel
Accessibility and choiceKeep equivalent text, visual or human access availableNever make speech the only path to an essential service

Provider, hosting and retention choices are documented for the selected channel and jurisdiction rather than promised in the abstract.

Delivery model

Start with one channel and a small set of intents

A focused vertical slice exposes audio, integration and handover risks before the team commits to a broad multilingual service.

  1. 01

    Choose channel and task

    Define where people speak, which requests are in scope and what remains visual or human.

  2. 02

    Collect real language

    Use support questions, search terms, product vocabulary and difficult audio conditions.

  3. 03

    Connect a bounded path

    Add the minimum identity, catalog or order interfaces required for the complete task.

  4. 04

    Evaluate and release

    Test task outcome, latency, privacy and handover before a staged rollout.

Practical questions

What teams should settle before implementation

Channel and risk determine the technical answer. These decisions should not be left to the speech provider defaults.

Is this a phone assistant or voice control in the shop?

It can be either, but they are different products. We select one initial channel because telephony, browser audio, identity, latency and handover requirements differ.

Can it access customer and order data?

Yes, through scoped application interfaces after the customer has been verified. The model does not receive broad database access, and failed verification must disclose no account information.

How do you handle accents and background noise?

We test representative recordings from the intended channel, preserve transcription uncertainty and provide correction or handover paths. A quiet demo is not sufficient evidence for release.

Do conversations have to be recorded?

No. Audio, transcripts and evaluation samples can have different retention rules. The selected policy depends on operational need, consent, provider behaviour and applicable law.

Can the assistant perform actions?

Only through approved, narrowly scoped tools. Sensitive or irreversible changes require deterministic validation, explicit confirmation and, where appropriate, human approval.