Latență
Latency
The time elapsed between the user's question and the assistant's first response. High latency kills the conversation: the customer perceives the hesitation as a malfunction. The practical goal for a business assistant is a response perceived as almost instant.
- Appeared
- A universal performance metric; critical for conversational UX.
- Tactics
- We optimize latency per channel; the operational target is a response under 3 seconds. The choice of [model](#llm) and management of the [context window](#context-window) are the main levers.
Related terms
“Latență” is part of Glossary · AI Chatbot — part of the Atlas, Websem's reference of AI search, marketing and data terms.