Monitoring and Reporting
2 min
The Evaluation enables administrators and product owners to measure, monitor, and improve the performance of the Brand Concierge assistant.
Evaluation
- Central dashboard showing evaluation results
- Provides performance metrics and insights
The system evaluates performance across three key dimensions:
Category | Focus Area | Purpose |
|---|---|---|
Functional Evaluation | Response accuracy & correctness | Ensures expected outputs are met |
Out-of-Scope Evaluation | Handling irrelevant queries | Validates fallback behaviour |
Safeguard Evaluation | Safety & compliance | Ensures policy adherence |
Performance Snapshot
- Performance Snapshot: Displays cards summarizing key metrics, including total conversations, unique users, sentiment trends, and engagement rate.
- View Report Button: Allows you to open a dashboard powered by Customer Journey Analytics for in-depth access to advanced analytics and performance metrics.
Note: To see conversations for this concierge, set Concierge ID (Event) to 6ab406d233636f009ac92f1a. Conversations before 14 Oct 2026 were recorded under the earlier concierge ID 69ccf3501f1b4b35719eb553. To include that history, leave Concierge ID unfiltered.
