Admin View
The Admin View provides a centralized interface for reviewing conversations and analyzing user interactions with Serenity.
Overview
Every conversation with Serenity is recorded and accessible via the Admin View. This includes both the end-user messages and the responses generated by Serenity. The Admin View allows for:
- Reviewing complete chat history
- Inspecting low-level technical details for each interaction
- Reviewing user feedback
- Applying filters to focus on specific conversation subsets
- Running targeted analytics to surface common issues and improvement areas
Accessing the Admin View
The Admin View is accessible to users with admin privileges via:
Conversation Review
All conversations with Serenity are stored and can be reviewed in full.
Each question row offers two ways to inspect it:
- view — See the conversation as it appeared to the user.
- Details — See the context and AI decisions behind the response.
Clicking view brings up the conversation as it appeared to the user, showing the full back-and-forth exchange between the user and Serenity along with the thumbs up/down ratings and detailed feedback for each message.
Technical Details
For advanced debugging and transparency, each conversation includes a Details view. This exposes:
- LLM system, user prompts, and tool calls
- Semantic search results and chunks used in the response
Clicking Details brings up the full context trace for the conversation: every step the AI decided to take, the tool calls it made, and the context available to it at each point in time.
Clicking Debug brings up the system prompt. You can modify these instructions and regenerate the answer to see whether a better response can be produced.
Note: For a complete record of all raw messages exchanged with the LLM, including token usage and latency, see Langfuse.
Feedback and Ratings
Feedback provided by users is clearly visible within the Admin View:
Thumbs up and thumbs down indicators appear next to each answer in the question list, and detailed feedback is available under Rate feedbacks.
Opening a feedback entry lets a reviewer record what was done to address it. The Conclusion field provides space to leave comments on the actions taken in response to the feedback.
This feedback helps prioritize areas for improvement and can be filtered or exported for further analysis.
Filters
The Admin View supports flexible filtering to quickly locate relevant conversations. Common filters include:
| Filter Type | Description |
|---|---|
| By Use | Filter conversations based on use case (e.g., support, internal QA) |
| Date Range | Limit results to a specific timeframe |
| Feedback | Show only conversations with positive/negative feedback |
| Custom Filters | Additional filters can be configured based on your deployment |
Analytics and Reporting
Custom analytics are available to identify trends and improvement areas. Typical analytics include:
Documentation Gap Analysis
Identifies questions that received incomplete or no answers, highlighting potential gaps in your knowledge base or documentation.
Commonly Asked Questions
Surfaces frequently asked question types to reveal areas that cause:
- High user confusion
- Recurring misunderstandings
- Repeated technical issues
These insights help guide documentation updates and product improvements.