Skip to content

Admin View

The Admin View provides a centralized interface for reviewing conversations and analyzing user interactions with Serenity.

Overview

Every conversation with Serenity is recorded and accessible via the Admin View. This includes both the end-user messages and the responses generated by Serenity. The Admin View allows for:

  • Reviewing complete chat history
  • Inspecting low-level technical details for each interaction
  • Reviewing user feedback
  • Applying filters to focus on specific conversation subsets
  • Running targeted analytics to surface common issues and improvement areas

Accessing the Admin View

The Admin View is accessible to users with admin privileges via:

https://<your-serenity-instance>/admin

Conversation Review

All conversations with Serenity are stored and can be reviewed in full. Questions

For each conversation:

✅ Transcript — View the full back-and-forth exchange between the user and Serenity

✅ Feedback Indicators — Quickly identify which messages received thumbs up/down and detailed feedback

Question Details

Technical Details

For advanced debugging and transparency, each conversation includes a Details view. This exposes:

  • LLM system, user prompts, and tool calls
  • Semantic search results and chunks used in the response

Technical Details

Note: For a complete record of all raw messages exchanged with the LLM, including token usage and latency, see Langfuse.

Feedback and Ratings

Feedback provided by users is clearly visible within the Admin View:

  • 👍 Thumbs Up — Indicates user satisfaction with the response
  • 👎 Thumbs Down — Marks an unsatisfactory or incorrect response
  • ✍️ Freeform Feedback — If provided, user comments or additional notes are displayed

This feedback helps prioritize areas for improvement and can be filtered or exported for further analysis.

Filters

The Admin View supports flexible filtering to quickly locate relevant conversations. Common filters include:

Filter Type Description
By Use Filter conversations based on use case (e.g., support, internal QA)
Date Range Limit results to a specific timeframe
Feedback Show only conversations with positive/negative feedback
Custom Filters Additional filters can be configured based on your deployment

Analytics and Reporting

Custom analytics are available to identify trends and improvement areas. Typical analytics include:

Documentation Gap Analysis

Identifies questions that received incomplete or no answers, highlighting potential gaps in your knowledge base or documentation.

Commonly Asked Questions

Surfaces frequently asked question types to reveal areas that cause:

  • High user confusion
  • Recurring misunderstandings
  • Repeated technical issues

These insights help guide documentation updates and product improvements.