Adding a data source and creating an eval

Complete these steps after finishing the Self-Service Installation Guide.

Add a data source

Follow the instructions in Configuration.

Verify Document Indexing

Check Indexing Status

Run the num_docs command to get document and chunk statistics.

• Make sure the number of documents indexed aligns with your expectations and that the corresponding chunks were processed.

Browse Indexed Content

For detailed inspection, use the admin interface:

• Documents: /admin/documents/document/ - View all indexed documents and their metadata

• Chunks: /admin/chunks/chunk/ - Examine how documents were chunked and processed

Create an Evaluation

Set up an eval to measure system performance. Follow the guide at SerenityGPT Evals Documentation.

Run and Analyze Evals

Execute the Eval

Run the eval command.

Review Results

Examine the evaluation output following Interpreting Eval Results.