Skip to content

Internal customer subscription deployment

The Internal Customer Subscription Deployment model for SerenityGPT allows organizations to deploy and run the entire solution within their own infrastructure. This model provides maximum control over data and security, making it suitable for organizations with strict compliance requirements or those who prefer to manage their own IT resources.

Architecture overview

Internal Deployment Architecture

In this deployment model, all SerenityGPT components run within the customer's infrastructure as containerized applications. The architecture typically includes:

  1. Natural language search engine: The core component that processes user queries and searches across indexed data sources.
  2. Data ingestion and indexing: Integrates with your existing data sources to create a searchable index.
  3. Contextual understanding and response generation: Utilizes large language models to analyze and interpret retrieved information, synthesizing coherent explanations.
  4. Multi-language support: Optionally integrates with translation services for global deployments.
  5. User interface: A web-based interface for query input and result display.
  6. Database containers: Store indexed data and search metadata.
  7. Load balancer: Distributes incoming requests across application containers for improved performance and reliability.
  8. Authentication integration: Connects to the organization's existing identity provider (e.g., Microsoft Entra ID).
  9. Internal network: Securely connects all components within the customer's infrastructure.

Key benefits

  1. Full data control: All data remains within the organization's infrastructure, addressing data residency and sovereignty requirements.
  2. Customization: Ability to tailor the deployment to existing infrastructure and security policies.
  3. Integration: Seamless integration with internal systems and data sources.
  4. Compliance: Easier to meet strict regulatory requirements by maintaining full control over the environment.

Considerations

Before opting for an internal deployment, consider the following:

  1. Resource requirements: Requires internal IT resources for deployment, maintenance, and scaling.
  2. Updates: Customer is responsible for applying updates and patches to containers and underlying infrastructure.
  3. Performance optimization: May require fine-tuning for optimal performance based on specific infrastructure.

If you have questions about these considerations or need assistance in evaluating your readiness for an internal deployment, please contact our support team.

Deployment process

The deployment process involves several key steps to ensure a successful implementation of SerenityGPT in your environment:

  1. Prepare infrastructure based on System requirements.
  2. Pull and deploy SerenityGPT container images from our provided container registry.
  3. Configure database connections and data source integrations within the containers.
  4. Set up authentication integration with your internal identity provider.
  5. Perform initial data ingestion and indexing using our provided tools.
  6. Configure load balancing for the application containers.
  7. Implement network security measures as per your organization's policies.
  8. Conduct thorough testing and validation, including:
  9. Functionality testing of search and response generation
  10. Performance testing under expected load
  11. Security testing to ensure proper access controls and data protection

For detailed guidance on each step or assistance with the deployment process, please reach out to our support team.

Scaling and maintenance

Proper scaling and maintenance are crucial for optimal performance of your SerenityGPT deployment:

  • Horizontal scaling: Add application containers to handle increased load. This can often be automated using container orchestration platforms like Kubernetes.
  • Vertical scaling: Upgrade container resources (CPU, RAM) as needed, which may require adjusting your container definitions.
  • Regular backups: Implement backup strategies for databases and configuration, ensuring you can recover quickly in case of issues.
  • Monitoring: Set up monitoring tools to track system health, container performance, and resource utilization.

Our team can provide best practices and assistance in setting up robust scaling and maintenance procedures. Contact support for personalized guidance.

Security considerations

Securing your SerenityGPT deployment is paramount. Key security measures include:

  • Implement network segmentation to isolate SerenityGPT containers.
  • Use internal PKI for TLS certificate management between containers and external access points.
  • Regularly audit access controls and permissions for all components.
  • Implement data encryption at rest and in transit for all containers and data stores.
  • Keep container images and host systems updated with the latest security patches.

For a comprehensive security assessment or to discuss advanced security configurations, please contact our security team at security@serenitygpt.com.

Next steps

To begin your internal deployment journey:

If you need any clarification or assistance with your internal deployment, please reach out to our support team. We're here to ensure your SerenityGPT deployment is successful and optimized for your specific needs.