bottest.ai: Test chatbot conversations against recorded baselines
bottest.ai is an open-source, no-code platform for automating tests of AI chatbots.
What is bottest.ai?
bottest.ai is an open-source testing tool for AI chatbots. Tests are recorded with a few clicks and given baselines, then replayed so responses can be evaluated against those baselines. Suites group tests together and show results as passed, failed, mixed, running, stopped, skipped or errored, with detailed analysis of any failure. The platform covers functionality, performance and security checks, can auto-generate cases to widen coverage, and includes prepackaged chatbot-specific security tests. Analytics track performance over time. It is no-code, self-hosted ready, and deploys on your own infrastructure with a one-command Docker Compose setup so data stays on your systems.
Who is bottest.ai for?
- Developers building and maintaining AI chatbots
- QA and test engineers running chatbot regression suites
- Teams that need chatbot testing on their own infrastructure
Is bottest.ai worth it?
A focused open-source option for teams that want recorded, baseline-driven chatbot tests running on their own infrastructure
Where bottest.ai is strong
- Records and replays chatbot conversations against baselines
- Includes prepackaged chatbot security tests and auto-generated cases
- Self-hosted deployment via one-command Docker Compose setup
Where it falls short
- No published pricing page or paid plan details
- No information on supported chatbot platforms or integrations
How do you get started with bottest.ai?
- 01Clone the project from the GitHub repository
- 02Deploy it on your own infrastructure with the Docker Compose setup
- 03Record a test, set a baseline, and run a suite
bottest.ai: frequently asked questions
What does bottest.ai actually test?
It tests AI chatbot conversations for functionality, performance and security, using recorded tests evaluated against baselines.
Is bottest.ai free?
Yes. The site states that Bottest is free and open source, and points users to GitHub and the documentation.
Can I run it on my own servers?
Yes. It is self-hosted ready, deploys with a one-command Docker Compose setup, and keeps your data on your infrastructure.
Do I need to write code to create tests?
The product is described as no-code automation: you record tests with a few clicks and set baselines for the conversation.
bottest.ai alternatives
The closest tools in our directory, matched on category, focus areas and audience.
Teams wanting execution-backed API, UI and security checks on pull requests
| Tool | Best for | Free plan | Starting price | Focus areas |
|---|---|---|---|---|
| bottest.ai | Teams automating regression, performance and security tests for chatbots | Yes | — | — |
| autify.com | QA and development teams automating web and mobile tests | Yes | $99/mo | — |
| Qodex | Teams wanting execution-backed API, UI and security checks on pull requests | Yes | $1,299/mo | — |
| Hamming AI | QA and reliability for voice and chat agents before and after launch | No | — | — |
| BugRaptors | Teams outsourcing QA, automation, security or ERP testing | No | — | — |
| Mabl | QA and engineering teams automating regression testing at scale | No | — | — |
| Virtuoso QA | Enterprise QA teams needing traceable evidence for releases | No | — | — |
| ACCELQ | QA teams automating web, mobile, API and packaged app testing | No | — | — |
| Klarent | Enterprise QA teams testing web and mobile | No | — | — |
| Applitools Eyes | AI-powered end-to-end testing platform for visual and functional testing. | Unknown | — | — |
| AskUI | Transform Your UI Automation with AskUI | Unknown | — | — |
