LaunchRoundsSubmit Software

bottest.ai: Test chatbot conversations against recorded baselines

bottest.ai is an open-source, no-code platform for automating tests of AI chatbots.

What is bottest.ai?

bottest.ai is an open-source testing tool for AI chatbots. Tests are recorded with a few clicks and given baselines, then replayed so responses can be evaluated against those baselines. Suites group tests together and show results as passed, failed, mixed, running, stopped, skipped or errored, with detailed analysis of any failure. The platform covers functionality, performance and security checks, can auto-generate cases to widen coverage, and includes prepackaged chatbot-specific security tests. Analytics track performance over time. It is no-code, self-hosted ready, and deploys on your own infrastructure with a one-command Docker Compose setup so data stays on your systems.

Who is bottest.ai for?

  • Developers building and maintaining AI chatbots
  • QA and test engineers running chatbot regression suites
  • Teams that need chatbot testing on their own infrastructure

Is bottest.ai worth it?

A focused open-source option for teams that want recorded, baseline-driven chatbot tests running on their own infrastructure

Where bottest.ai is strong

  • Records and replays chatbot conversations against baselines
  • Includes prepackaged chatbot security tests and auto-generated cases
  • Self-hosted deployment via one-command Docker Compose setup

Where it falls short

  • No published pricing page or paid plan details
  • No information on supported chatbot platforms or integrations

How do you get started with bottest.ai?

  1. 01Clone the project from the GitHub repository
  2. 02Deploy it on your own infrastructure with the Docker Compose setup
  3. 03Record a test, set a baseline, and run a suite

bottest.ai: frequently asked questions

What does bottest.ai actually test?

It tests AI chatbot conversations for functionality, performance and security, using recorded tests evaluated against baselines.

Is bottest.ai free?

Yes. The site states that Bottest is free and open source, and points users to GitHub and the documentation.

Can I run it on my own servers?

Yes. It is self-hosted ready, deploys with a one-command Docker Compose setup, and keeps your data on your infrastructure.

Do I need to write code to create tests?

The product is described as no-code automation: you record tests with a few clicks and set baselines for the conversation.

bottest.ai alternatives

The closest tools in our directory, matched on category, focus areas and audience.

bottest.ai compared with its alternatives
ToolBest forFree planStarting priceFocus areas
bottest.aiTeams automating regression, performance and security tests for chatbotsYes——
autify.comQA and development teams automating web and mobile testsYes$99/mo—
QodexTeams wanting execution-backed API, UI and security checks on pull requestsYes$1,299/mo—
Hamming AIQA and reliability for voice and chat agents before and after launchNo——
BugRaptorsTeams outsourcing QA, automation, security or ERP testingNo——
MablQA and engineering teams automating regression testing at scaleNo——
Virtuoso QAEnterprise QA teams needing traceable evidence for releasesNo——
ACCELQQA teams automating web, mobile, API and packaged app testingNo——
KlarentEnterprise QA teams testing web and mobileNo——
Applitools EyesAI-powered end-to-end testing platform for visual and functional testing.Unknown——
AskUITransform Your UI Automation with AskUIUnknown——