Skip to content
SPECIFICTION
Get listed

AUTOTEST

github.com

WindowsLinuxSelf-hosted
Visit github.com
Spec score 7.5 #20 of 21 in AI Test Case Generators

What it is

AUTOTEST is an open-source GenAI command-line tool that analyzes web pages and generates automated test cases and Python Selenium scripts. Starting from a base URL, it recursively collects unique internal URLs with breadth-first search to a chosen depth. Generated scenarios can include positive and negative cases for login, registration and forms when test data is supplied. Page analysis combines language-model metadata extraction with Selenium selector functions as a fallback. The project lists Selenium and Playwright support, with Puppeteer described in the development branch. LangChain provides access to major open-source and closed-source language models, with OpenAI, Groq and Anthropic shown as provider examples. Tests can pause for a user to handle a CAPTCHA or another security challenge. Scripts and reports are saved in local folders. Python 3.10.12 and an LLM-provider API key are prerequisites. SQLite caching is available, with a no-cache option to regenerate outputs. The project uses the MIT License.

Spec sheet

What it does
AUTOTEST is an open-source GenAI tool that analyzes web pages and generates test cases and Python Selenium scripts.Read 4 Oct 2026 · github.com
Purpose
AUTOTEST is an open-source GenAI tool that analyzes web pages and generates automated test cases and Python Selenium scripts.Read 4 Oct 2026 · github.com
Intended users
The README lists understanding of web-page test cases and knowledge of Selenium scripts among the prerequisites.Read 4 Oct 2026 · github.com
License
The repository says the project is licensed under the MIT license.Read 4 Oct 2026 · github.com
Caching
The README describes caching LLM responses in SQLite and a --no-cache option to regenerate test cases or scripts.Read 4 Oct 2026 · github.com
CLI and outputs
AUTOTEST is primarily CLI-based and stores generated scripts and test reports in local folders.Read 4 Oct 2026 · github.com
Crawling
It extracts unique internal URLs from a base URL using breadth-first search up to a configurable depth.Read 4 Oct 2026 · github.com
Frameworks
The README identifies Selenium and Playwright as supported frameworks and describes Puppeteer support in the dev branch.Read 4 Oct 2026 · github.com
Human intervention
Generated tests can pause for a user to resolve security challenges such as CAPTCHAs.Read 4 Oct 2026 · github.com
Language limit
The README says the current version generates test scripts in Python; support for other languages is under development.Read 4 Oct 2026 · github.com
LLM options
The README says it supports major open-source and closed-source LLMs through LangChain’s abstraction layer, with provider configuration examples including OpenAI, Groq, and Anthropic.Read 4 Oct 2026 · github.com
LLM providers
The README says its LangChain abstraction supports major open-source and closed-source LLMs and gives OpenAI, Groq, and Anthropic as provider examples.Read 4 Oct 2026 · github.com
Manual intervention
Generated tests can pause for a user to resolve a CAPTCHA or other stated security requirement.Read 4 Oct 2026 · github.com
Page analysis
It combines LLM-based page metadata extraction with Selenium selector functions as a fallback.Read 4 Oct 2026 · github.com
Requirements
The README lists Python 3.10.12 and an API key from an LLM provider as prerequisites.Read 4 Oct 2026 · github.com
Security and compliance
The repository describes a manual CAPTCHA handling step but does not state security certifications or compliance claims.Read 4 Oct 2026 · github.com
Test coverage
It can generate positive and negative test cases, including for login, registration, and form pages when test data is supplied.Read 4 Oct 2026 · github.com
URL crawling
It recursively extracts unique internal URLs from a base URL using breadth-first search, up to a specified depth.Read 4 Oct 2026 · github.com
Usage
AUTOTEST is primarily a command-line tool and stores generated scripts and test reports in local folders.Read 4 Oct 2026 · github.com

Strong points and limits

Strong points

  • Crawls internal URLs to a chosen depth
  • Generates positive and negative test cases
  • Supports Selenium and Playwright
  • Works with multiple LLM providers through LangChain
  • MIT-licensed open source

Limits

  • Current script generation is Python-only
  • Requires Python 3.10.12
  • Requires an API key from an LLM provider
  • Primarily command-line with local outputs

Who it suits

AUTOTEST suits developers who understand web-page test cases and Selenium scripts. It fits users comfortable with command-line workflows, Python and configuring an LLM provider.

Verdict

AUTOTEST combines site crawling, language-model page analysis and browser-test generation in a free, self-hosted tool. Its Python focus, command-line operation and API-key requirement define the setup, while CAPTCHA handling can pause generated tests for manual action.

Where Specifiction places it

Alternatives to AUTOTESTAll alternatives →