Mutahunter 1.2.4

Check out our open-source, language-agnostic mutation testing tool using LLM agents here: https://github.com/codeintegrity-ai/mutahunter Mutation testing is a way to verify the effectiveness of your test cases. It involves creating small changes, or “mutants,” in the code and checking if the test cases can catch these changes. Unlike line coverage, which only tells you how much of the code has been executed, mutation testing tells you how well it’s been tested. We all know line coverage is BS. That’s where Mutahunter comes in. We leverage LLM models to inject context-aware faults into your codebase. As the first AI-based mutation testing tool, Our AI-driven approach provides a full contextual understanding of the entire codebase by using the AST, enabling it to identify and inject mutations that closely resemble real vulnerabilities. This ensures comprehensive and effective testing, significantly enhancing software security and quality. We also make use of LiteLLM, so we support all major self-hosted LLM models We’ve added examples for JavaScript, Python, and Go (see /examples). It can theoretically work with any programming language that provides a coverage report in Cobertura XML format (more supported soon) and has a language grammar available in TreeSitter.

Tags java go python bug-tracking build-tool debugger python-module python
License Affero GPLv3
State stable

Recent Releases

1.2.416 Jan 2025 21:01 minor feature: Develop by @jungs1 in #1 Develop by @jungs1 in #3 LLM Surving Mutant Anlaysis by @jungs1 in #4 Develop by @jungs1 in #6 docs: update README.md by @eltociear in #9 feat: improve mutant quality, reduce syntax error for mutant generation by @jungs1 in #10 HTML report, token cost reduction by @jungs1 in #11 report generator by @jungs1 in #12 feat: adding replit to readme by @abilashraghuram in #15 Refactor by @jungs1 in #16 Separate code cov and mutation cov unittest generator by @jungs1 in #19 Test generation improvement by @jungs1 in #20
02 Jul 2024 01:29 minor feature: