Evaluation & Testing

Awesome papers involving LLMs in Social Science.

A test runner for agentskills.io-style AI agent skills

Deliver safe & effective language models

Deliver safe & effective language models

Data-Driven Evaluation for LLM-Powered Applications

Free, open-source AWS emulator. LocalStack alternative: 26 services, 1,924 operations, 100% conformance. No account, no auth token, no paid tier.

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

A comprehensive set of LLM benchmark scores and provider prices. (deprecated, read more in README)

Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.

A list of LLMs Tools & Projects

Python SDK for running evaluations on LLM generated responses

Computer-Use SDK for E2E QA Testing

QA Skills Directory QA Skills is a curated directory of testing-specific skills for AI coding agents (Claude Code, Cursor, Copilot, etc.).

The self-improving Agentic QA harness with Memory. Write tests in natural language.
 Catch regressions before releases ship.

Spec2Case 是生产级 AI 测试用例生成智能体，支持图片/文本需求理解、人工确认、LangGraph 流程编排和 Excel 用例导出。