Eval

"Unit tests" for your agent skills

Public results and task definitions for FrontierHarness Eval

Test that your Claude Code skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, activation checks, A/B experiments, CI gates.

An MCP server that autonomously evaluates web applications.

Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

开源 AI 应用评测平台，支持 RAG、AI Agent、多轮对话、LLM-as-Judge、接口评测、评测报告和人工盲测。Open-source AI evaluation platform for RAG, AI Agents, multi-turn conversations, LLM-as-Judge, endpoint evaluation

A Model Context Protocol (MCP) server that provides advanced code analysis and reasoning capabilities powered by Google's Gemini AI

build eval for your agent in 10 mins

GitHub Copilot and AI Agent skill that parses job descriptions, mirrors exact technical terminology, quantifies impact metrics, and evaluates engineering compensation packages.

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

Comprehensive developer guide covering prompt engineering, agent orchestration, LLM application architecture, and evaluation formulas.

The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

Open-source AI-native canvas and agent workspace unifying multi-threaded chat, knowledge retrieval, and document co-creation.

Upstash Context7 MCP Server providing ultra-fast vector search, semantic context retrieval, and Redis caching for AI models and Cursor IDE.

Comprehensive hands-on course and curriculum for Large Language Models (LLMs) with interactive Colab notebooks, fine-tuning recipes, quantization, and evaluation roadmaps.

Improve how you work with AI. Portable Claude Code and Codex skill with evidence-based assessment and evaluation.

The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

Long-term memory for any AI agent. One Rust binary, offline, 98.2% recall@5 on LongMemEval-S. Self-host free or use Uteke Cloud.

Versioned Codex instruction deployment with preview, ownership manifests, hook isolation, scenario evaluation, and recovery.

🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery

Milvus & Zilliz-powered Claude Desktop and Cursor MCP server for long-term agent memory, doc retrieval, and code knowledge graph querying.

Open-source AI job search: scan job portals, evaluate listings into a structured A-H report with a global 1-5 score, tailor your CV, track applications — runs locally in your AI coding CLI (Claude Code, Codex, OpenCode, Antigravity…)

OpenClaw + 大模型驱动的完整电商客服自动化系统：覆盖淘宝、拼多多、抖音、快手、小红书、视频号，包含浏览器/手机 Worker、订单物流与售后工具、记忆、回执、恢复和 Eval。

Plugins, agents, skills, and commands for Claude Code, Codex CLI, Cursor, OpenCode, Antigravity CLI, GitHub Copilot, and Pi, written once in Markdown and adapted to each tool by generators with validation and evals.