Evaluations

[NeurIPS 2025] Official repository of RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents

Awesome Jev: a source-backed field guide to TypeSafe's System One model, with SDKs, live demos, agent tools, and independent evaluations.

Evidence-first game operations incident investigation agent with read-only MCP tools and reproducible evaluations.

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

SGLang is a high-performance serving framework for large language models and multimodal models.

GitHub Copilot and AI Agent skill that parses job descriptions, mirrors exact technical terminology, quantifies impact metrics, and evaluates engineering compensation packages.

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

Comprehensive developer guide covering prompt engineering, agent orchestration, LLM application architecture, and evaluation formulas.

Collection of production-ready Gemini function calling schemas, audio/video analysis skills, and structured JSON generation templates.

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

Comprehensive hands-on course and curriculum for Large Language Models (LLMs) with interactive Colab notebooks, fine-tuning recipes, quantization, and evaluation roadmaps.

Improve how you work with AI. Portable Claude Code and Codex skill with evidence-based assessment and evaluation.

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

AI 短剧/漫剧创作 skill 合集，覆盖剧本、资产、分镜、图片/视频提示词到独立审查全链路，适配 Claude Code 与 Codex。| An AI short-drama skill suite for Claude Code & Codex: scripts, assets, storyboards, image/video prompts, and independent review.

Curated Golang development skills for Claude Code: idiomatic Go patterns, concurrency safety checks, table-driven testing, and linter fixes.

A Windows workbench and native Python Pi harness for Odoo 19: approved business actions, state readback, traceable runs, and ERP-Bench evaluation.

Recoverable and auditable deep-research agent built with LangGraph. It plans research, searches the web, manages evidence and context, resumes interrupted runs, and generates cited reports—also designed as a learning reference for AI Agent enthusiasts.

HeyClaude (formerly Claude Pro Directory) is a searchable collection of pre-built AI skills, agents, MCP servers, guides, hooks, statuslines, and other custom configs, designed to enhance Claude, Codex, Cursor, OpenClaw, and various other agentic workflows/platforms.

Local code search combining BM25, vector similarity, and cross-encoder reranking. Parses 60+ languages with tree-sitter, runs entirely offline, and returns structured results with file paths, line ranges, and symbol metadata. Built in Rust.

One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.

Rust graph-vector database: OpenCypher (99.9% of evaluated TCK scenarios pass), vector search, graph algorithms, RESP + HTTP. LDBC SNB Interactive and BI complete; 1B edges on one machine.

A curated list of indie-built AI startups — bootstrapped, pre-seed, and angel-funded products only.

Open-source AI job search: scan job portals, evaluate listings into a structured A-H report with a global 1-5 score, tailor your CV, track applications — runs locally in your AI coding CLI (Claude Code, Codex, OpenCode, Antigravity…)