Arize Evaluator

by github

Arize Evaluator is an AI Engineering skill for Claude Code, published by github in awesome-copilot.

37.8K stars4.8K forkson github/awesome-copilotAdded 2026/08/13Repository updated 2026/08/13

View source on GitHub Download repo ZIP

agent-skillsagentsaiawesomecustom-agentsgithub-copilothacktoberfestprompt-engineering

Install in seconds

Install Arize Evaluator

Copy Arize Evaluator into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/github/awesome-copilot/tree/main/skills/arize-evaluator ~/.claude/skills/arize-evaluator

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/github/awesome-copilot.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: skills/arize-evaluator/SKILL.md in github/awesome-copilot
Installs to: ~/.claude/skills/arize-evaluator
Collection: One of 25 skills cataloged from this repository
Category: AI Engineering — 2451 skills

What Arize Evaluator does

Arize Evaluator creates and runs LLM-as-judge evaluators on Arize, including setting up evaluator templates, running evaluations on spans or experiments, and managing tasks and column mappings. Use it when working with hallucination, faithfulness, correctness, relevance, or other LLM quality metrics.

Arize Evaluator is cataloged under AI Engineering on DirSkills. Arize Evaluator comes from a repository tagged agent-skills, agents, ai, awesome and custom-agents.

Documentation

README

Excerpt

Arize Evaluator Skill

SPACE — All --space flags and the ARIZE_SPACE env var accept a space name (e.g., my-workspace) or a base64 space ID (e.g., U3BhY2U6...). Find yours with ax spaces list.

This skill covers designing, creating, and running LLM-as-judge evaluators on Arize. An evaluator defines the judge; a task is how you run it against real data.

Prerequisites

Proceed directly with the task — run the ax command you need. Do NOT check versions, env vars, or profiles upfront.

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Arize Evaluator

What else does github publish alongside Arize Evaluator?
Arize Evaluator is one of 25 skills that DirSkills catalogs from github/awesome-copilot, the repository it ships in. Its siblings there include AI Prompt Engineering Safety Review, AI Readiness Assessment and AI Ready. Each one is a separate skill with its own page in this directory, installs the same way Arize Evaluator does, and is maintained by github in that same repository. The rest of the collection is listed on the github/awesome-copilot page.
How does Arize Evaluator compare to other AI Engineering skills?
Arize Evaluator ranks #156 by stars among the 2451 AI Engineering skills in this catalog. The most-starred ones next to it are Architecture Decision Records, AI-First Engineering and Agentic OS. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Arize Evaluator against them. Open each page to compare what they document and how they install.