Paper Review

by agentscope-ai

Paper Review is a Quality skill for Claude Code, published by agentscope-ai in OpenJudge.

797 stars64 forkson agentscope-ai/OpenJudgeAdded 2026/08/23+1% in starsRepository updated 2026/08/03

View source on GitHub Download repo ZIP

agentagent-skillsai-agentalignmentevaluationgraderllmrewardreward-modelrlhfskill-mdskills

Install in seconds

Install Paper Review

Copy Paper Review into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/agentscope-ai/OpenJudge/tree/main/skills/paper-review ~/.claude/skills/paper-review

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/agentscope-ai/OpenJudge.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: skills/paper-review/SKILL.md in agentscope-ai/OpenJudge
Installs to: ~/.claude/skills/paper-review
Collection: One of 18 skills cataloged from this repository
Category: Quality — 1354 skills

What Paper Review does

Paper Review reviews academic papers for correctness, quality, novelty, and reference accuracy using OpenJudge's multi-stage pipeline. Use it when you need to assess a PDF, LaTeX source package, or BibTeX file for a research paper.

Paper Review is cataloged under Quality on DirSkills. Paper Review comes from a repository tagged agent, agent-skills, ai-agent, alignment and evaluation.

Documentation

README

Excerpt

Paper Review Skill

Multi-stage academic paper review using the OpenJudge PaperReviewPipeline:

Safety check — jailbreak detection + format validation
Correctness — objective errors (math, logic, data inconsistencies)
Review — quality, novelty, significance (score 1–6)
Criticality — severity of correctness issues
BibTeX verification — cross-checks references against CrossRef/arXiv/DBLP

Prerequisites

# Install OpenJudge
pip install py-openjudge

# Extra dependency for paper_review
pip install litellm
pip install pypdfium2  # only if using vision mode (use_vision_for_pdf=True)

This is the opening of the README. Read the full README on GitHub.

Commands Paper Review provides

Slash commands named in this skill’s SKILL.md, listed in the order they first appear.

/v1

Frequently asked about Paper Review

What else does agentscope-ai publish alongside Paper Review?
Paper Review is one of 18 skills that DirSkills catalogs from agentscope-ai/OpenJudge, the repository it ships in. Its siblings there include Align Human, Auto Arena and BibTeX Verification. Each one is a separate skill with its own page in this directory, installs the same way Paper Review does, and is maintained by agentscope-ai in that same repository. The rest of the collection is listed on the agentscope-ai/OpenJudge page.
How does Paper Review compare to other Quality skills?
Paper Review ranks #976 by stars among the 1354 Quality skills in this catalog. The most-starred ones next to it are Benchmark, Benchmark Optimization Loop and API Design Patterns. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Paper Review against them. Open each page to compare what they document and how they install.