Back
researchproductivityOpen source

Jev Paper Judge

Judge a paper's readability and completeness with narrow Jev questions.

What Jev decides

Whether a passage or paper section meets each rubric criterion.

Jev Paper Judge splits a PDF into passages, asks Jev rubric questions, and combines the answers with deterministic checks into an inspectable report.

NOULSCORE
Jev role
Judge focused readability and completeness properties of paper passages.
Input
Extracted paper passages, paper-level structure, and fixed rubric questions.
Output
Typed probabilities and ordered scores combined by server-side code.
Decision frequency
On each paper upload, across its passages and paper-level state.
Fallback
Deterministic checks handle countable facts; unsure findings are qualified in the report.
Author reported · Source reviewed

How it works

Input
Extracted paper passages, paper-level structure, and fixed rubric questions.
Jev
NOUL + SCORE
Output
Typed probabilities and ordered scores combined by server-side code.

Overview

The browser extracts text from a PDF and divides the paper into passages. A Worker asks Jev focused questions about clarity, explained terms, and missing presentation details. Code combines the answers with checks for acronyms, figures, and section coverage, then compares scores with a reference set of accepted papers. Low-confidence findings are labelled separately.

The tool assesses presentation and completeness, not scientific correctness. It needs a text layer in the PDF; scanned papers are not OCRed. The published reference calibration and performance figures are supplied by the project authors.

Language
TypeScript
License
MIT
Author
JacobLinCool
Sources checked Sep 23, 2026

Sources

Related projects