Summary

/claim #16

Adds a distinct reviewer calibration and inter-rater agreement assistant for the AI-Powered Research Assistant Suite. The module validates synthetic peer-review packets before AI-generated review summaries, reputation updates, or author-facing recommendations are released.

This slice focuses on reviewer calibration rather than another broad research assistant, evidence binder, structured-abstract checker, model-assumption diagnostic, dependency guard, external-validity transfer assistant, research-gap finder, or reproducibility executor.

What it checks

• pairwise reviewer agreement across clarity, rigor, novelty, reproducibility, and recommendation
• recommendation consensus ratio
• severe score spread by scoring dimension
• domain-template drift
• evidence-anchor coverage for reviewer claim checks
• duplicate reviewer records
• whether disputed packets should remain double-blind during calibration

Reviewer artifacts

• reviewer-calibration-assistant/reports/reviewer-calibration-report.json
• reviewer-calibration-assistant/reports/reviewer-calibration-report.md
• reviewer-calibration-assistant/reports/reviewer-calibration-summary.svg
• reviewer-calibration-assistant/reports/reviewer-calibration-demo.mp4

Demo video raw URL: https://raw.githubusercontent.com/catcherintheroad-hub/SCIBASE.AI/catcherintheroad/reviewer-calibration-assistant/reviewer-calibration-assistant/reports/reviewer-calibration-demo.mp4

Validation

• npm test
• npm run demo
• node --check reviewer-calibration-assistant/src/calibration.js
• node --check reviewer-calibration-assistant/demo/generate-demo.js
• node --check reviewer-calibration-assistant/demo/write-svg.js
• git diff --check
• ffprobe verified the committed MP4 as H.264, 1280x1280, 8 seconds

Boundaries

Dependency-free Node implementation using synthetic data only. It does not call external AI APIs, ingest private manuscripts, access credentials, or integrate with payment systems.