shinpr/rashomon
18 stars · Last commit 2026-08-30
Measure prompt and skill improvements with blind A/B comparison.
README preview
<p align="center"> <img src="assets/rashomon-banner.jpg" width="600" alt="Rashomon"> </p> <p align="center"> <a href="https://claude.ai/code"><img src="https://img.shields.io/badge/Claude%20Code-Plugin-purple" alt="Claude Code"></a> <a href="LICENSE"><img src="https://img.shields.io/badge/License-MIT-blue" alt="License"></a> </p> <p align="center">English | <a href="README.zh-CN.md">简体中文</a></p> **Find out whether a skill improves agent behavior before you ship it.** A capable model can follow a bad instruction very well. Unnecessary gates become unnecessary stops. Rigid procedures become extra work. Rules written around an older model's limitations can hold back a newer one. In some cases, an agent performs better without the skill. Rashomon tests that possibility. It runs the same task under a baseline and a changed version, then compares the results without revealing which version produced them. For skills, the result is a `ship`, `revise`, or `reject` recommendation. ## Quick Start