01 · Roasts
Citation pending
13,470 trials across six models is serious research; 0 stars and 0 forks means the audience has not arrived yet.
CI-shaped hole
Three repositories, zero CI pipelines: the statistical rigor is checking in before the automation is.
Tests chose favorites
ungrounded has substantial tests, while ungrounded-agents and Decoy-Tool are still running on methodological confidence alone.
Private-mode alibi
The heatmap is sparse, but privateWorkLikely=true keeps the public 101-commit year from telling the whole story.
Built using
Zoral
Shadows one worker for a week, then takes over their job with zero extra setup. Behaves exactly like the original.
zoral.ai
02 · Category breakdown
- Impact25% weight30F
- Consistency20% weight55D
- Quality20% weight59D
- Depth15% weight50D
- Breadth10% weight40D
- Community10% weight25F
03 · Stats
365-day commit heatmap
20 active days
Language distribution
- Python78%
- TeX22%
- Shell1%
04 · Numbers
Owned repos
non-fork
4
Commits
last 12 months
101
Followers
0
Joined GitHub
Mar 2026
05 · Top repos
Taran-Douley /
ungrounded-agents
A substantial, reproducible Python research repository with four experiment harnesses, 13,470 trials, clustered statistical analysis, figures, raw-data workflows, and a detailed preprint, but no tests, CI, typed code, or detected license.
Taran-Douley /
ungrounded
A polished, research-oriented Python package for measuring LLM tool misselection, with a CLI, provider adapters, clustered statistics, replication stimuli, and substantial tests, but no demonstrated adoption or CI.
Taran-Douley /
Decoy-Tool
A focused, reproducible Python experiment with a substantial README and writeup, reporting 3,030 trials and statistical analysis, but currently has no visible adoption, tests, CI, or typed implementation.
06 · Timeline
- Mar 27, 2026Joined GitHub
- Aug 4, 2026Created Decoy-Tool — Contains the files used to measure the false positive rate of an agent when given a decoy tool.
- Aug 15, 2026Created ungrounded-agents
- Aug 21, 2026Created ungrounded — Measure how often your LLM agent reaches for the wrong tool when it can't ground an entity in a request.
- Aug 22, 2026Most recent push to ungrounded-agents
07 · Compare
08 · Rubric
How this score was produced
Overall = Σ (category × weight) + gentle top-end curve
Tier thresholds
▸ How the pipeline works
- 01Scrape.Pull every non-fork repo pushed in the last 90 days, plus your contribution calendar, followers, and language byte counts — straight from GitHub's REST & GraphQL APIs.
- 02Triage.A small model reads every repo's file tree + README and picks the 20 files per repo that actually reveal how you code.
- 03Grade each repo. All repos run in parallel through a fast scoring model that reads the picked files and rates each one independently on Impact, Quality, and Depth — with evidence citations.
- 04Aggregate. A larger reasoning model combines the per-repo scores with server-computed stats (heatmap, commit cadence, language entropy, follower count) to produce the 6-dimension profile score + roasts.
- 05Correct.Deterministic server-side checks enforce anchor-scale floors (e.g. a profile with 2,000+ public commits can't score 30 Consistency) and recompute the final verdict.
~90 seconds per profile, ~$0.25 in compute. Total of ~240 files read across your top-12 repos. One rating per GitHub account per day.
▸ Data sources & caveats
- Heatmap & commit totals: GitHub GraphQL
contributionsCollection— covers the last 365 days, includes private repos when the user has opted in (default). - Language %: byte totals across the top 30 owned non-fork repos.
- Curve: a small upward nudge centered on raw score ≈ 70, capping at 100. Prevents specialists from being unfairly penalised for narrow breadth.
- Anchor corrections: when server-measured signals (e.g. privateWorkLikely, multiRepoVolume, follower count) mandate a minimum category score, the aggregation step enforces it. These are signal-conditional, not identity-based floors.