EvolvingLMMs-Lab/lmms-eval
What happens to a stranger's pull request here, in the Porchlamp snapshot of 17 October 2026.
Outside pull requests to EvolvingLMMs-Lab/lmms-eval got a first human reply in a median of 26.6 hours (131 pull requests, 19 April to 16 October 2026); 9% got none within 14 days. It ranks 1,129 of 3,219 overall. For first-time contributors it ranks 860 of 1,525 (the bottom 44%).
| Rank | 1,129 of 3,219 |
|---|---|
| Score | 54.23 |
| Tier | C |
| Median first reply | 26.6 hours |
| 14-day no-reply share | 9% |
| First-timer rank | 860 of 1,525 |
| Ecosystem | Python |
| Window | 19 April to 16 October 2026 |
Composite
- Rank
- 1,129 of 3,219
- Score
- 54.23
- Tier
- C
- Coverage
- 93% · Ceiling A
- Quadrant
- Nursery
Coordinates: leverage 46.5 (coverage 100%), friction 32.5 (coverage 90%)
Five pillars
| Pillar | Score | Coverage |
|---|---|---|
| Responsiveness | 80.6 | 100% |
| Criticality | 25.6 | 100% |
| Governance | 76.8 | 100% |
| Rigor | 61.2 | 100% |
| Accessibility | 21.0 | 50% |
The measured parameters
Responsiveness
| Parameter | Value | Score | Count | Window | Source |
|---|---|---|---|---|---|
| Decision Rate (90d)Share of outside pull requests that were merged or closed within 90 days. | 90.9% | 100.0 | 55 | 19 April to 18 July 2026 | primaryraw/pr_window/EvolvingLMMs-Lab__lmms-eval.json |
| PR Ghost Rate (14d)Share of outside pull requests with no maintainer response, merge or close within 14 days. | 8.7% | 82.7 | 127 | 20 April to 17 October 2026 | primaryraw/pr_window/EvolvingLMMs-Lab__lmms-eval.json |
| First-timer Merge RateShare of first-time outside authors' decided pull requests that were merged. | 66.7% | 83.3 | 57 | — | primaryraw/author_history/EvolvingLMMs-Lab__lmms-eval.json |
| Time to First ResponseMedian hours from an outside pull request opening to its first substantive human reply. | 26.6 hours (1.1 days) | 71.3 | 131 | 19 April to 16 October 2026 | primaryraw/pr_window/EvolvingLMMs-Lab__lmms-eval.json |
| Time to Merge (p90)Hours within which 90% of merged outside pull requests were merged. | 317.0 hours (13.2 days) | 51.1 | 121 | 19 April to 16 October 2026 | primaryraw/pr_window/EvolvingLMMs-Lab__lmms-eval.json |
Criticality
| Parameter | Value | Score | Count | Window | Source |
|---|---|---|---|---|---|
| DependentsPackages in the registry that depend on this project, counted once each. | 0 | 15.9 | — | — | primaryraw/dependents/EvolvingLMMs-Lab__lmms-eval.json |
| Monthly DownloadsDownloads from the package registry in a month. | 4,408 downloads a month | 22.6 | — | — | primaryraw/downloads/pypi__lmms-eval.json |
| OpenSSF CriticalityOpenSSF criticality score from 0 to 1, computed from the project's public activity signals. | 0.388 | 38.8 | — | — | primaryraw/github_meta/EvolvingLMMs-Lab__lmms-eval.json |
Governance
| Parameter | Value | Score | Count | Window | Source |
|---|---|---|---|---|---|
| Elephant FactorThe fewest organisations that account for half of the last year's commits. | 5 | 100.0 | 401 | — | primaryraw/commits_365d/EvolvingLMMs-Lab__lmms-eval.json |
| Legal IP RegimeThe contributor licence regime: DCO, none, a foundation CLA or a corporate CLA. | No CLA or sign-off found | 85.0 | — | — | primaryraw/governance/EvolvingLMMs-Lab__lmms-eval.json |
| Promotion LadderHow openly a contributor can become a maintainer, from closed to verified. | No written path to becoming a maintainer | 40.0 | — | — | primaryraw/governance/EvolvingLMMs-Lab__lmms-eval.json |
Rigor
| Parameter | Value | Score | Count | Window | Source |
|---|---|---|---|---|---|
| AI Policy PostureWhether the project has a written policy on AI-assisted contributions. | Written AI policy | 95.0 | — | — | primaryraw/governance/EvolvingLMMs-Lab__lmms-eval.json |
| Pipeline DefensesHow well the project's build and review pipeline defends against bad changes, 0 to 100. | 72.7273 | 72.7 | 165 | — | proxy:review_ciraw/pr_window/EvolvingLMMs-Lab__lmms-eval.json |
| Substantive Review RateShare of decided pull requests that received a substantive review. | 9.7% | 12.2 | 154 | 19 April to 16 October 2026 | primaryraw/pr_window/EvolvingLMMs-Lab__lmms-eval.json |
Accessibility
| Parameter | Value | Score | Count | Window | Source |
|---|---|---|---|---|---|
| Developer ExperienceDeveloper experience, 0 to 100: half CI run time, half setup signals. | 70 | 70.0 | 26 | — | primaryraw/actions_runs/EvolvingLMMs-Lab__lmms-eval.json |
| Newcomer ConversionShare of first-time authors whose first pull request merged within 180 days. | Not shown: Collector failure | ||||
| Newcomer Issue SupplyOpen, unassigned, up-to-date issues marked for newcomers. | 0 | 0.0 | — | — | primaryraw/gfi/EvolvingLMMs-Lab__lmms-eval.json |
| Newcomer Return RateShare of those merged first-time authors who sent a second pull request within 90 days. | Not shown: Collector failure | ||||
Persona view
| Persona | Rank | Score | Tier | Status |
|---|---|---|---|---|
| Balanced | 1,129 of 3,219 | 54.23 | C | Rated |
| First-timer | 860 of 1,525 | 54.70 | C | Rated |
| Career capital | This repository's production-criticality signal is not yet high enough for career-capital ranking. | |||
| Senior systems | 673 of 1,276 | 53.54 | C | Rated |
| AI-assisted | 1,020 of 3,696 | 56.29 | B | Rated |
Integrity
- Snapshot
- 2026-10-17
- Raw hash
- 2c6e5e6c9f24b4c31e35bedba273bebef1fa3869300ccac226111e7297d5b079
No suspicion flags on this repository.
The full record is in data/2026-10-17/repos/fd.json, under the key EvolvingLMMs-Lab/lmms-eval.
How every number is measured: Porchlamp methodology.
Open an issue about this record and say what looks wrong.
Porchlamp (2026). EvolvingLMMs-Lab/lmms-eval. Snapshot 2026-10-17. https://porchlamp.org/projects/evolvinglmms-lab/lmms-eval/. CC BY 4.0.
Similar projects
The ranked projects nearest this one in the same ecosystem.
- kaifcodec/user-scanner (rank 1,119)
- OpenByteInc/QuantDinger (rank 1,122)
- googleapis/google-api-python-client (rank 1,123)
- jupyter/docker-stacks (rank 1,130)
- Zipstack/unstract (rank 1,141)