{ "schema_version": "1", "record": { "artifact": "rust-doctor-score-credibility-corpus", "schema_version": 7, "generated_at": "2026-08-22", "sha256": "bdc2329270dacf8435e6ecd1e49755c108d42cc1130ebd5e3fb16c9a1c48afe9", "source": "https://github.com/arthjean/rust-doctor/blob/main/tests/corpus.json", "toolchain": { "cargo": "cargo 1.97.1 (c980f4866 2026-06-30)", "clippy": "clippy 0.1.97 (8bab26f4f6 2026-07-14)", "rustc": "rustc 1.97.1 (8bab26f4f 2026-07-14)" }, "position_proof": { "digest": "2b3c827d5f910e969d4e686ac3553f2fb20d0a6b6779a0beee4c76c4bb5e322e", "sites": 671, "date": "2026-08-22", "toolchain": "rustc 1.97.1 (8bab26f4f 2026-07-14)" } }, "threshold_basis_points": 500, "gate_verdict": "passed", "catalogued_rules": 62, "unobserved_rules": 36, "reviewed_sites": 452, "smoothing": { "prior_false_positives": 1, "prior_sites": 2 }, "criterion": "A finding is a true positive when the flagged site should actually be changed, judged at the pinned revision under the published scope of the rule; it is a false positive when the flagged construct is correct as written, when its safety is established by the surrounding code, or when the context makes the flagged behaviour the intended one. Confirming that the rule's pattern is present is a separate, mechanical check: it proves the span is not corrupted, never that the site is a defect. For structural findings the value question is stated separately. A duplication family is a true positive when its members repeat a nontrivial shared scaffold that one definition, parameter or macro could serve without changing behavior; it is a false positive when the shared body is a short delegation whose entire difference lives in the erased names, when the members mirror each other by design, as benchmark or test comparison pairs and replays under a different harness do, or when separate trait impls the language forces apart leave nothing to factor. A complexity or size hotspot is a true positive when decomposition is feasible and would plausibly be accepted, a false positive when the measured branch count or length is the clearest available form or is forced by a trait contract. An unreasoned allow or an unreferenced feature is a false positive when the surrounding code or manifest already documents the intent the detector could not read.", "sampling": "Deterministic sample of up to 5 sites per rule. The population of a rule is the set of its corpus findings ordered canonically by (repository, path, line); sites sharing that identity are collapsed once. From a population of n such sites the sample takes k = min(5, n) of them, at the indices floor(i * n / k) for i in [0, k), a regular stride from the first site, so the sample follows the same distribution as the findings a user actually receives. Every sampled site was read in the pinned source with its surrounding code. The published rate is the rate of that sample, never of the unreviewed population; at k = 5 the sample resolves steps of 20 points, so it separates a rule with no observed false positive from one that has some, and cannot place a rule precisely against the 5 % threshold. Structural rules sample their production-context subpopulation, with the same stride: a family marked as a test, benchmark, example or build-script context does not weigh on the score, so the rate that decides what a structural rule costs is the rate of the families that do. rust_doctor::structure::duplicate_function_body samples k = min(20, n) of that subpopulation, because its published target is a rate at or under 5 percent and a five-site sample cannot resolve that threshold; the other structural rules sample five. The unit of a structural sample is the family or unit the diagnostic reports, read at its anchor together with its related sites. The all-context measurement of 2026-08-09, which this replaced, is recorded in docs/structural-precision-2026-08.md with its composition. Three rules were deepened on 2026-08-11, past the five-site default, because five sites resolve steps of twenty points and cannot place a rule against the threshold. clippy::indexing_slicing takes k = 40 of its 241 sites by the same stride, which contains the k = 5 stride it replaces. clippy::string_slice reviews its whole population of 40, so its rate is exact rather than sampled. rust_doctor::structure::complex_function reviews 31 of the 34 production families it observes. Every added site was judged twice by independent passes blind to each other, and the three sites where the passes disagreed are excluded from the sample and left to a human verdict rather than settled by the agent that produced them, which is why complex_function reviews 31 and not 34. The agreement of those passes is published per rule and population in adjudication.agreement.coefficients, which the suite recomputes from the pairs on record: no count and no coefficient is stated here, because a number written in prose is a number no test compares. The four structural rules of the agent population are drawn by that same stride over their production-context subpopulation, at the target their plan publishes, bounded by what the population can supply, with the population, the target and the positions the stride landed on recorded in adjudication.sampling_plan and the draw enrolled in adjudication.adjudicated_after_cutoff. That subpopulation is the findings the scan publishes with no context, and it excludes a finding under a tests, benches or examples directory or in a file named tests.rs even where the scan attributes no context to it: the correction of August 2026 to how a module declared out of line under a cfg(test) attribute is classified shrank all four populations, and one predicate now decides both what a rule is measured over and what the record may publish as a production site. A population that changes size does not keep its sample, since the stride recomputes every position from n, so each of the four plans names the positions of the sites an earlier plan drew that survived the correction, in adjudication.sampling_plan.carried_over. The carry-over extends the sample and never edits the draw: a carried position is a position of the corrected population that the new stride did not select, and the verdicts behind it are the verdicts already on record rather than a re-reading of the same site. The two healthy structural scopes that the agent population also measures are drawn by that same stride over their production-context subpopulation, and drawn to the whole of it: rust_doctor::structure::oversized_unit publishes a target of 46 over a population of 46 and rust_doctor::structure::near_duplicate_function_body a target of 30 over 30, so the stride selects every site and the target of the protocol is read as a floor rather than as a quota, which is what lets a scope the reviewer can exhaust ask for all of it. Neither draw carries anything over, since a draw that takes the whole population has nothing left to carry. Neither can be deepened either. The healthy near_duplicate_function_body scope holds 30 production families across the ten pinned repositories, under the 40 sites per arm that the difference interval of rate_comparison names as its nominal coverage floor, and it publishes that fact on the row rather than withholding the comparison. No sampling decision can move it: the limit is the corpus, not the draw, and deepening the scope means pinning more repositories rather than reviewing more of these.", "provenance_note": "Who produced each verdict. \"human\" names a site a person read and judged. \"agent\" names a site adjudicated by an agent under the published protocol: the site read in the pinned source with its surrounding code, blind to any prior verdict, with a disagreement between independent passes escalated rather than settled by the agent. \"unrecorded\" names the sites judged before this field existed, whose author is not established; they are published as they were measured rather than reattributed after the fact. A rate mixing provenances is worth its weakest one, and no verdict, whoever produced it, is certified beyond the agreement two trained reviewers reach with each other.", "protocol_cutoff": "2026-08-21", "trigger_verification": { "findings": 575, "confirmed": 575, "method": "Mechanical: the rule's trigger is searched inside the reported span at the pinned revision. This is a guard against corrupted spans only. It cannot measure precision, because the lint that looks for a pattern always finds that pattern." }, "agreement": { "pairs": 219, "escalations_open": 12, "coefficients": [ { "rule": "rust_doctor::structure::complex_function", "population": "healthy", "pairs": 3, "agreed": 0, "kappa_basis_points": null, "kappa_status": "undefined_no_variance", "ac1_basis_points": -10000 }, { "rule": "rust_doctor::structure::duplicate_function_body", "population": "agent", "pairs": 48, "agreed": 46, "kappa_basis_points": 8889, "kappa_status": "defined", "ac1_basis_points": 9333 }, { "rule": "rust_doctor::structure::near_duplicate_function_body", "population": "agent", "pairs": 43, "agreed": 43, "kappa_basis_points": 10000, "kappa_status": "defined", "ac1_basis_points": 10000 }, { "rule": "rust_doctor::structure::near_duplicate_function_body", "population": "healthy", "pairs": 30, "agreed": 30, "kappa_basis_points": 10000, "kappa_status": "defined", "ac1_basis_points": 10000 }, { "rule": "rust_doctor::structure::orphan_module_file", "population": "agent", "pairs": 12, "agreed": 12, "kappa_basis_points": 10000, "kappa_status": "defined", "ac1_basis_points": 10000 }, { "rule": "rust_doctor::structure::oversized_unit", "population": "agent", "pairs": 37, "agreed": 37, "kappa_basis_points": 10000, "kappa_status": "defined", "ac1_basis_points": 10000 }, { "rule": "rust_doctor::structure::oversized_unit", "population": "healthy", "pairs": 46, "agreed": 39, "kappa_basis_points": 6734, "kappa_status": "defined", "ac1_basis_points": 7182 } ] }, "rate_comparison": [ { "rule": "rust_doctor::structure::complex_function", "healthy_basis_points": 8709, "agent_basis_points": 7000, "gap_basis_points": -1709, "difference_low_basis_points": -3437, "difference_high_basis_points": 282, "difference_method": "newcombe_hybrid_score_95", "below_nominal_coverage": true, "verdict": "indistinguishable" }, { "rule": "rust_doctor::structure::duplicate_function_body", "healthy_basis_points": 4000, "agent_basis_points": 2391, "gap_basis_points": -1609, "difference_low_basis_points": -3966, "difference_high_basis_points": 683, "difference_method": "newcombe_hybrid_score_95", "below_nominal_coverage": true, "verdict": "indistinguishable" }, { "rule": "rust_doctor::structure::near_duplicate_function_body", "healthy_basis_points": 6333, "agent_basis_points": 4418, "gap_basis_points": -1915, "difference_low_basis_points": -3935, "difference_high_basis_points": 396, "difference_method": "newcombe_hybrid_score_95", "below_nominal_coverage": true, "verdict": "indistinguishable" }, { "rule": "rust_doctor::structure::oversized_unit", "healthy_basis_points": 3333, "agent_basis_points": 1351, "gap_basis_points": -1982, "difference_low_basis_points": -3725, "difference_high_basis_points": -57, "difference_method": "newcombe_hybrid_score_95", "below_nominal_coverage": true, "verdict": "separated" } ], "structural_density": { "agent": { "findings": 5296, "lines": 988872, "per_thousand_lines_milli": 5355 }, "healthy": { "findings": 433, "lines": 122044, "per_thousand_lines_milli": 3547 }, "ratio_milli": 1509, "refutes_density_assumption": false }, "score_separation_centi": 850, "populations": [ { "key": "healthy", "repositories": [ { "name": "anyhow", "url": "https://github.com/dtolnay/anyhow.git", "commit": "1dbe1862aae650423e3361fbd20b7d17c5109cc3", "rationale": "Narrowly scoped error-handling library from the dtolnay organization, carried by a build script and a large trait-heavy test suite: it exercises the panic pack outside any binary entry point.", "tag": "1.0.104" }, { "name": "async-channel", "url": "https://github.com/smol-rs/async-channel.git", "commit": "35a63c456aaa1906015f5a825e7e35505a749afa", "rationale": "Asynchronous channel primitive from the smol-rs organization, built on futures-core: it is the smallest corpus entry able to reach the await-holding rules of the correctness dimension.", "tag": "v2.5.0" }, { "name": "bytes", "url": "https://github.com/tokio-rs/bytes.git", "commit": "76c0fbb54ed4336caf9d2311658a2f4a5627c21d", "rationale": "Buffer library from the tokio-rs organization, unsafe-heavy and indexing-heavy: it stresses the reliability pack on code whose slicing is deliberate rather than accidental.", "tag": "v1.12.1" }, { "name": "fd", "url": "https://github.com/sharkdp/fd.git", "commit": "7027d45303b412be6fa9c09d689cc6276748fb38", "rationale": "Command-line binary from the sharkdp organization with a wide dependency graph: it is the corpus entry able to observe the dependency dimension on a real resolved graph.", "tag": "v10.4.2" }, { "name": "hexyl", "url": "https://github.com/sharkdp/hexyl.git", "commit": "abc20a380c8c2d9d76c1976222725d3211cef809", "rationale": "Small binary carrying its own library from the sharkdp organization: it exercises the terminal-output rules on a program whose printing is its purpose.", "tag": "v0.16.0" }, { "name": "log", "url": "https://github.com/rust-lang/log.git", "commit": "f405739f3a15a3f00680c793e1e1fa7e57d26ba4", "rationale": "Logging facade maintained by the rust-lang organization, dependency-free and macro-heavy: it is the lowest-noise reference of the corpus and its findings are the hardest to dismiss as incidental.", "tag": "0.4.33" }, { "name": "ripgrep", "url": "https://github.com/BurntSushi/ripgrep.git", "commit": "e89fff89ac9af12e8d4ce9d5fd07beb408ca730f", "rationale": "Ten-member workspace from the BurntSushi organization mixing a binary and eight libraries: it is the corpus entry that proves the scan holds across a real multi-member workspace, and its nightly benches make it the entry whose scan legitimately stays incomplete.", "tag": "15.2.0" }, { "name": "serde_json", "url": "https://github.com/serde-rs/json.git", "commit": "efa66e3a1d61459ab2d325f92ebe3acbd6ca18b1", "rationale": "Serialization library from the serde-rs organization whose test suite is larger than its source: it is the corpus entry that measures how the panic pack behaves on deliberate test-target panics.", "tag": "v1.0.145" }, { "name": "smol", "url": "https://github.com/smol-rs/smol.git", "commit": "a1e642196803fc5dff56f1e04e867bfc024966bd", "rationale": "Asynchronous runtime from the smol-rs organization composing eight async crates: it is the corpus entry whose execution model is asynchronous from end to end.", "tag": "v2.0.2" }, { "name": "thiserror", "url": "https://github.com/dtolnay/thiserror.git", "commit": "e13a7854338e446f184725fc8b9c9e86a0a537d2", "rationale": "Three-member workspace from the dtolnay organization carrying a procedural macro crate: it is the corpus entry that proves generated code does not leak spurious findings into the catalog.", "tag": "2.0.19" } ], "observations": [ { "name": "anyhow", "commit": "1dbe1862aae650423e3361fbd20b7d17c5109cc3", "production_lines": 4113, "occurrences": 69, "distinct": 50, "score": 87, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 972526 }, { "name": "maintainability", "score": 52, "density_micro": 1945052 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "async-channel", "commit": "35a63c456aaa1906015f5a825e7e35505a749afa", "production_lines": 1388, "occurrences": 30, "distinct": 13, "score": 95, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 95, "density_micro": 500000 }, { "name": "maintainability", "score": 72, "density_micro": 1000000 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "bytes", "commit": "76c0fbb54ed4336caf9d2311658a2f4a5627c21d", "production_lines": 9881, "occurrences": 152, "distinct": 94, "score": 84, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 66, "density_micro": 4149378 }, { "name": "maintainability", "score": 49, "density_micro": 2125291 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "fd", "commit": "7027d45303b412be6fa9c09d689cc6276748fb38", "production_lines": 4676, "occurrences": 75, "distinct": 59, "score": 75, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 41, "density_micro": 8912746 }, { "name": "maintainability", "score": 53, "density_micro": 1924722 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 72, "density_micro": 1000000 } ] }, { "name": "hexyl", "commit": "abc20a380c8c2d9d76c1976222725d3211cef809", "production_lines": 1854, "occurrences": 34, "distinct": 29, "score": 74, "label": "Needs work", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 39, "density_micro": 9500000 }, { "name": "maintainability", "score": 37, "density_micro": 3000000 }, { "name": "performance", "score": 88, "density_micro": 500000 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "log", "commit": "f405739f3a15a3f00680c793e1e1fa7e57d26ba4", "production_lines": 5745, "occurrences": 49, "distinct": 32, "score": 90, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 1914708 }, { "name": "maintainability", "score": 71, "density_micro": 1044386 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "ripgrep", "commit": "e89fff89ac9af12e8d4ce9d5fd07beb408ca730f", "production_lines": 45490, "occurrences": 812, "distinct": 499, "score": 80, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 45, "density_micro": 8078479 }, { "name": "maintainability", "score": 57, "density_micro": 1692680 }, { "name": "performance", "score": 96, "density_micro": 153880 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "serde_json", "commit": "efa66e3a1d61459ab2d325f92ebe3acbd6ca18b1", "production_lines": 18301, "occurrences": 175, "distinct": 122, "score": 86, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 2568166 }, { "name": "maintainability", "score": 45, "density_micro": 2404240 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "smol", "commit": "a1e642196803fc5dff56f1e04e867bfc024966bd", "production_lines": 129, "occurrences": 4, "distinct": 2, "score": 99, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 95, "density_micro": 500000 }, { "name": "maintainability", "score": 100, "density_micro": 0 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "thiserror", "commit": "e13a7854338e446f184725fc8b9c9e86a0a537d2", "production_lines": 3096, "occurrences": 113, "distinct": 76, "score": 73, "label": "Needs work", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 36, "density_micro": 10335917 }, { "name": "maintainability", "score": 20, "density_micro": 4844961 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] } ], "distribution": { "minimum": 73, "maximum": 99, "spread": 26, "median_centi": 8500, "bands": [ { "label": "Great", "repositories": 8 }, { "label": "Needs work", "repositories": 2 } ] }, "precision": [ { "id": "clippy::exit", "tier": "P2", "status": "measured", "findings": 10, "reviewed": 5, "doubly_judged": 0, "false_positives": 5, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 5655, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::expect_used", "tier": "P3", "status": "measured", "findings": 23, "reviewed": 5, "doubly_judged": 0, "false_positives": 4, "true_positives": 1, "false_positive_rate_basis_points": 8000, "interval_low_basis_points": 3755, "interval_high_basis_points": 9638, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::indexing_slicing", "tier": "P3", "status": "measured", "findings": 246, "reviewed": 40, "doubly_judged": 0, "false_positives": 40, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 9124, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "agent", "unrecorded" ] }, { "id": "clippy::mem_forget", "tier": "P2", "status": "measured", "findings": 1, "reviewed": 1, "doubly_judged": 0, "false_positives": 1, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 2065, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::missing_safety_doc", "tier": "P3", "status": "measured", "findings": 2, "reviewed": 2, "doubly_judged": 0, "false_positives": 0, "true_positives": 2, "false_positive_rate_basis_points": 0, "interval_low_basis_points": 0, "interval_high_basis_points": 6576, "separation": "indecisive", "provenance": [ "unrecorded" ] }, { "id": "clippy::panic", "tier": "P3", "status": "measured", "findings": 11, "reviewed": 5, "doubly_judged": 0, "false_positives": 5, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 5655, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::panic_in_result_fn", "tier": "P2", "status": "measured", "findings": 46, "reviewed": 5, "doubly_judged": 0, "false_positives": 5, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 5655, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::print_stderr", "tier": "P3", "status": "measured", "findings": 9, "reviewed": 5, "doubly_judged": 0, "false_positives": 5, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 5655, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::ptr_arg", "tier": "P3", "status": "measured", "findings": 1, "reviewed": 1, "doubly_judged": 0, "false_positives": 0, "true_positives": 1, "false_positive_rate_basis_points": 0, "interval_low_basis_points": 0, "interval_high_basis_points": 7935, "separation": "indecisive", "provenance": [ "unrecorded" ] }, { "id": "clippy::rc_buffer", "tier": "P3", "status": "measured", "findings": 6, "reviewed": 5, "doubly_judged": 0, "false_positives": 0, "true_positives": 5, "false_positive_rate_basis_points": 0, "interval_low_basis_points": 0, "interval_high_basis_points": 4345, "separation": "indecisive", "provenance": [ "unrecorded" ] }, { "id": "clippy::stable_sort_primitive", "tier": "P3", "status": "measured", "findings": 1, "reviewed": 1, "doubly_judged": 0, "false_positives": 0, "true_positives": 1, "false_positive_rate_basis_points": 0, "interval_low_basis_points": 0, "interval_high_basis_points": 7935, "separation": "indecisive", "provenance": [ "unrecorded" ] }, { "id": "clippy::string_slice", "tier": "P3", "status": "measured", "findings": 40, "reviewed": 40, "doubly_judged": 0, "false_positives": 40, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 9124, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "agent", "unrecorded" ] }, { "id": "clippy::too_many_arguments", "tier": "P3", "status": "measured", "findings": 1, "reviewed": 1, "doubly_judged": 0, "false_positives": 1, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 2065, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::type_complexity", "tier": "P3", "status": "incomplete", "findings": 2, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "clippy::unreachable", "tier": "P2", "status": "measured", "findings": 23, "reviewed": 5, "doubly_judged": 0, "false_positives": 4, "true_positives": 1, "false_positive_rate_basis_points": 8000, "interval_low_basis_points": 3755, "interval_high_basis_points": 9638, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "clippy::unwrap_used", "tier": "P3", "status": "measured", "findings": 117, "reviewed": 5, "doubly_judged": 0, "false_positives": 5, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 5655, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "rust_doctor::cargo::duplicate_major_versions", "tier": "P2", "status": "measured", "findings": 1, "reviewed": 1, "doubly_judged": 0, "false_positives": 0, "true_positives": 1, "false_positive_rate_basis_points": 0, "interval_low_basis_points": 0, "interval_high_basis_points": 7935, "separation": "indecisive", "provenance": [ "unrecorded" ] }, { "id": "rust_doctor::cargo::unchecked_release_overflow", "tier": "P3", "status": "measured", "findings": 3, "reviewed": 3, "doubly_judged": 0, "false_positives": 1, "true_positives": 2, "false_positive_rate_basis_points": 3333, "interval_low_basis_points": 615, "interval_high_basis_points": 7923, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "rust_doctor::structure::complex_function", "tier": "P3", "status": "measured", "findings": 34, "reviewed": 31, "doubly_judged": 0, "false_positives": 27, "true_positives": 4, "false_positive_rate_basis_points": 8709, "interval_low_basis_points": 7115, "interval_high_basis_points": 9487, "separation": "above", "provenance": [ "agent", "unrecorded" ] }, { "id": "rust_doctor::structure::crate_level_allow", "tier": "P2", "status": "incomplete", "findings": 33, "reviewed": 4, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::structure::duplicate_function_body", "tier": "P3", "status": "measured", "findings": 134, "reviewed": 20, "doubly_judged": 0, "false_positives": 8, "true_positives": 12, "false_positive_rate_basis_points": 4000, "interval_low_basis_points": 2188, "interval_high_basis_points": 6134, "separation": "above", "provenance": [ "unrecorded" ] }, { "id": "rust_doctor::structure::near_duplicate_function_body", "tier": "P3", "status": "measured", "findings": 98, "reviewed": 30, "doubly_judged": 30, "false_positives": 19, "true_positives": 11, "false_positive_rate_basis_points": 6333, "interval_low_basis_points": 4551, "interval_high_basis_points": 7813, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::oversized_unit", "tier": "P3", "status": "measured", "findings": 58, "reviewed": 39, "doubly_judged": 39, "false_positives": 13, "true_positives": 26, "false_positive_rate_basis_points": 3333, "interval_low_basis_points": 2063, "interval_high_basis_points": 4902, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::stacked_allow_attribute", "tier": "P3", "status": "incomplete", "findings": 1, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::structure::unreasoned_allow_attribute", "tier": "P3", "status": "incomplete", "findings": 68, "reviewed": 4, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::structure::unreferenced_feature", "tier": "P3", "status": "measured", "findings": 7, "reviewed": 5, "doubly_judged": 0, "false_positives": 5, "true_positives": 0, "false_positive_rate_basis_points": 10000, "interval_low_basis_points": 5655, "interval_high_basis_points": 10000, "separation": "above", "provenance": [ "unrecorded" ] } ], "clippy_rules_disabled": 0, "selection_criterion": null }, { "key": "agent", "repositories": [ { "name": "claudes-c-compiler", "url": "https://github.com/anthropics/claudes-c-compiler.git", "commit": "6f1b99acb2f4ec2414592136c2009fe7713deec3", "rationale": "Anthropic's demonstration C compiler, authored by Claude Opus 4.6 with the trailer on 64 percent of 3982 commits.", "tag": null }, { "name": "ostendo", "url": "https://github.com/ZoneMix/ostendo.git", "commit": "0284e33b45a69921fac85fcb95c7a1bf8759f936", "rationale": "A display-control tool whose README and commit trailers document Claude Code authorship.", "tag": null }, { "name": "artifexprocal", "url": "https://github.com/danielwlee312/artifexprocal.git", "commit": "2be33f74d64a536ceca06deaacae11d71309474f", "rationale": "A generative-art project with 72 percent of its commits carrying the Claude trailer.", "tag": null }, { "name": "mdr", "url": "https://github.com/CleverCloud/mdr.git", "commit": "26e92506e9e6113f233b65ff1ea1894d9efb11ea", "rationale": "A CleverCloud terminal markdown renderer built with Claude, model names in the trailers.", "tag": null }, { "name": "ralph-os", "url": "https://github.com/schani/ralph-os.git", "commit": "cd6dac93028460d761e3c5e67aaadc23c4a24af2", "rationale": "An operating-system experiment driven by an autonomous agent loop, attribution in every generated commit.", "tag": null }, { "name": "vibesql", "url": "https://github.com/rjwalters/vibesql.git", "commit": "4d9b33d9ab5a379425db3807d7e66c000b3a4bc6", "rationale": "A SQL engine grown to 700k lines by an agent, the largest agent-authored Rust tree found.", "tag": null }, { "name": "syncvibe", "url": "https://github.com/Curious1008/syncvibe.git", "commit": "ff10443c652324c38d8af390e7af29d8e6560c14", "rationale": "A sync tool with 74 percent of its commits carrying the Claude trailer.", "tag": null }, { "name": "coda", "url": "https://github.com/adamtwiss/coda.git", "commit": "cf32fbe5f2adee8e3d36312bbdc41f8c6c3209e8", "rationale": "A long-running agent-built project, 2528 commits of which 1295 carry the Claude trailer.", "tag": null } ], "observations": [ { "name": "claudes-c-compiler", "commit": "6f1b99acb2f4ec2414592136c2009fe7713deec3", "production_lines": 186696, "occurrences": 1741, "distinct": 1201, "score": 77, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 1005356 }, { "name": "maintainability", "score": 14, "density_micro": 6004414 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 72, "density_micro": 1000000 } ] }, { "name": "ostendo", "commit": "0284e33b45a69921fac85fcb95c7a1bf8759f936", "production_lines": 16184, "occurrences": 149, "distinct": 88, "score": 76, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 90, "density_micro": 1000000 }, { "name": "maintainability", "score": 34, "density_micro": 3274839 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 26, "density_micro": 4000000 } ] }, { "name": "artifexprocal", "commit": "2be33f74d64a536ceca06deaacae11d71309474f", "production_lines": 10664, "occurrences": 156, "distinct": 75, "score": 74, "label": "Needs work", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 90, "density_micro": 1000000 }, { "name": "maintainability", "score": 44, "density_micro": 2438110 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 5, "density_micro": 9000000 } ] }, { "name": "mdr", "commit": "26e92506e9e6113f233b65ff1ea1894d9efb11ea", "production_lines": 5031, "occurrences": 62, "distinct": 36, "score": 83, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 90, "density_micro": 1000000 }, { "name": "maintainability", "score": 30, "density_micro": 3577818 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 72, "density_micro": 1000000 } ] }, { "name": "ralph-os", "commit": "cd6dac93028460d761e3c5e67aaadc23c4a24af2", "production_lines": 11653, "occurrences": 49, "distinct": 38, "score": 85, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 1171630 }, { "name": "maintainability", "score": 37, "density_micro": 3003518 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] }, { "name": "vibesql", "commit": "4d9b33d9ab5a379425db3807d7e66c000b3a4bc6", "production_lines": 413822, "occurrences": 9984, "distinct": 3650, "score": 68, "label": "Needs work", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 1060412 }, { "name": "maintainability", "score": 32, "density_micro": 3409679 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 0, "density_micro": 19000000 } ] }, { "name": "syncvibe", "commit": "ff10443c652324c38d8af390e7af29d8e6560c14", "production_lines": 13170, "occurrences": 103, "distinct": 57, "score": 74, "label": "Needs work", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 1075930 }, { "name": "maintainability", "score": 47, "density_micro": 2277904 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 19, "density_micro": 5000000 } ] }, { "name": "coda", "commit": "cf32fbe5f2adee8e3d36312bbdc41f8c6c3209e8", "production_lines": 40599, "occurrences": 271, "distinct": 198, "score": 84, "label": "Great", "model": "core-v3", "dimensions": [ { "name": "security", "score": 100, "density_micro": 0 }, { "name": "reliability", "score": 75, "density_micro": 1295574 }, { "name": "maintainability", "score": 33, "density_micro": 3349836 }, { "name": "performance", "score": 100, "density_micro": 0 }, { "name": "dependencies", "score": 100, "density_micro": 0 } ] } ], "distribution": { "minimum": 68, "maximum": 85, "spread": 17, "median_centi": 7650, "bands": [ { "label": "Great", "repositories": 5 }, { "label": "Needs work", "repositories": 3 } ] }, "precision": [ { "id": "rust_doctor::cargo::duplicate_major_versions", "tier": "P2", "status": "incomplete", "findings": 28, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::cargo::missing_lockfile", "tier": "P2", "status": "measured", "findings": 3, "reviewed": 3, "doubly_judged": 0, "false_positives": 0, "true_positives": 3, "false_positive_rate_basis_points": 0, "interval_low_basis_points": 0, "interval_high_basis_points": 5615, "separation": "indecisive", "provenance": [ "agent" ] }, { "id": "rust_doctor::cargo::test_only_dependency", "tier": "P2", "status": "incomplete", "findings": 3, "reviewed": 2, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::cargo::unchecked_release_overflow", "tier": "P3", "status": "incomplete", "findings": 8, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::cargo::unused_dependency", "tier": "P2", "status": "incomplete", "findings": 5, "reviewed": 4, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::structure::complex_function", "tier": "P3", "status": "measured", "findings": 1609, "reviewed": 40, "doubly_judged": 0, "false_positives": 28, "true_positives": 12, "false_positive_rate_basis_points": 7000, "interval_low_basis_points": 5457, "interval_high_basis_points": 8193, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::crate_level_allow", "tier": "P2", "status": "incomplete", "findings": 43, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::structure::duplicate_function_body", "tier": "P3", "status": "measured", "findings": 1476, "reviewed": 46, "doubly_judged": 46, "false_positives": 11, "true_positives": 35, "false_positive_rate_basis_points": 2391, "interval_low_basis_points": 1391, "interval_high_basis_points": 3794, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::near_duplicate_function_body", "tier": "P3", "status": "measured", "findings": 1120, "reviewed": 43, "doubly_judged": 43, "false_positives": 19, "true_positives": 24, "false_positive_rate_basis_points": 4418, "interval_low_basis_points": 3043, "interval_high_basis_points": 5889, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::orphan_module_file", "tier": "P3", "status": "measured", "findings": 16, "reviewed": 12, "doubly_judged": 12, "false_positives": 1, "true_positives": 11, "false_positive_rate_basis_points": 833, "interval_low_basis_points": 149, "interval_high_basis_points": 3539, "separation": "indecisive", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::oversized_unit", "tier": "P3", "status": "measured", "findings": 948, "reviewed": 37, "doubly_judged": 37, "false_positives": 5, "true_positives": 32, "false_positive_rate_basis_points": 1351, "interval_low_basis_points": 591, "interval_high_basis_points": 2798, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::stacked_allow_attribute", "tier": "P3", "status": "measured", "findings": 2, "reviewed": 2, "doubly_judged": 0, "false_positives": 1, "true_positives": 1, "false_positive_rate_basis_points": 5000, "interval_low_basis_points": 945, "interval_high_basis_points": 9055, "separation": "above", "provenance": [ "agent" ] }, { "id": "rust_doctor::structure::unreasoned_allow_attribute", "tier": "P3", "status": "incomplete", "findings": 80, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] }, { "id": "rust_doctor::structure::unreferenced_feature", "tier": "P3", "status": "incomplete", "findings": 2, "reviewed": 0, "doubly_judged": 0, "false_positives": null, "true_positives": null, "false_positive_rate_basis_points": null, "interval_low_basis_points": null, "interval_high_basis_points": null, "separation": null, "provenance": [] } ], "clippy_rules_disabled": 37, "selection_criterion": "A repository qualifies when at least half of the commit messages reachable from its pinned revision contain its recorded marker, an exact substring such as 'Co-Authored-By: Claude' or 'Generated with [Claude Code]' that coding agents append to the commits they author. The criterion reads the git history alone, never code style, README claims or popularity, and marked_commits and total_commits are recounted mechanically from git log at the pinned revision when the corpus is replayed. The population is scanned with every Clippy rule off, because its build scripts and proc-macros are untrusted: the native detectors parse source text and compile nothing." } ] }