Methods still require major revision. Missing administrative pre-registration conditions do not determine this verdict.
Round 4 dispositions
| Comment | Status | Assessment |
|---|---|---|
| C4-1 | Partly resolved | Separate recorded-harms analysis helps. However, 95% completeness still permits unknown outcomes to become implicit non-events in hazard-ratio analysis. Numerical justification assumes equal losses across arms and does not establish claimed bias bound. |
| C4-2 | Resolved | Explicit 0.5 correction for auxiliary contributions, retention of every primary trial, and qualitative fallback address original zero-cell failure. This pragmatic approximation is acceptable for contributions. Newly introduced cumulative-incidence inputs need corresponding handling, below. |
| C4-3 | Partly resolved | Separating reported cause-specific and subdistribution HRs and requiring competing-event information for absolute conversion are appropriate. Derived cumulative-incidence inputs remain unassigned to their correct hazard scale; “negligible mortality” exemption is undefined. |
| C4-4 | Resolved | IGLARLIXI_SWITCH_<strategy>_SC_TIT_QD is protected by is_template = yes; narrative requires strategy identifier, permitted pens, switching threshold, and titration algorithm before activation. |
Major findings
Persistent censoring problem, with new incorrect bias claim. protocol/protocol.qmd:473, “Event outcomes and harms.”
Independent incomplete observation does not necessarily attenuate effects. Consider true risks 0.010000 and 0.011988, corresponding to HR 1.20 under proportional hazards. Independent loss at baseline of 5% in control and none in treatment produces recorded proportions 0.009500 and 0.011988. Their complementary log-log contrast gives 1.2635. Both arms satisfy revised completeness rule, yet bias exceeds 5% and crosses prespecified 1.25 threshold.
Thus, neither attenuation nor “under 2 percent” bias follows from eligibility rule. Informative missingness is less constrained. Dichotomous analysis of survival outcomes requires known fixed-time status. Cochrane Handbook, section 6.8
Replacement: “Unadjusted counts enter the primary hazard-ratio analysis only when event status is known for every randomized participant at a common within-trial time, subject to the matching hazard-scale assumptions. Otherwise use a censoring-aware estimate or likelihood. Counts with unresolved missing status enter the recorded-harms analysis only. The 95% restriction may define a sensitivity analysis, but does not establish a general bound or direction for bias.”
New cumulative-incidence route does not specify compatible hazard scale. protocol/protocol.qmd:473 and protocol/protocol.qmd:500.
Transforming competing-risk cumulative incidence with
log(-log(1-p))targets cumulative subdistribution hazard. It cannot supply a cause-specific HR. Separation rule currently addresses reported HRs without assigning derived estimates. Listed outcomes also omit harms such as cancer and suicide, for which death from other causes can compete. Austin and FineReplacement: “Record the survival estimator and hazard type for every input, including derived estimates. Contrasts derived from competing-risk cumulative incidence enter only subdistribution-hazard networks, under a stated proportional subdistribution-hazards assumption. They never enter cause-specific networks. Apply this distinction to every outcome with competing events, including harms. Include hazard type in the network key. Remove the undefined negligible-mortality exemption.”
Also specify that curve-based normal inputs require
0 < p < 1and finite uncertainty. Boundary estimates require a suitable survival likelihood or descriptive reporting, not an invented finite transformed value.New recorded-harms absolute effect is not operationally defined. protocol/protocol.qmd:486, “Recorded harms analysis.”
Risk differences “over the median observation period” require risks at that common period. Endpoint counts collected over different periods and observation patterns do not supply those risks. Selecting median duration still selects a horizon; calling it something else does not remove required standardization assumptions. No reference observation process or baseline-risk rule is specified for this analysis.
Replacement: “Report recorded event proportions and within-trial risk differences at each trial’s actual observation period, with that period and follow-up completeness displayed. Do not convert the recorded-harms network contrast into a pooled absolute difference at the median duration. Any standardized recorded-risk analysis requires a separately specified observation model and protocol amendment.”
Minor findings
New cumulative-incidence inputs are omitted from contribution calculation. protocol/protocol.qmd:856, “Confidence in cumulative evidence.”
Revised primary model accepts censoring-aware cumulative incidence, but contribution rule uses reported HRs and “otherwise” raw counts. Those counts can discard censoring information and yield inappropriate precision weights even when calculations remain finite. Qualitative fallback does not automatically catch this mismatch.
Replacement: “When the primary model uses cumulative-incidence estimates, derive auxiliary contrasts and variances from those same transformed estimates and their uncertainty, preserving shared-arm covariance. Do not substitute raw event proportions. Use corrected count-derived contrasts only for trials entering through the count likelihood. If compatible contributions cannot be computed, apply the full-evidence qualitative fallback.”
New relative-only exception leaves certainty rules incomplete. protocol/protocol.qmd:507, protocol/protocol.qmd:812, and protocol/protocol.qmd:878.
When competing-event information is unavailable, relative-only reporting is appropriate. However, affected nonrare outcomes still require absolute thresholds for imprecision and heterogeneity, and potentially incoherence. Blanket requirements for absolute effects and rankings also remain.
Replacement: “When valid absolute conversion is unavailable, report relative estimates and explicitly mark absolute effects and absolute clinical-importance categories unavailable. Assess magnitude-dependent certainty domains qualitatively, documenting why numerical threshold rules cannot be applied; do not assign no concerns merely because conversion is unavailable. Omit rankings requiring unavailable absolute effects. These exceptions override the blanket absolute-effects and ranking requirements.”
New duplicated kidney-composite entry. protocol/protocol.qmd:454, “Composite definitions.”
O22C appears twice in a list described as mutually separate outcomes.
Replacement: “O22 (kidney failure, sustained eGFR decline of at least 50%, or kidney death), O22B (40% decline), O22C (sustained doubling of serum creatinine), O22D (including cardiovascular death), and O22E (including albuminuria or smaller declines without cardiovascular death) are analyzed separately.”
All requested files reviewed. Read-only checks found no window overlaps, missing reference-SD or Turner mappings, or disagreement between agent search terms and concepts version 1.2.0. Search renderer inspected statically; R execution and live search recall were not assessed. No files edited, created, or deleted.
VERDICT: MAJOR REVISION