Promise Ledger

Promise Ledger: BJP vs Congress

Two parties evaluated like two models on the same benchmark. Each claim or promise by a party's Union ministers, Chief Ministers or leaders is a test case; global indices measure the change during each party's era at the centre. Rules: methodology.

BJP (May 2014 → today)
0.513
95% CI [0.41, 0.62] · n=82
83 scored claims
Congress (2000 → May 2014)
0.585
95% CI [0.46, 0.71] · n=92
86 scored claims
Difference (BJP − INC), overall
−0.072
95% CI [-0.25, 0.09]
CI includes 0: no clear difference

False claim rate

Rates are shares of each party's own graded claims, so a party with fewer claims is not penalised. Lower is better for every row.

RateBJPINCBJP − INC (95% CI)Reading
False claims
share of graded statements/statistics rated false
14.6%
6 of 41 [5–27%]
6.1%
3 of 49 [0–12%]
+8.5 pp [-4, 22]no clear difference
False or misleading claims
share of graded statements/statistics rated false or misleading
48.8%
20 of 41 [34–63%]
32.7%
16 of 49 [20–45%]
+16.1 pp [-3, 35]no clear difference
Promises not delivered
share of due, graded promises not delivered on time (unachieved, false, missed deadline, misleading)
58.6%
17 of 29 [41–76%]
62.9%
22 of 35 [46–77%]
−4.2 pp [-29, 21]no clear difference
Promises unachieved or false
share of due, graded promises rated unachieved or false (excludes late delivery)
13.8%
4 of 29 [3–28%]
25.7%
9 of 35 [11–40%]
−11.9 pp [-31, 7]no clear difference

pp = percentage points. "Higher" is stated only when the 95% bootstrap interval of the difference excludes 0. Promises not yet due and unverifiable claims are not counted in any rate.

Verdict mix

BJP (May 2014 → today)
Statements & statistics · 43
true / met 21 (49%)misleading 14 (33%)false 6 (14%)unverifiable 2 (5%)
Promises · 40
true / met 7 (18%)in progress 5 (13%)missed deadline 10 (25%)misleading 3 (8%)unachieved 4 (10%)unverifiable 2 (5%)not yet due 9 (23%)
Congress (2000 → May 2014)
Statements & statistics · 51
true / met 33 (65%)misleading 13 (25%)false 3 (6%)unverifiable 2 (4%)
Promises · 35
true / met 12 (34%)in progress 1 (3%)missed deadline 13 (37%)unachieved 9 (26%)
Weights are normalised to sum to 1. CI: 1000 bootstrap resamples, fixed seed.

Head to head by suite

SuiteBJP (May 2014 → today)Congress (2000 → May 2014)BJP − INC (95% CI)
A: Factual Accuracy0.683CI [0.57, 0.79] · n=41strict 0.512 · abstained 20.806CI [0.72, 0.89] · n=49strict 0.673 · abstained 2−0.123 [-0.26, 0.01] · not significant
B: Promise Delivery0.440CI [0.32, 0.57] · n=29on-time 0.241 · abstained 2 · not yet due 90.450CI [0.32, 0.59] · n=35on-time 0.343 · abstained 0 · not yet due 0−0.010 [-0.20, 0.18] · not significant
C: Index change in era0.417CI [0.17, 0.67] · n=12up 5 / down 7 · mean Δ/yr +0.0020.500CI [0.13, 0.88] · n=8up 4 / down 4 · mean Δ/yr −0.005−0.083 [-0.50, 0.38] · not significant

Scores 0–1, higher is better. Suite C = share of indices that improved during the party's era (INC: 2004 → 2014 edition; BJP: 2014 → latest). Cells with n < 5 show no score. A difference is "significant" here only when its 95% CI excludes 0.

Leaderboard

ModelPartyA: Factual AccuracyB: Promise Delivery
BJP (May 2014 → today)BJP0.683CI [0.57, 0.79] · n=410.440CI [0.32, 0.57] · n=29
↳ BJP · Union ministers & PMBJP0.682CI [0.56, 0.80] · n=330.417CI [0.28, 0.55] · n=24
↳ BJP · Chief MinistersBJPinsufficient datan=4 (min 5) · mean 0.625insufficient datan=4 (min 5) · mean 0.688
↳ BJP · Party leaders (not in govt)BJPinsufficient datan=4 (min 5) · mean 0.750insufficient datan=1 (min 5) · mean 0.000
· Yogi AdityanathBJPinsufficient datan=2 (min 5) · mean 0.250insufficient datan=1 (min 5) · mean 0.250
· Narendra ModiBJP0.615CI [0.46, 0.75] · n=260.433CI [0.28, 0.60] · n=15
· Amit ShahBJP0.800CI [0.60, 1.00] · n=50.417CI [0.17, 0.67] · n=6
· Nirmala SitharamanBJPinsufficient datan=2 (min 5) · mean 1.000insufficient datan=1 (min 5) · mean 0.500
Congress (2000 → May 2014)INC0.806CI [0.72, 0.89] · n=490.450CI [0.32, 0.59] · n=35
↳ INC · Union ministers & PMINC0.850CI [0.75, 0.95] · n=300.438CI [0.28, 0.60] · n=20
↳ INC · Chief MinistersINC0.706CI [0.53, 0.85] · n=170.389CI [0.11, 0.70] · n=9
↳ INC · Party leaders (not in govt)INCinsufficient datan=2 (min 5) · mean 1.0000.583CI [0.25, 0.92] · n=6
· Manmohan SinghINC0.808CI [0.62, 0.96] · n=130.438CI [0.25, 0.72] · n=8
· Sheila DikshitINC0.500CI [0.50, 0.50] · n=5insufficient datan=3 (min 5) · mean 0.167
· Kapil SibalINCinsufficient datan=4 (min 5) · mean 0.750insufficient datan=3 (min 5) · mean 0.167
· Tarun GogoiINCinsufficient datan=4 (min 5) · mean 0.875insufficient datan=0 (min 5)
· SiddaramaiahINCinsufficient datan=3 (min 5) · mean 1.000insufficient datan=1 (min 5) · mean 1.000
· Jairam RameshINCinsufficient datan=4 (min 5) · mean 0.875insufficient datan=2 (min 5) · mean 0.500
· Ashok GehlotINCinsufficient datan=2 (min 5) · mean 0.500insufficient datan=1 (min 5) · mean 1.000
· P. ChidambaramINCinsufficient datan=3 (min 5) · mean 1.0000.500CI [0.15, 0.85] · n=5
· Sonia GandhiINCinsufficient datan=1 (min 5) · mean 1.0000.583CI [0.25, 0.92] · n=6
· Y. S. Rajasekhara ReddyINCinsufficient datan=1 (min 5) · mean 1.000insufficient datan=3 (min 5) · mean 0.333

Rows: each party, then by office (Union ministers, Chief Ministers, party office-bearers), then individual speakers with at least 3 graded claims.

Domain × suite

DomainBJPINC
ABCABC
Economy & Jobs0.667n=9n=3n=20.583n=60.583n=6n=2
Agriculture & Ruraln=40.450n=5n=00.917n=60.650n=5n=0
Welfare, Health & Education0.611n=9n=4n=40.833n=90.393n=7n=2
Infrastructure & Energy1.000n=50.500n=9n=10.667n=90.429n=7n=1
Security & Internal Affairs0.583n=60.417n=6n=00.944n=90.350n=5n=0
Democracy & Governance0.500n=8n=20.200n=50.850n=100.300n=5n=3

Claims are assigned to the domain of their first topic. Shade: scale from 0 to 1 around 0.5; the value is always printed. Greyed: n < 5.

Radar by domain (A and B combined)

Each point is the mean of all graded claims (suites A and B) in that domain. Domains with n < 5 for a party are left out of its polygon.