On this page
Dates
Recorded
Record idRS-20260903T013022Z-b0937bf9

No explanation has been written for this record yet.

Technical recordMetrics, gate checks and limitationsRS-20260903T013022Z-b0937bf9
valid runoutcome: failnot-supported-as-testedtier: pilotRS-20260903T013022Z-b0937bf9

Stage 1: on the EX-4 panel's fit games (2,913 roots with depth-4 root value above -50,000; 425 dropped), ridge regression of the depth-4 root value on the eighteen fair-leaf terms plus intercept (lambda 0.001 by game-grouped CV, the grid edge) reaches held-out R^2 0.852 on 1,877 held-out roots, against 0.729 for an affine rescaling of the frozen leaf (gain +0.123; P-L1 passes) and 0.852 with the best-immediate-six-feature-drop term added (gain -0.0001; P-L3 fails as predicted: the six drop features carry no leaf-relevant information the fair terms lack). The refit reweights the terms wildly relative to the frozen constants (open columns -4,232 against +180, solid exposure +3,273 against +40, intercept +45,744), which correlated terms permit. Stage 2, the disclosed biased proxy: full-width d4s7 with the refit leaf agrees with exact frozen-leaf d5s7 on 68.0% of the 128 sub-panel roots against 79.7% for the frozen leaf and loses 9,350 points per decision under those values against 146 (paired change -9,204, bound -21,308); it changes 28 of 128 decisions. Stage 3: in play on the 256 pilot games, full-width fair d4s7 with the refit leaf averages 321,045 points and 93.74 moves against 404,497 and 116.41 for the frozen leaf on the same seeds: paired delta -83,451 points (one-sided 95% bounds -118,022 and -49,021; floor 34,345) and -22.66 moves (bounds -31.98, -13.32), 104 wins to 152; upper bound below zero, so P-L2 FAILS with a measurable loss of about a fifth of the score. The leaf that predicts the depth-4 value best is a worse leaf: it explains more variance among live roots by absorbing four plies of expected score, and inside the search that reweighting mis-prices the positions the search actually has to choose between, above all near death, which the fit deliberately excluded. Unlike three earlier proxies, this one pointed the right way. Valid negative result at pilot tier; one-step linear TreeStrap on these eighteen terms is closed as tested.

What it had to pass
  • P-L1 (theory a): held-out R^2 of refit-18 exceeds the frozen-leaf affine baseline by >= 0.05 — observed: 0.852 vs 0.729, gain +0.123 (lambda 0.001, the grid edge)
  • P-L2 (theory b): refit-18 arm's paired score delta over the frozen-leaf arm has LB95 > 0; fail if UB95 < 0 — observed: -83,451 [LB -118,022, UB -49,021], floor 34,345; moves -22.66 [LB -31.98, UB -13.32]; W/T/L 104/0/152
  • P-L3 (variant): refit-19's held-out R^2 exceeds refit-18's by >= 0.01 — observed: gain -0.0001 (kf_beta 326 on a term the eighteen already explain); no refit-19 arm run
  • Mechanics: LinearLeaf at the frozen constants bit-identical to FairLeaf; zero illegal and incomplete decisions — observed: crate test frozen_linear_leaf_matches_fair_leaf_bits (56 boards); 0 illegal, 0 incomplete, 0 censored
Technical recordRecorded metricsRS-20260903T013022Z-b0937bf9
stage1
floor
-50,000
fitRoots
2,913
fitRootsDropped
425
heldOutRoots
1,877
heldOutRootsDropped
183
baselineAffine
slope
0.9202
intercept
12988.0593
lambda
0.0010
cv
0.001
73401582.5580
0.01
73410223.4741
0.1
74906572.4486
1.0
121426385.8128
10.0
233085590.2247
r2HeldOut
0.7293
refit18
weights
open_columns
-4232.4797
height_load
6.3982
solid_cells
-1201.5322
cracked_cells
284.9428
numbered_cells
-338.5627
high_low_numbers
-149.0987
direct_potential
863.4063
latent_chain_potential
564.1850
cracked_exposure
1538.3437
solid_exposure
3272.8873
adjacent_ones
-2840.1211
triple_twos
-4222.7704
dead_low_numbers
-884.3974
covered_height_risk
-158.0583
low_number_height_risk
17.6718
danger_height_squared
-333.3924
rise_pressure
4.8411
next_disc_vertical_options
58.6726
bias
45744.3099
lambda
0.0010
cv
0.001
37957398.9705
0.01
37958704.1872
0.1
38523932.0167
1.0
54358654.2899
10.0
153452998.5746
r2HeldOut
0.8521
r2Fit
0.8654
refit19
kfBeta
325.9629
bias
45637.6966
lambda
0.0010
r2HeldOut
0.8520
gainOverBaseline
0.1228
gain19Over18
-0.0001
stage2SubPanelProxy
roots
128
truth
exact frozen-leaf d5s7
configs
exact:4:7
roots
128
games
16
top1Agreement
0.7969
meanNormalisedRegret
0.0285
meanRawRegret
145.6493
maxNormalisedRegret
0.6959
meanWork
5105613.2969
workRatioOfMeans
1
meanWorkRatio
1
priorWorkShare
0
meanPrunedNodes
0
meanWallMs
4962.1700
monotoneViolations
218
top1AgreementLb95
0.7524
meanNormalisedRegretUb95
0.0398
weights-leaf18.txt
roots
128
games
16
top1Agreement
0.6797
meanNormalisedRegret
0.0846
meanRawRegret
9349.9620
maxNormalisedRegret
1
meanWork
5105613.2969
workRatioOfMeans
1
meanWorkRatio
1
priorWorkShare
0
meanPrunedNodes
0
meanWallMs
4950.8656
monotoneViolations
861
top1AgreementLb95
0.6129
meanNormalisedRegretUb95
0.1321
pairedVsexact:4:7
meanNormalisedRegretReduction
-0.0560
normalisedLb95
-0.0977
meanRawRegretReduction
-9204.3127
rawLb95
-21308.0222
roots
128
weights-leaf19.txt
roots
128
games
16
top1Agreement
0.6875
meanNormalisedRegret
0.0866
meanRawRegret
9352.2231
maxNormalisedRegret
1
meanWork
5105613.2969
workRatioOfMeans
1
meanWorkRatio
1
priorWorkShare
0
meanPrunedNodes
0
meanWallMs
5901.2160
monotoneViolations
861
top1AgreementLb95
0.6179
meanNormalisedRegretUb95
0.1345
pairedVsexact:4:7
meanNormalisedRegretReduction
-0.0581
normalisedLb95
-0.0986
meanRawRegretReduction
-9206.5737
rawLb95
-21291.2906
roots
128
refitVsFrozenD4SameAction
100/128
stage3
cohort
seedsStartHex
0xa5277000
games
256
moveCap
2,000
arms
fair-d4s7
games
256
score
mean
404496.8555
sd
282958.1647
median
315157.5000
q25
211976.2500
min
103,308
max
1,746,375
moves
mean
116.4063
median
90
q25
65
min
35
max
475
censoredGames
0
numberedClearsPerMove
2.0715
coveredRevealsPerMove
1.1652
meanChainDepth
2.1475
maximumChainDepth
13
illegalDecisions
0
incompleteDecisions
0
logicalWorkPerMove
5221078.2738
wallSecondsPerGame
464.7704
leaf-d4s7-weights-leaf18
games
256
score
mean
321045.4141
sd
203027.9780
median
264787.5000
q25
173,833
min
85,331
max
1,275,013
moves
mean
93.7422
median
80
q25
55
min
30
max
355
censoredGames
0
numberedClearsPerMove
2.0144
coveredRevealsPerMove
1.1403
meanChainDepth
2.1226
maximumChainDepth
12
illegalDecisions
0
incompleteDecisions
0
logicalWorkPerMove
5236533.4317
wallSecondsPerGame
358.2558
pairedVsFairD4s7
leaf-d4s7-weights-leaf18
score
n
256
meanDelta
-83451.4414
sdDelta
334053.5228
lb95
-118021.6523
ub95
-49021.2969
detectionFloor
34344.8778
wins
104
ties
0
losses
152
moves
n
256
meanDelta
-22.6641
sdDelta
90.7159
lb95
-31.9805
ub95
-13.3164
detectionFloor
9.3267
wins
98
ties
9
losses
149
workPerMoveRatio
1.0030
meanScore
321045.4141
referenceMeanScore
404496.8555
wallClock
2026-09-02T20:25:12Z to 2026-09-03T00:42:41Z on 6 threads, 15,449 s, shared with three EX-5 arms
Limitations
  • Pilot tier; the comparator rows are EX-5's full-width arm on the same seeds (RS RS-20260903T013022Z-d32ee053), read once more here.
  • The refit excluded death-dominated roots by design (root value above -50,000) and fitted the smallest lambda of the preregistered grid; a refit that keeps or reweights death-dominated roots, or a shrinkage toward the frozen constants, was not tested and is what would reopen the direction.
  • The stage-2 proxy scores the refit leaf's decisions with the frozen leaf's depth-5 values and is biased toward the frozen leaf; it is reported because it predicted the gameplay sign correctly, not as evidence on its own.
  • The leaf arm ran concurrently with three other arms; its 15,449 s wall plus the earlier stages exceeded the preregistered 14,400 s stop by about 1,300 s, which was not enforced; every row is deterministic and no number is affected. Wall times are contended; work per move (5.24M vs 5.22M, ratio 1.003) is the cost comparison.
  • Panel-derived R^2 values are on training-role roots of fair-d4s7 play and describe the depth-4 root value, not score.

Recorded against Linear leaf refit to the depth-4 root value: held-out fit, depth-5 agreement proxy, and gameplay pilot.

Agent contextHow to extend this record

To add a reader-facing explanation, write web/content/research/RS-20260903T013022Z-b0937bf9.mdx; it renders above this record on the next request. The recorded metrics, gate checks and limitations are in the technical record above.

Record file: research/results/RS-20260903T013022Z-b0937bf9.json, validated against research/schemas/result-v1.schema.json.

Run ids
  • RUN-20260902T184241Z-062fef8c
Contribution ids
  • CT-20260902T082510Z-4af4b77b
Per-game artifact
runs/RUN-20260902T184241Z-062fef8c/oneply-q/evaluate-leaf.json (sha256 fc9cad7eb090224a67e68bd829e0b1fc661b37f7a1f848a2da7322f9d53d3be3, 256 records)
Machine profiles
  • research/system-profiles/MACH-20260902T080517Z-dec42aab.json