bood / go-test Goto Github PK
View Code? Open in Web Editor NEWScenario based strength test tool for Go programs
License: MIT License
Scenario based strength test tool for Go programs
License: MIT License
if I give you access to a server remetloy can you log in on my behalf and set up training for me?
I wish to net2net Leela zero current net (#116) to a 256f 20b (or 40blocks) network (new net) and then backtrain the last 2 million games.
Can you help
https://online-go.com/game/12435854
This game has RZ dropping from 60% winrate after move 148. Analyzing the game with the net used (8c67ecdc-120), the now best (5d6d9c5b-121), and current best 256x20 (1629cbfd-V5) for move 150 with 32000 visits seems to show the live eval thought the win rate of 48% for playing K2 was not actually as good.
weight: 8c67ecdc, visit: 32000
L2 -> 11132 (V: 43.14%) (N: 1.53%) PV: L2 L4 K5 H2 K2 P5 P4 P6 Q7 O3 N6 L6 J7 K6 O7 J5 B10 L12 C11 D11 G17 M11 H10 O12 S15 S16 T16 T17 T15 S18 F18
Q1 -> 6024 (V: 49.93%) (N: 0.03%) PV: Q1 R2 P1 R1 L4 P7 O8 L2 M2 H2 K2 L3 K5 K4 K6 J5 L6 J7 L1 K1 J1 H1 M1 F1 B10
K2 -> 4656 (V: 42.85%) (N: 10.96%) PV: K2 L3 Q1 R2 P1 S2 L4 L2 M2 H2 L1 H1 E1 K1 K4 J3 D1 A5 K5 J5
H2 -> 3323 (V: 43.02%) (N: 3.22%) PV: H2 L4 L3 P6 P4 O8 P7 Q6 R6 Q7 R2 S2 R3 S3 O3 R1 P1 Q2 S15 S16
L4 -> 2985 (V: 40.35%) (N: 64.84%) PV: L4 L2 M2 H2 K2 L3 L1 H1 E1 K1 K5 K4 K6 J5 L6 J7
R2 -> 1495 (V: 43.06%) (N: 1.12%) PV: R2 S2 L4 L2 M2 H2 K2 L3 L1 H1 R3 S3 E1 K1 K4 J3
weight: 5d6d9c5b, visit: 32000
L4 -> 7914 (V: 40.18%) (N: 64.82%) PV: L4 L2 R2 R3 M2 P5 P4 P6 R6 O3 S2 P1 T3 T4 N4 R1 S1 T2 Q1 Q2 O1 S3 K2
K2 -> 6567 (V: 41.13%) (N: 10.26%) PV: K2 L3 Q1 R2 P1 S2 L4 L2 M2 H2 K5 K4 K6 J5 L6 J7 L1 K1 J1 H1 K1 F1 B10
R2 -> 3778 (V: 41.31%) (N: 1.16%) PV: R2 S2 R3 S3 L4 L2 M2 H2 K5 K4 K2 L3 L6 K6 L1 P7 O8 R6 Q6 Q7 P5 P9 S7
L2 -> 3741 (V: 41.29%) (N: 1.71%) PV: L2 L4 K5 P5 P4 P6 R6 O3 H2 J5 G17 F18 G16 H17 S15 S16 T16 T17 T15 S18 B10 C11 A6
R3 -> 3531 (V: 41.34%) (N: 0.28%) PV: R3 S3 L4 L2 R2 S2 M2 H2 K2 L3 K5 J5 L1 K1 J1 H1 K6 J7 M1 F1 S15 S16
H2 -> 3456 (V: 41.24%) (N: 2.83%) PV: H2 L4 K5 P7 O8 J5 K6 L6 J7 M5 N6 N4 P4 O3 R3 S3 R2 M2 S2 R6 Q6 Q7 S7 P5 T6 L8 S15 S16
weight: 1629cbfd, visit: 32000
R2 -> 7510 (V: 42.65%) (N: 2.40%) PV: R2 S2 Q1 R3 P1 S1 L4 L2 M2 H2 K2 L3 L1 K1 K5 K4 J1 H1 K6 J5 L6 J7
L4 -> 5970 (V: 41.24%) (N: 60.58%) PV: L4 L2 R2 S2 R3 S3 Q1 Q2 K2 L3 H2 M2 O3 N1 N4 O1 P4 R1 G17 F18 G16 H17 S15
P1 -> 4986 (V: 42.69%) (N: 0.04%) PV: P1 Q1 L4 L2 M2 H2 K2 L3 K5 J5 L1 H1 E1 K1 J1 J3 M1 K1 G17
H2 -> 4062 (V: 42.45%) (N: 6.85%) PV: H2 L4 L3 L6 J3 P6 P4 O3 N6 P5 Q7 J7 K5 K4 K2 J5 G17 F18 G16 H17 S15
K2 -> 3912 (V: 42.36%) (N: 8.97%) PV: K2 L3 R2 S2 Q1 R3 P1 S1 L4 L2 M2 H2 L1 K1 K5 K4 J1 H1 K6 J5 L6 J7
R3 -> 2884 (V: 42.68%) (N: 0.11%) PV: R3 S3 L4 L2 R2 S2 Q1 Q2 K2 L3 H2 M2 O3 N1 N4 O1 P4 R1 G17 F18 G16 H17 S15
…
L2 -> 23 (V: 32.23%) (N: 1.68%) PV: L2 L4 K5 H2 K2 J5 G17
I'm not really sure what's the right play here. Or maybe there is no definitive right or wrong play at this point? Notably the 256x20 didn't think very highly of the best move 150 L2 of the first network.
As a sanity check, move 148 E5 is generally good with all 3 networks although not quite the 60% win rate from the live game:
weight: 8c67ecdc, visit: 32000
B10 -> 13554 (V: 51.08%) (N: 0.26%) PV: B10 L12 C11 D11 C12 G16 M11 E5 D12 E14 F15 G14 E12 D14 E11
A6 -> 7745 (V: 50.79%) (N: 0.20%) PV: A6 H2 K3 E5 A4 C1 A2 L12 B10 M11 H10 C11 G17 F18 G16 H17 S15 O12 S17
E5 -> 3387 (V: 50.49%) (N: 7.20%) PV: E5 K3 K2 L3 L4 L2 M2 H2 L1 H1 E1 K1 J1 J3 D1 A5
F7 -> 2702 (V: 50.75%) (N: 0.80%) PV: F7 K3 L4 L2 M2 H2 K2 L3 K5 J5 L1 K1 J1 H1 E1 J3 D1 A5 S15
L6 -> 2086 (V: 47.85%) (N: 43.65%) PV: L6 E5 G4 H2 K3 E7 A6 G7 A4 C1 A2 B3 A3 E1 B10 B9 C9 C10 B11
weight: 5d6d9c5b, visit: 32000
A6 -> 15661 (V: 48.35%) (N: 0.26%) PV: A6 H2 K3 E5 A4 C1 F7 F6 B10 L12 A2 M11 H10 C11 G17 F18 G16 H17 S15 S16 T16 T17
B10 -> 3480 (V: 48.33%) (N: 0.36%) PV: B10 L12 M11 H2 K3 E5 C11 D11 S15 S16 T16 T17 T15 S18 G17 F18 G16
L6 -> 3126 (V: 46.37%) (N: 43.14%) PV: L6 E5 G4 H2 K3 E7 A6 G8 H8 G7 K6 J7 A4 C1 A2
E5 -> 2988 (V: 48.02%) (N: 6.89%) PV: E5 K3 L4 L2 M2 H2 K2 L3 L1 H1 E1 K1 J1 J3 D1 A5 S15
J7 -> 2463 (V: 48.18%) (N: 2.86%) PV: J7 E5 G4 H2 K3 E7 K4 K5 F7 D8 D9 C8 C9 B8 E8 B9
F7 -> 1521 (V: 48.26%) (N: 0.75%) PV: F7 K3 R2 S2 L4 L2 M2 H2 K2 L3 L1 K1 R3 S3 J1 H1 E1 J3
weight: 1629cbfd, visit: 32000
F7 -> 13345 (V: 52.09%) (N: 0.26%) PV: F7 L6 G17 F18 G16 H17 J7 K3 H2 P7 O8 R6 Q6 P5 N6 O7 Q7 P4 L2
G17 -> 4557 (V: 52.07%) (N: 0.52%) PV: G17 L12 M11 H2 K3 E5 B10 C11 S15 S16 T16 T17 T15 S18 H17 H18 J17 J18 K17
B10 -> 4011 (V: 52.08%) (N: 0.12%) PV: B10 L12 M11 H2 K3 E5 G17 M12 N13 N12 O13 C10 B9 B11 S15 S16 T16 T17 T15
A6 -> 3738 (V: 52.08%) (N: 0.02%) PV: A6 L12 A4 C1 M11 H2 K3 E5 A2 M12 E1 A3 B3 B17 B18 A3 R2 S2 B3
E5 -> 2792 (V: 51.97%) (N: 2.25%) PV: E5 K3 K2 L4 L3 P7 O8 P5 P4 R6 P6 Q6 P5 Q7 O7 J3 R2 R3 S2 R8 S8 S7 S9 T2
All 3 networks do have the PV: E5 K3 K2
, but comparing the win rates from move 148 (50.49%, 48.02%, 51.97%) to the above move 150 K2 (after black plays K3): 42.85%, 41.13%, 42.36%. So even when playing the expected variation, the win rate drops by about 8% for each network, so it seems like the value head is off… ?
The SGF appears to be missing for race4
. This is the filename:
12383186-296-inelasticneutron-RoyalZero.sgf
https://online-go.com/game/12496265
Seems like there was a mistake earlier as win rate drops from 52.4% to 35.4% after a potential ladder starting at move 58.
But at least for move 123 Q3, it wasn't expected for rotation 2 with only a 11.71% prior policy (whereas other rotations were ~25-40%):
expect: Q3, move: 123, who: b
weight: 8a045bce, visit: 250
rotation: 0, seed: 22
Q3 -> 236 (V: 95.16%) (N: 29.38%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 M1 L1 N1
T2 -> 5 (V: 49.29%) (N: 20.93%) PV: T2 R3 S5
S5 -> 5 (V: 48.89%) (N: 20.01%) PV: S5 T3 Q3 Q2 T2
T3 -> 3 (V: 47.46%) (N: 11.95%) PV: T3 R3 S5
= Q3
rotation: 1, seed: 6
Q3 -> 163 (V: 77.27%) (N: 38.97%) PV: Q3 Q2 R3 T3 S2 O1 S5 N2 M3 L2 M2 M1 N3 N1
T2 -> 58 (V: 56.80%) (N: 21.66%) PV: T2 S2 S5 R3 T6 L3 S1 T3 E14
T3 -> 16 (V: 51.99%) (N: 14.53%) PV: T3 R3 S5 S2 K4 K3
S5 -> 8 (V: 52.96%) (N: 6.74%) PV: S5 T3 Q3 Q2 T2 T4
R3 -> 4 (V: 42.98%) (N: 6.04%) PV: R3 Q3 T2 S2
= Q3
rotation: 2, seed: 2
T3 -> 122 (V: 57.84%) (N: 11.71%) PV: T3 R3 S5 S2 L8 L3 S17 N14 M15
T2 -> 69 (V: 47.93%) (N: 58.36%) PV: T2 O1 S5 N2 M3 N3 O4 M2 L3 L2 K3 K2 J3 J2 G2 H2 L8
Q3 -> 56 (V: 56.23%) (N: 11.93%) PV: Q3 Q2 T2 R3 S5 S2 T6 L3 L8
S5 -> 2 (V: 44.02%) (N: 2.91%) PV: S5 T3
= T3
rotation: 3, seed: 11
Q3 -> 239 (V: 95.42%) (N: 43.42%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 N1 H10 L8 M7
T2 -> 4 (V: 48.27%) (N: 16.76%) PV: T2 S2 S5 R3
S5 -> 4 (V: 45.58%) (N: 18.30%) PV: S5 T3 Q3 Q2
T3 -> 2 (V: 48.52%) (N: 9.26%) PV: T3 R3
= Q3
rotation: 4, seed: 3
Q3 -> 197 (V: 90.05%) (N: 28.35%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 N1 H10 L8 M7
T2 -> 45 (V: 56.60%) (N: 38.65%) PV: T2 O1 S5 N2 M3 L2 M2 M1 N3 N1
S5 -> 5 (V: 46.47%) (N: 10.26%) PV: S5 T3 Q3 Q2 T6
O1 -> 2 (V: 46.87%) (N: 5.27%) PV: O1 R3
= Q3
rotation: 5, seed: 4
Q3 -> 237 (V: 94.63%) (N: 25.97%) PV: Q3 Q2 R3 T3 S2 O1 S5 N2 M3 M2 L3 L2 K3
T2 -> 7 (V: 49.77%) (N: 27.99%) PV: T2 R3 S5 S2
S5 -> 3 (V: 47.19%) (N: 15.47%) PV: S5 T3 Q3
T3 -> 2 (V: 41.81%) (N: 10.33%) PV: T3 R3
= Q3
rotation: 6, seed: 12
Q3 -> 217 (V: 87.48%) (N: 29.44%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 N1 S17 S18 T18
T2 -> 14 (V: 54.26%) (N: 18.25%) PV: T2 R3 S5 S2 T6
S5 -> 8 (V: 51.46%) (N: 11.99%) PV: S5 T3 Q3 Q2 T6 T4
T3 -> 8 (V: 48.88%) (N: 16.69%) PV: T3 S2 S5 R3
T6 -> 2 (V: 43.91%) (N: 6.07%) PV: T6 T3
= Q3
rotation: 7, seed: 1
Q3 -> 203 (V: 60.17%) (N: 39.11%) PV: Q3 Q2 T2 T3 E14 D14 T4 R3 S5 T3 D15
T2 -> 27 (V: 52.56%) (N: 21.08%) PV: T2 O1 S5 N2 M2 N3 O4
S5 -> 11 (V: 51.53%) (N: 9.84%) PV: S5 T3 Q3 Q2 T2 R3 T4 S2
T3 -> 5 (V: 47.56%) (N: 6.42%) PV: T3 R3 S5 S2
R3 -> 3 (V: 33.11%) (N: 5.93%) PV: R3 Q3 T2
= Q3
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.