Work log · Stance · Fine-tuning

Work log for Shadow clones: four Muay Thai techniques learnt in parallel

The higher guard: retraining every skill onto a new stance

By Tony Yum · 22–24 October 2026

Training cost about $21.0436 rented GPUs (vast.ai RTX 5090s, then RunPod RTX 5090s from guard15) plus gate and clip jobs, 22–24 October 2026 · 18 training runs, 36 machines, about 24.5 machine-hours

I asked for a new guard: both wrists at the brow, palms facing forward and turned about 25° in, the forearms framing the face with the eyes clear. Before, the fists sat at eye and nose level. Every reference table was rebuilt from the new pose (rhythm, recovery, the five punches and their aim grids, blocks, walking). I wanted the current models fine-tuned onto it rather than retrained from scratch, and balance, walking, punches and blocks all had to still work.

The parent was opp15-14.5M, the blocking keeper on the old guard.

The runs

runwhat changedoutcome
guard1opp15 fine-tuned in the opponent env on the new guardstopped at 34.2 M: punches, walk, blocks short
guard2more punch, block and walk episodesstopped at 159 M: everything held but the punches
guard3level-head and palm-to-ear referenceslead hook about 1 m/s, 0/12 (it got ~3 % of episodes)
guard4three times the lead-hook presses56 M at the 3 h cap: no lead hook, punches 52 → 44
guard5no walk teacher while punching (teacher-free block-punch)kept 26.2 M: every row at or above opp15, opponent 125/160
guard6the lead hook from my capturetrained on a body with the ankle widened for the retarget: walk 10/40, not kept
guard7guard6 with the ankle backlead hook 11/12 but punches 47 → 38, walk 31–33/40; guard5 itself lands the captured hook 10/12, so it stays
guard8–10the lead hook’s form: impact and swing rewards, a follow-throughthe swing still ~25 cm low
guard11the reference’s feed-forward torque on the hook armswing −14 to −18 cm, blocks and opponent lost
guard12guard5 as the teacher outside the lead hook, an arm-pose termother skills held (blocks 31, opponent 118), elbow still 10 cm low
guard13the arm term narrower, with the trunk jointsswing −10, elbow −9 cm
guard14the swing term ×3kept 45.9 M: elbow level with the fist, lead hook 12/12, every row at guard5’s
guard15the jab’s aimstopped at 0.7 M when I asked for the original elbows
guard16–18the original elbows, the jab at the reference’s pace, its pose and line termsguard18-124.5M: the base for new training (jab 2–4 cm off; blocks 27/32)

guard14 is the parent of the first body-straight and knee teachers; guard18 is the base of the distillation and every later clone.

Where the money went

machinesmachine-hourscost
guard1–14 on vast.ai, plus gate, clip and render jobs29about 21.6about $17.62
guard15–18 on RunPod, plus an angle render and the gate7about 2.9about $3.42
total36about 24.5about $21.04

Several vast.ai boxes never came up (created stopped, no SSH after 4 minutes, or still loading after 10). They are billed for the minutes they existed and are in the totals. RunPod first refused every request filtered to CUDA 13 (“no longer any instances available”) while 5090s were in stock; without the filter it deployed at once.

Every run

From the run records in kakuto-ml: each run's machines, their billed hours and cost (EC2 runs are estimates from the run logs), plus the tests and renders this log covers.

RunOutcomeMachinesHoursCost
guard1-2026102222 October · jab, cross, lead hook, rear hook, lead uppercut, blocks · kept guard1-9.8MKept22.6$2.06
guard2-2026102222 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped12.5$1.79
guard3-2026102222 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped10.8$0.51
guard4-2026102222 October · jab, cross, lead hook, rear hook, lead uppercut, blocksNot kept13.1$2.50
guard5-2026102222 October · jab, cross, lead hook, rear hook, lead uppercut, blocks · kept guard5-26.2MKept21.6$1.51
guard6-2026102323 October · jab, cross, lead hook, rear hook, lead uppercut, blocksNot kept41.5$1.10
guard7-2026102323 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped11.1$0.79
guard8-2026102323 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped11.2$1.23
guard9-2026102323 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped10.7$0.60
guard10-2026102323 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped21$0.65
guard11-2026102423 October · jab, cross, lead hook, rear hook, lead uppercut, blocksStopped21.2$0.82
guard12-2026102423 October · lead hook · kept guard12-39.3MKept51.5$1.34
guard13-2026102423 October · lead hook · kept guard13-29.5MKept11$1.05
guard14-2026102423 October · lead hook · kept guard14-45.9MKept41.8$1.65
guard15-2026102524 October · jabStopped10.1$0.13
guard16-2026102524 October · jab, cross, lead hook, rear hook, lead uppercut · kept guard16-34.1MKept20.6$0.68
guard17-2026102524 October · jab, cross, lead hook, rear hook, lead uppercut · kept guard17-42.6MKept10.6$0.70
guard18-2026102524 October · jab, cross, lead hook, rear hook, lead uppercut · kept guard18-124.5MKept21.6$1.86
18 training runs3424.4$20.95
  • lead-hook reference renders for the higher guard, 22 October: 2 machines, 0.1 h, $0.09

← All the work logs for “Shadow clones: four Muay Thai techniques learnt in parallel”