Self-Taught Semi-Self Speculative Decoding

S4D is a state-of-the-art hierarchical speculative decoding method that replaces hand-tuned speculative-decoding thresholds with a learned per-token routing policy