deepseek-ai/DeepSpec: DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms
Why CEREBRO kept it
Speculative decoding optimization—core LLM inference research.
The text below is an automated extraction of the article at https://github.com/deepseek-ai/DeepSpec, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (github.com).
DeepSpec is a full-stack codebase for training and evaluating draft models for speculative decoding. It contains data preparation utilities, draft model implementations, training code, and evaluation scripts. Install the Python dependencies: python -m pip install -r requirements.txtData preparation additionally requires an inference engine to serve the target model when regenerating answers; see scripts/data/README.md for details. Run the stages in order — each stage's output feeds the next: - Data Preparation — download prompts, regenerate target answers, and build the target cache. - Trainin
Backlinks
Appeared in 1 briefing