Deep Dive into SGLang, Volume II: Quantization, Distributed Serving, Kernels, and Measurement - Couverture souple

Yang, Yin

Couverture souple

ISBN 13 : 9798183580419

Editeur : Independently published, 2026

Synopsis

Deep Dive into SGLang, Volume II continues the source-guided explanation of SGLang’s inference runtime where the core request path meets deployment pressure.

This volume follows the serving contracts introduced in Volume I into quantized weights, LoRA adapters, Mixture-of-Experts routing, distributed placement, collectives, prefill/decode disaggregation, load balancing, custom kernels, CUDA graphs, hardware backends, multimodal transformer serving, diffusion inference, benchmarking, correctness testing, and technical extension work.

The book is written for engineers, researchers, and advanced students who want to understand how modern LLM serving systems preserve correctness while changing representation, placement, execution, and measurement.

• How rows stay aligned across optimized execution paths
• How KV state moves safely between runtime components
• How kernels become eligible or ineligible for a request step
• How distributed workers coordinate placement and visibility
• How benchmark claims become comparable
• How extensions can be evaluated without breaking hidden runtime contracts

This is not a command reference or quick-start guide. It is a deep technical reading of the machinery behind high-throughput inference serving. Each chapter explains the algorithmic or systems problem first, then ties SGLang-specific claims to source files, tests, benchmark artifacts, and operational invariants.

Volume II assumes familiarity with the core serving loop from Volume I: admission, prefill and decode scheduling, KV storage, forward execution, sampling, streaming, and cleanup. Readers with GPU systems and transformer inference background can also use the opening preliminaries bridge as a compact orientation before entering the specialized chapters.

Détails de l'édition

• Éditeur: Independently published
• Date d'édition: 2026
• Langue: anglais
• ISBN 13: 9798183580419
• Reliure: Broché
• Nombre de pages: 530
• Coordonnées du fabricant: Manufactured by Amazon on behalf of the author; https://www.amazon.fr/hz/contact-us; ; c/o Amazon Media EU S.à.r.l., 38 Avenue John F. Kennedy; Luxembourg; L-1855; Luxembourg