Articles liés à Deep Dive into SGLang, Volume I: Runtime, Scheduling,...
Deep Dive into SGLang, Volume I: Runtime, Scheduling, Memory, and Decoding - Couverture souple
Livre 3 sur 4: Foundation Books
Synopsis
Deep Dive into SGLang, Volume I explains SGLang’s runtime request path as a set of algorithms, data structures, and systems tradeoffs.
This volume focuses on the core inference-serving loop: tokenization, admission, prefill and decode scheduling, prefix lookup, KV-cache allocation, forward execution, sampling, streaming, and cleanup. Instead of treating SGLang as a catalog of commands, it builds a working model of the runtime state that makes modern LLM serving possible.
Volume I covers:
- The inference serving problem and request lifecycle
- Transformer inference cost models
- SGLang’s runtime as a distributed state machine
- Continuous batching and chunked prefill
- KV-cache memory management
- RadixAttention and prefix reuse
- Hierarchical caching
- Attention backends and forward batches
- Model architecture registration
- Sampling and logits processing
- Structured outputs, reasoning parsers, and tool-call parsing
- Speculative decoding
- Diffusion language models and blockwise decoding
Each chapter explains the systems problem before implementation details, then ties technical claims back to SGLang source files, tests, or benchmark artifacts. The book is written for readers who already know basic transformer and GPU-systems vocabulary and want a deeper, source-grounded understanding of how a production LLM serving runtime is organized.
This is Volume I of Deep Dive into SGLang. Volume II continues into quantization, distributed serving, kernels, hardware backends, benchmarking, correctness, multimodal serving, diffusion inference, and technical extension.
Independent explanatory guide. Not affiliated with or endorsed by the SGLang project.
Les informations fournies dans la section « Synopsis » peuvent faire référence à une autre édition de ce titre.
Résultats de recherche pour Deep Dive into SGLang, Volume I: Runtime, Scheduling,...
Image d'archives
Deep Dive into SGLang, Volume I: Runtime, Scheduling, Memory, and Decoding (Foundation Books)
impression à la demandeVendeur : California Books, Miami, FL, Etats-Unis
Évaluation du vendeur 4 sur 5 étoiles
Etat : New. Print on Demand. N° de réf. du vendeur I-9798182198233
Acheter neuf
EUR 30,22
Livraison gratuite
Expédition nationale : Etats-Unis
Expédition nationale : Etats-Unis
Quantité disponible : Plus de 20 disponibles
Image d'archives
Deep Dive into SGLang, Volume I
Vendeur : PBShop.store US, Wood Dale, IL, Etats-Unis
Évaluation du vendeur 5 sur 5 étoiles
PAP. Etat : New. New Book. Shipped from UK. Established seller since 2000. N° de réf. du vendeur L2-9798182198233
Acheter neuf
EUR 37,56
Livraison gratuite
Expédition nationale : Etats-Unis
Expédition nationale : Etats-Unis
Quantité disponible : Plus de 20 disponibles
Image d'archives
Deep Dive into SGLang, Volume I
Vendeur : PBShop.store UK, Fairford, GLOS, Royaume-Uni
Évaluation du vendeur 5 sur 5 étoiles
PAP. Etat : New. New Book. Shipped from UK. Established seller since 2000. N° de réf. du vendeur L2-9798182198233
Acheter neuf
EUR 30,19
Expédition à EUR 7,90
Expédition depuis Royaume-Uni vers Etats-Unis
Expédition depuis Royaume-Uni vers Etats-Unis
Quantité disponible : Plus de 20 disponibles
Image d'archives
Deep Dive into SGLang, Volume I (Paperback)
impression à la demandeVendeur : CitiRetail, Stevenage, Royaume-Uni
Évaluation du vendeur 5 sur 5 étoiles
Paperback. Etat : new. Paperback. Deep Dive into SGLang, Volume I explains SGLang's runtime request path as a set of algorithms, data structures, and systems tradeoffs. This volume focuses on the core inference-serving loop: tokenization, admission, prefill and decode scheduling, prefix lookup, KV-cache allocation, forward execution, sampling, streaming, and cleanup. Instead of treating SGLang as a catalog of commands, it builds a working model of the runtime state that makes modern LLM serving possible. Volume I covers: The inference serving problem and request lifecycleTransformer inference cost modelsSGLang's runtime as a distributed state machineContinuous batching and chunked prefillKV-cache memory managementRadixAttention and prefix reuseHierarchical cachingAttention backends and forward batchesModel architecture registrationSampling and logits processingStructured outputs, reasoning parsers, and tool-call parsingSpeculative decodingDiffusion language models and blockwise decodingEach chapter explains the systems problem before implementation details, then ties technical claims back to SGLang source files, tests, or benchmark artifacts. The book is written for readers who already know basic transformer and GPU-systems vocabulary and want a deeper, source-grounded understanding of how a production LLM serving runtime is organized. This is Volume I of Deep Dive into SGLang. Volume II continues into quantization, distributed serving, kernels, hardware backends, benchmarking, correctness, multimodal serving, diffusion inference, and technical extension. Independent explanatory guide. Not affiliated with or endorsed by the SGLang project. This item is printed on demand. Shipping may be from our UK warehouse or from our Australian or US warehouses, depending on stock availability. N° de réf. du vendeur 9798182198233
Acheter neuf
EUR 34,28
Expédition à EUR 43,23
Expédition depuis Royaume-Uni vers Etats-Unis
Expédition depuis Royaume-Uni vers Etats-Unis
Quantité disponible : 1 disponible(s)
Image d'archives
Deep Dive into SGLang, Volume I : Runtime, Scheduling, Memory, and Decoding
Vendeur : AHA-BUCH GmbH, Einbeck, Allemagne
Évaluation du vendeur 5 sur 5 étoiles
Taschenbuch. Etat : Neu. Neuware - Deep Dive into SGLang, Volume I explains SGLang's runtime request path as a set of algorithms, data structures, and systems tradeoffs. This volume focuses on the core inference-serving loop: tokenization, admission, prefill and decode scheduling, prefix lookup, KV-cache allocation, forward execution, sampling, streaming, and cleanup. Instead of treating SGLang as a catalog of commands, it builds a working model of the runtime state that makes modern LLM serving possible. Volume I covers: - The inference serving problem and request lifecycle- Transformer inference cost models- SGLang's runtime as a distributed state machine- Continuous batching and chunked prefill- KV-cache memory management- RadixAttention and prefix reuse- Hierarchical caching- Attention backends and forward batches- Model architecture registration- Sampling and logits processing- Structured outputs, reasoning parsers, and tool-call parsing- Speculative decoding- Diffusion language models and blockwise decoding>This is Volume I of Deep Dive into SGLang. Volume II continues into quantization, distributed serving, kernels, hardware backends, benchmarking, correctness, multimodal serving, diffusion inference, and technical extension. Independent explanatory guide. Not affiliated with or endorsed by the SGLang project. N° de réf. du vendeur 9798182198233
Acheter neuf
EUR 48
Expédition à EUR 39,23
Expédition depuis Allemagne vers Etats-Unis
Expédition depuis Allemagne vers Etats-Unis
Quantité disponible : 2 disponible(s)