Ollama & Local AI: A Practical Guide to Self-Hosting, Fine-Tuning, and Deploying Open-Source LLMs for Production - Couverture souple

Reedwell, Max

Couverture souple

ISBN 13 : 9798273638556

Editeur : Independently published, 2025

Synopsis

Frustrated by the high costs, slow latency, and data privacy risks of proprietary cloud LLM APIs?

This book is the definitive, hands-on guide for AI developers, DevOps engineers, and technical leaders who are ready to take full control of their AI stack. Ollama & Local AI provides a practical, code-driven roadmap to self-hosting, fine-tuning, and deploying powerful open-source models like Llama and Mistral directly on your own hardware. Move beyond simple API consumption, gain absolute data sovereignty, and dramatically reduce your inference costs.
This is not a high-level overview; it's a complete production playbook. Inside, you will find the precise, step-by-step instructions to:
Master Installation: Set up and manage complete Ollama and LocalAI ecosystems, from simple scripts to production-ready Docker and Kubernetes deployments.
Fine-Tune Custom Models: Learn to perform efficient LoRA and QLoRA fine-tuning using modern tools like Unsloth and Axolotl to create models with specialized skills.
Optimize and Deploy: Convert, quantize, and merge models into the high-performance GGUF format using llama.cpp workflows for deployment in both Ollama and LocalAI.
Build Secure APIs: Architect secure, high-throughput REST APIs for your models using an Nginx reverse proxy for enterprise-grade authentication.
Orchestrate Workflows: Integrate your local models into complex LangChain pipelines to build powerful applications like Retrieval-Augmented Generation (RAG).
Troubleshoot Like a Pro: Diagnose and solve common pitfalls in VRAM management, CUDA conflicts, and performance bottlenecks.
Stop renting your AI. Build, deploy, and own your high-performance LLM infrastructure today.

Détails de l'édition

• Éditeur: Independently published
• Date d'édition: 2025
• Langue: anglais
• ISBN 13: 9798273638556
• Reliure: Broché
• Nombre de pages: 121
• Coordonnées du fabricant: Manufactured by Amazon on behalf of the author; https://www.amazon.fr/hz/contact-us; ; c/o Amazon Media EU S.à.r.l., 38 Avenue John F. Kennedy; Luxembourg; L-1855; Luxembourg