《大模型项目实战：多领域智能应用开发》配套资源
-
Updated
Mar 14, 2026 - JavaScript
#
llm-deployment
Here are 21 public repositories matching this topic...
-
Updated
Sep 25, 2025 - Python
A curated collection of open-source Large Language Model (LLM) projects that are production-ready and can be used for solving real-world problems. This repository focuses on high-performance, scalable LLM solutions across various industries and applications.
-
Updated
May 29, 2026
Production-ready checklists and frameworks for deploying LLMs, GenAI models, and AI infrastructure. Covers vLLM, Kubernetes, GPU optimization, observability, compliance, and Day-0 to Day-2 operations.
kubernetes machine-learning deployment optimization best-practices checklists model-serving gpu-optimization mlops production-readiness ai-governance vllm genai llm-deployment ai-infrastructure
-
Updated
Apr 15, 2026 - Shell
🚀 AI-Native Developer & Computer Engineer | Designing scalable cognitive ecosystems through advanced AI orchestration. Specializing in LLM deployment, Semantic Q&A, and high-performance backend architecture. "I don’t just write code — I orchestrate intelligence."
python open-source computer-engineering fastapi llm-deployment ai-orchestration cognitive-ecosystems high-performance-backend
-
Updated
Jun 29, 2026
🧠 A comprehensive toolkit for benchmarking, optimizing, and deploying local Large Language Models. Includes performance testing tools, optimized configurations for CPU/GPU/hybrid setups, and detailed guides to maximize LLM performance on your hardware.
cuda gpu-acceleration model-management inference-optimization model-quantization cpu-inference llama-cpp local-llm llm-deployment llm-benchmarking ollama-optimization hybrid-inference wsl-ai-setup context-window-scaling
-
Updated
Mar 27, 2025 - Shell
5-Day Hands-on AI Agents Course using Google ADK & Vertex AI | From first agent to production deployment
memory mcp multi-agent gemini observability ai-agents rag kaggle-course vertex-ai llm generative-ai llm-deployment agentic-workflows model-context-protocol google-adk
-
Updated
Nov 25, 2025 - Jupyter Notebook
Structured repository covering LLM foundations, fine-tuning workflows, optimization strategies, deployment patterns, evaluation methods, and Responsible AI considerations.
python machine-learning fine-tuning responsible-ai large-language-models prompt-engineering llm-evaluation llm-deployment llm-optimization llm-monitoring llm-fundamentals
-
Updated
Dec 19, 2025 - Jupyter Notebook
API to efficiently deploy Language Model (LLM) applications using Flask API
-
Updated
Feb 26, 2024
ModelSpec is an open, declarative specification for describing how AI models especially LLMs are deployed, served, and operated in production. It captures execution, serving, and orchestration intent to enable validation, reasoning, and automation across modern AI infrastructure.
kubernetes runtime json-schema inference autoscaling observability model-deployment model-serving declarative-config production-ai mlops ai-systems llm ai-ops gpu-inference vllm llm-deployment ai-infrastructure modelspec
-
Updated
Apr 27, 2026 - Python
Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment
machine-learning developer-tools awesome-list live-data mlops ai-engineering ai-tools auto-updated ai-monitoring ai-observability llmops prompt-management llm-deployment llm-observability ai-infrastructure llm-gateway llm-stack awesome-llmops
-
Updated
Jun 30, 2026 - Python
Python codes generation from latex expressions. Using synthetic dataset and CodeT5-base model.
transformers postprocessing synthetic-data fine-tuning transformer-models t5-model inferencing large-language-models llm t5-base llm-deployment llm-models latex-to-python
-
Updated
Oct 16, 2024 - Jupyter Notebook
Open-source LLM inference benchmarks — TTFT, TPOT, Throughput, Latency & Cost-per-token for models like Llama, Qwen, Gemma, DeepSeek, Gpt-Oss etc. deployed on different dedicated GPUs.
gpu inference benchmarks llama quantization tensor-rt llm vllm open-source-llm qwen llm-deployment sglang
-
Updated
Jun 18, 2026 - Python
🧠 Инфраструктура для деплоймента Zeroclaw, докерезированная и совместимая с Portainer
docker docker-compose portainer llm-deployment ai-deployment openclaw zeroclaw openclaw-docker zeroclaw-docker
-
Updated
May 28, 2026 - Dockerfile
LLMOps infrastructure and deployment pipelines using Bicep. Azure-based MLOps for large language model deployment and management.
-
Updated
Aug 16, 2024 - Bicep
AWS EKS + IRSA, Volumes, ISTIO & KServe+ NextJS App + Fastapi Serve + kubernetes + Helm charts + Multimodel or LLM-Deployment The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs
-
Updated
Jan 26, 2025 - Python
A 6-week hands-on masterclass in production MLOps engineering. Build a file-backed experiment tracker, a containerized model registry, an inference server with dynamic batching, a cached pipeline DAG, automated drift detectors (PSI/KS), and high-performance LLM serving infra (KV-cache/continuous batching) from scratch.
docker registry tracking packaging containers cicd inference-server machine-learning-production mlops model-registry data-drift llm llm-serving llm-deployment cicd-pipelines devops-for-ml mflow-alternative
-
Updated
May 27, 2026 - Jupyter Notebook
LLM App for summarization of Terms and Conditions agreements available on the internet.
-
Updated
Nov 18, 2024 - Jupyter Notebook
A simple CLI tool to fetch Hugging Face model metadata and estimate required VRAM/RAM for inference.
transformers inference python-cli huggingface memory-estimation resource-planning llm llm-deployment ai-infrastructure vram-calculator
-
Updated
Mar 14, 2026 - Python
-
Updated
Oct 2, 2025
Improve this page
Add a description, image, and links to the llm-deployment topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-deployment topic, visit your repo's landing page and select "manage topics."