A curated list of awesome open source and commercial platforms for serving models in production 🚀

A lightweight server for LightGBM

Serving large ml models independently and asynchronously via message queue and kv-storage for communication with other services [EXPERIMENT]

Collection of OSS models that are containerized into a serving container

Miscellaneous codes and writings for MLOps

Integrating Aporia ML model monitoring into a Bodywork serving pipeline.

Big ML Project with infrastructure (MLflow, Minio, Grafana), backend (FastAPI, Catboost) and frontend (React, Maplibre)

Applied Machine Learning Projects

🌐 Language identification for Scandinavian languages

Energy consumption of ML inference with Runtime Engines

Resources for serving models in production

Example solution to the MLOps Case Study covering both online and batch processing.

Heterogeneous System ML Pipeline Scheduling Framework with Triton Inference Server as Backend

Data extraction for Identifying architectural design decisions for achieving green ML serving