Universal LLM Deployment Engine with ML Compilation

High-performance In-browser LLM Inference Engine

LLM inference in C/C

Port of OpenAI's Whisper model in C/C

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

https://openjdk.org/projects/panama

https://openjdk.org/projects/loom

🎼 Bach Builds (on(ly)) Modules

Package provides java implementation of reinforcement learning algorithms such Q-Learn, R-Learn, SARSA, Actor-Critic

Java implementation of RSocket

Java libraries for writing microservices

Gradle plugin: adds support for building Java 9 modules.

A really small static web server for Docker

Netty project - an event-driven asynchronous network application framework

Vert.x is a tool-kit for building reactive applications on the JVM

🌄 The Cloud Native Interactive Landscape filters and sorts hundreds of projects and products, and shows details including GitHub stars, funding, first and last commits, contributor counts and headq…

The container native, cloud agnostic serverless platform.

Java API and runtime for fn.

Resilience4j is a fault tolerance library designed for Java8 and functional programming