Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
-
Updated
Jun 4, 2024 - Python
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Pybind11 bindings for Whisper.cpp
Miscellaneous codes and writings for MLOps
Repo with code used in the "Deploying ML Into Production" video tutorial on The Sound of AI channel
Model Deployment at Scale on Kubernetes 🦄️
Serving and Deploying Machine Learning Models with BentoML
A simple demonstration of an Airflow-Kafka-Spark (AKS) stack for online time series forecasting.
Testing deployment of PyMC models using MLFlow and BentoML.
Testing the integration of MLFlow and BentoML
Evaluating several Machine Learning Models in order to predict the price of a phone.
API serving for your diffusers models
GitHub repo showcasing a SVM-based Iris flower species classifier. Leveraging BentoML for model deployment and Swagger API integration. Trained on the Iris dataset with 150 instances from 3 species. Ready for collaborative contributions.
My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club
Iris Classification problem deployed using BentoML
Add a description, image, and links to the bentoml topic page so that developers can more easily learn about it.
To associate your repository with the bentoml topic, visit your repo's landing page and select "manage topics."