This module has been moved to deepjavalibrary/djl-serving repository.
DJL serving is a high performance universal model serving solution. You can use djl-serving serve the following models out of the box:
- PyTorch TorchScript model
- TensorFlow SavedModel bundle
- Apache MXNet model
You can install extra extensions to enable the following models:
- ONNX model
- XGBoost model
- LightGBM model
- Sentencepiece model
- fastText/BlazingText model