Tools for Serving

    Overview

    Model serving overview

    KFServing

    Model serving using KFServing

    Seldon Serving
    NVIDIA TensorRT Inference Server

    Model serving with TRT Inference Server

    TensorFlow Serving

    Serving TensorFlow models

    TensorFlow Batch Prediction

    Was this page helpful?

    Glad to hear it! Please .

    Last modified 12.02.2020: rename training and serving section titles (#1668) (32e4df31)