• Docs >
  • Develop a Model Server
Shortcuts

Develop a Model Server

Audience: Users who want to serve their trained models.

Prerequisite: Reach level 16+.


Objective

Create a simple application that trains and serves a Sklearn machine learning model with MLServer from SeldonIO


Final Application

Here is a gif of the final application built in this example.

https://pl-flash-data.s3.amazonaws.com/assets_lightning/ml_server_2.gif

System Design

In order to create such application, we need to build several components:

  • A Model Train Component that trains a model and provides its trained weights

  • A Model Server Component that serves as an API endpoint for the model generated by the Model Train Component.

  • A Load Testing Component that tests the model server works as expected. This could be used to CI/CD the performance of newly generated models (left to the users).

https://pl-flash-data.s3.amazonaws.com/assets_lightning/model_server_app_2.png

Let’s dive into the tutorial.


Tutorial