• Docs >
  • Develop a Model Server

Develop a Model Server

Audience: Users who want to serve their trained models.

Prerequisite: Reach level 16+.


Create a simple application that trains and serves a Sklearn machine learning model with MLServer from SeldonIO

Final Application

Here is a gif of the final application built in this example.


System Design

In order to create such application, we need to build several components:

  • A Model Train Component that trains a model and provides its trained weights

  • A Model Server Component that serves as an API endpoint for the model generated by the Model Train Component.

  • A Load Testing Component that tests the model server works as expected. This could be used to CI/CD the performance of newly generated models (left to the users).


Let’s dive into the tutorial.