Develop a Model Server¶
Audience: Users who want to serve their trained models.
Prerequisite: Reach level 16+.
Objective¶
Create a simple application that trains and serves a Sklearn machine learning model with MLServer from SeldonIO
Final Application¶
Here is a gif of the final application built in this example.
System Design¶
In order to create such application, we need to build several components:
A Model Train Component that trains a model and provides its trained weights
A Model Server Component that serves as an API endpoint for the model generated by the Model Train Component.
A Load Testing Component that tests the model server works as expected. This could be used to CI/CD the performance of newly generated models (left to the users).
Let’s dive into the tutorial.
