4. Build Server with Docker

With a working server, we can now harness Docker to serve the model. This chapter will guide you through the process of serving the model in a container and how to fetch translation from the server.

Note

In this lab, we will use MobaXterm to establish the connection to EC2. You can use other SSH clients such as PuTTY or Terminal on Mac.

Content

  1. Test connection
  2. Serving with Docker
  3. Making Inference