A example FastAPI PyTorch Model deploy with nvidia/cuda base docker.

The model used is trained for classification on Iris Flower Dataset, from this blog written by Nikolai Janakiev: https://janakiev.com/blog/pytorch-iris/

Detailed explaination can be found in this Medium article: https://medium.com/@mingc.me/deploying-pytorch-model-to-production-with-fastapi-in-cuda-supported-docker-c161cca68bb8