New Serverless Transformers using Amazon SageMaker Serverless Inference and Hugging Face

https://www.philschmid.de/serverless-transformers-sagemaker-huggingface

New Serverless Transformers using Amazon SageMaker Serverless Inference and Hugging Face
Amazon SageMaker Serverless Inference. Amazon SageMaker Serverless Inference is a fully managed serverless inference option that makes it easy for you to deploy and scale ML models built on top of AWS Lambda and fully integrated into the Amazon SageMaker service. Serverless Inference looks ideal for workloads that have idle periods, can tolerate cold starts, aren’t latency and throughput …
www.philschmid.de