Amazon SageMaker AI Async Inference now supports inline request payloads
Quick Answer
Amazon SageMaker AI Async Inference now supports inline request payloads, allowing users to send inference data directly in the InvokeEndpointAsync API request body.
Quick Take
This enhancement eliminates the need for prior uploads to Amazon S3, streamlining the inference process for customers.
Key Points
- Inline payloads enhance efficiency by removing S3 upload requirements.
- Users can now directly send inference data in API requests.
- This update simplifies the overall workflow for SageMaker users.
- Amazon continues to improve its AI services with user-friendly features.
Source Excerpt
Today, we’re announcing inline payload support for Amazon SageMaker AI Async Inference. Customers can now send inference payloads directly in the request body of the InvokeEndpointAsync API, removing the need to upload input data to Amazon Simple Storage Service (Amazon S3) before each invocation.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from AWS Machine Learning
See more →
Build an explainable next-best-product recommendation system for banking on AWS
AWS presents a deep learning-based Next-Best-Product recommendation system for banks, utilizing Amazon SageMaker and PyTorch to enhance customer product predictions. This architecture leverages a multi-tower neural network for improved accuracy and explainability, addressing the complexities of customer data in financial services.
