header banner
Default

Slashdot: AWS Customers Can Now Rent Nvidia GPUs for Speedy AI Projects Through a New Service


Table of Contents

    An anonymous reader quotes a report from TechCrunch: More and more companies are running large language models, which require access to GPUs. The most popular of those by far are from Nvidia, making them expensive and often in short supply. Renting a long-term instance from a cloud provider when you only need access to these costly resources for a single job, doesn't necessarily make sense. To help solve that problem, AWS launched Amazon Elastic Compute Cloud (EC2) Capacity Blocks for ML today, enabling customers to buy access to these GPUs for a defined amount of time, typically to run some sort of AI-related job such as training a machine learning model or running an experiment with an existing model.

    The product gives customers access to NVIDIA H100 Tensor Core GPUs instances in cluster sizes of one to 64 instances with 8 GPUs per instance. They can reserve time for up to 14 days in 1-day increments, up to 8 weeks in advance. When the timeframe is over, the instances will shut down automatically. The new product enables users to sign up for a the number of instances they need for defined block of time, just like reserving a hotel room for a certain number of days (as the company put it). From the customer's perspective, they will know exactly how long the job will run, how many GPUs they'll use and how much it will cost up front, giving them cost certainty. As a users sign up for the service, its displays the total cost for the timeframe and resources. Users can dial that up or down, depending on their resource appetite and budgets before agreeing to buy. The new feature is generally available starting today in the AWS US East (Ohio) region.

    Sources


    Article information

    Author: Jennifer Estrada

    Last Updated: 1700172122

    Views: 1614

    Rating: 4.5 / 5 (109 voted)

    Reviews: 88% of readers found this page helpful

    Author information

    Name: Jennifer Estrada

    Birthday: 1989-11-25

    Address: 4138 Mack Path, Taramouth, WY 26056

    Phone: +4106398509102339

    Job: Pharmaceutical Sales Rep

    Hobby: Astronomy, Cycling, Bird Watching, Camping, Chess, Cooking, Reading

    Introduction: My name is Jennifer Estrada, I am a accessible, expert, unguarded, venturesome, apt, fearless, enterprising person who loves writing and wants to share my knowledge and understanding with you.