Amazon has made a series of groundbreaking announcements, introducing Amazon Bedrock, Titan FMs, and CodeWhisperer. These innovative solutions aim to revolutionize the generative AI landscape and boost developer productivity across the board. In this article, we delve into the details of these exciting new offerings and explore how they are set to transform the way we build and scale AI-based applications.
Amazon Bedrock is a new service designed to make Foundation Models (FMs) from AI21 Labs, Anthropic, Stability AI, and Amazon easily accessible through an API. Bedrock aims to democratize access for all builders, allowing customers to effortlessly build and scale generative AI-based applications using FMs. With its serverless experience, Bedrock enables users to quickly find the right model, privately customize FMs with their own data, and seamlessly integrate and deploy them into their applications using familiar AWS tools and capabilities.
Bedrock offers access to some of the most advanced FMs available today, including the Jurassic-2 family of multilingual Large Language Models (LLMs) from AI21 Labs, Anthropic’s LLM, Claude, and Stability AI’s suite of text-to-image FMs. Bedrock’s customization capabilities make it simple for customers to fine-tune models for specific tasks, requiring only a few labeled examples.
Currently in limited preview, Bedrock has already garnered excitement from customers like Coda. Shishir Mehrotra, Co-founder and CEO of Coda, praises the speed and ease of incorporating generative AI using Bedrock, as well as the built-in security and privacy features.
Amazon is previewing two new Titan FMs, which will become more broadly available in the coming months. The first Titan model is a generative LLM for tasks such as summarization, text generation, classification, open-ended Q&A, and information extraction. The second is an embeddings LLM that translates text inputs into numerical representations, or embeddings, that contain semantic meaning. This LLM is useful for applications like personalization and search.
In line with responsible AI practices, Titan FMs are designed to detect and remove harmful content in the data, reject inappropriate user input, and filter outputs containing inappropriate content.
Amazon has announced the general availability of EC2 Trn1n instances, powered by AWS Trainium, and EC2 Inf2 instances, powered by AWS Inferentia2. These instances provide the most cost-effective cloud infrastructure for generative AI, ensuring optimal performance and cost control for ML training and inference.
The Trn1n instances offer 1600 Gbps of network bandwidth, designed to deliver 20% higher performance over the Trn1 instances for large, network-intensive models. The Inf2 instances, optimized for large-scale generative AI applications, deliver up to 4x higher throughput and up to 10x lower latency compared to previous generation Inferentia-based instances.
Amazon has announced the general availability of CodeWhisperer, an AI coding companion that uses an FM to boost developer productivity by generating code suggestions in real-time based on developers’ comments and prior code in their Integrated Development Environment (IDE). This tool allows developers
to focus on the creative aspects of coding while CodeWhisperer handles the repetitive, undifferentiated code generation.
During its preview, CodeWhisperer participants completed tasks 57% faster on average and were 27% more likely to complete them successfully compared to those who didn’t use the tool. This significant leap in developer productivity signals a promising future for the use of generative AI in coding.
Now available for Python, Java, JavaScript, TypeScript, C#, and ten additional languages, CodeWhisperer can be accessed from various IDEs through the AWS Toolkit IDE extensions. It has been trained on billions of lines of publicly available code and Amazon code, making it the most accurate, fastest, and secure way to generate code for AWS services like Amazon EC2, AWS Lambda, and Amazon S3.
CodeWhisperer is the only AI coding companion with built-in security scanning for detecting vulnerabilities and suggesting remediations. It also filters out biased or unfair code suggestions and flags code that resembles open source code requiring licensing or referencing.
Amazon offers CodeWhisperer for free to all individual users, with no qualifications or time limits. Business users can opt for the Professional Tier, which includes administration features like single sign-on (SSO) with AWS Identity and Access Management (IAM) integration and higher limits on security scanning.
Amazon’s unveiling of Bedrock, Titan FMs, and CodeWhisperer marks a turning point in the world of generative AI and developer productivity. By democratizing access to Foundation Models, providing cost-effective cloud infrastructure for AI, and boosting developer efficiency, Amazon is empowering organizations of all sizes to innovate and scale their AI-based applications.
As more customers integrate generative AI into their applications, Amazon’s commitment to performance, responsible AI, and cost control sets the stage for a new era of innovation. The future is bright for AI-powered applications, and Amazon’s latest offerings are just the beginning of what promises to be a transformative wave of ML advancements.
By: Darrin DeTorres
Darrin DeTorres is the founder and main contributor to the Taikover blog. As an expert marketer with 13 years of experience, he has been an early adopter of many emerging technologies. In 2009 he recognized the impact Social Media would have on businesses and subsequently helped many in Florida establish their social presence. Darrin also has had an interest in Cryptocurrency and the Block Chain. He is a contributor to the site, RunsOnCrypto.com. Darrin believes that AI will have an immediate impact on small businesses and is hoping to educate the masses on Artificial Intelligence via www.Taikover.com