Google Launches New AI Chip TPU v5e: Training Performance Boosted by 2x, Reasoning Performance Boosted by 2.5x
Views : 313
Update time : 2023-09-01 10:36:47
Google has announced a series of new artificial intelligence technologies and partnerships aimed at introducing more constantly evolving technologies to large enterprises. Google has also released a new version of customized artificial intelligence chips.
Google stated that Cloud TPU v5e has now launched a preview version and is the latest version of its internal Tensor processing unit. Google stated that compared to the TPU v4 released in 2021, for large language models and generative AI models, the chip's training performance per dollar has been improved by up to 2 times, and the inference performance per dollar has been improved by up to 2.5 times. The cost of TPU v5e is less than half that of TPU v4, enabling more organizations to train and deploy larger and more complex AI models. Google stated that "the TPU v5e Pod balances performance, flexibility, and efficiency, allowing up to 256 chips to interconnect, with a total bandwidth exceeding 400Tb/s and INT8 performance reaching 100 petaOps Google Blog stated that the new TPU will provide eight different virtual machine configurations, ranging from one TPU chip to over 250 TPU chips in a single chip. For customers who need more computing, the company is launching "Multislice", a service that hands over models to tens of thousands of TPU chips for computing. So far, training assignments using TPU are limited to a single TPU chip slice, and the maximum job slice size for TPU v4 is 3072 chips With Multislice, developers can scale workloads across multiple Pods to tens of thousands of chips within a single Pod through inter chip interconnection (ICI) or through data center networks (DCN) In addition to the new TPU, Google also stated that the A3 Virtual Machine (VM) will be fully launched in September, equipped with 8 Nvidia H100 GPUs, dual fourth generation Intel Xeon scalable processors, and 2TB of memory. These instances were initially announced in May this year and can be increased to 26000 Nvidia H100 Hopper GPUs. However, given the continuous shortage of GPUs, it is currently unclear how many H100 units Google will have. Google stated that Anthropic, a generative artificial intelligence startup, was an early user of the new TPU v5e and A3 VM. Although Google has invested $300 million in this startup, it is also a loyal user of Amazon AWS
The LDK220 series of low-dropout linear regulators (LDOs) is a high-performance device designed specifically for low-power consumption and high-precision voltage regulation, widely used in scenarios such as consumer electronics, industrial control, and po
Xilinx Spartan®-7 FPGA Family stands as a defining solution in the mid-range FPGA landscape, blending high performance, energy efficiency, and cost-effectiveness to redefine versatility for industrial, IoT, and consumer electronics applications. Built on
The Altera FLEX series was more than a lineup of FPGAs—it was a blueprint for how programmable logic devices could evolve to meet diverse market needs. The FLEX 8000 laid the architectural groundwork, the FLEX 10K redefined functionality with embedded mem
Among TI standout offerings, the LM4765 and LM4766 are dual-channel amplifiers designed to cater to diverse audio needs—from compact setups to high-fidelity systems. While sharing the same product lineage, these chips differ significantly in power output,
