Tenstorrent Wormhole-based Developer Kits and Workstations are Designed for AI Tasks

Tenstorrent has released four new products based on their next-generation Wormhole chip, designed for scalable multi-chip development. These include the TT-QuietBox Workstation, Wormhole-based N300 PCIe Card, Wormhole n150 and n300 Developer Kits, and TT-LoudBox Workstation. The new products build upon Tenstorrent’s first Grayskull AI Dev kits and leverage the company’s open-source software stacks for advancements in AI software development.

The TT-QuietBox is a $15,000 liquid-cooled workstation for AI development, featuring 8 Wormhole processors (4x n300 cards) and a 96GB memory pool. Its quiet operation makes it ideal for various environments. It includes an AMD EPYC 8124P CPU, 512GB DDR5 memory, 4TB NVMe storage, and various connectivity options.

The n300s has dual Wormhole ASICs (128 Tensix Cores @ 1 GHz), 192MB SRAM, 24GB GDDR6 (12 GT/sec, 576 GB/sec). It achieves 466 TeraFLOPs (FP8) at 300W. Connectivity includes 2x Warp 100 Bridge, 2x QSFP-DD 400GbE, and PCIe 4.0 x16. Default cooling is passive with optional active cooling.

The n150s features a Wormhole ASIC with 72 Tensix Cores running at 1 GHz, along with  108MB SRAM, and can be configured with 12GB GDDR6 memory with 12 GT/sec, and 288 GB/sec bandwidth respectively. The ASIC can deliver 262 TeraFLOPs (FP8) at 160W power. In terms of connectivity, it features 2x Warp 100 Bridge, 2x QSFP-DD 400GbE, and PCIe 4.0 x16. Default cooling is passive with optional active cooling.

The TT-LoudBox is a $12,000 4U rack-mounted workstation designed for AI development. It features 8 Wormhole processors (4x n300s cards) with a 96GB memory pool, supporting models up to 80 billion parameters. It includes two Intel Xeon Silver 4309Y CPUs, 512GB DDR4 memory, 3.8TB NVMe storage, and various connectivity options.

TT-QuietBox and TT-LoudBox are supported by open-source SDKs TT-Buda (high-level) and TT-Metalium (low-level). The n150 and n300 kits support various data precision formats: FP8, FP16, BF16, FP32 (output), BFP2, BFP4, BFP8, INT8, INT32 (output), UINT8, TF32, VTF19, VFP32, enhancing versatility for AI and computing tasks.

Tenstorrent’s Wormhole n150s is available for $999, while the Wormhole n300s is priced at $1,399. The company also offers two workstation options: the TT-QuietBox for $15,000 and the TT-LoudBox for $12,000.

by linuxgizmos

Please follow and like us: