Jamba在具有至少80GB显存的单个GPU（如A100）上运行时，可以处理多达140,000个token。 这相当于大约105,000字，或210页，是一本长度适中的长篇小说的篇幅。

The Ampere server could either be eight GPUs working together for training, or it could be 56 GPUs made for inference,' Nvidia CEO Jensen Huang says of the chipmaker's game changing A100 GPU.

Game Changing For The Data Center' Nvidia executive Ian Buck said the chipmaker's new A100 GPU will future-proof data centers for artificial intelligence workloads thanks to the processor's ...