Nvidia’s new graphics card is $3,000, painted gold, and not meant for graphics
New card does have video outputs, but it’s intended for computation and machine learning.
Unlike the Tesla cards, the Titan V is a proper graphics card. It has three DisplayPort and one HDMI outputs, it uses the standard GeForce driver stack, and it will play games. It’ll probably play them quite well, although Nvidia hasn’t made any gaming performance claims thus far. That’s because, although it’s a graphics card, it’s not really being aimed at graphics applications. Rather, it’s being aimed at the same kinds of GPU-based computation (especially machine learning) applications that the Tesla cards are meant for, just on a slightly smaller scale. Titan V would be used in a workstation PC, rather than a compute cluster in a datacenter.
With these similar roles in mind, it’s not too surprising that Titan V’s specs are extremely similar to Tesla V100’s. Both cards have 5,120 compute cores, and both have 640 machine learning-oriented “tensor cores” that specialize in 4×4 matrix arithmetic. Exact clock speeds for the Tesla cards aren’t known, but Titan V can boost to 1.455GHz, slightly more than V100’s 1.370GHz. It’s the memory subsystem that has the biggest difference: Titan V has 12GB of HBM2 memory, with a 3,072-bit memory bus. Tesla V100 has 16GB of HBM2 and a 4,096-bit bus. The Titan’s memory is also a hair slower, clocked at 1.70Gb/s compared to 1.75Gb/s.
Taken together, the new card has almost identical computational performance—13.8 trillion single precision floating point operations per second, 6.9 double precision TFLOPS, and 110 reduced precision machine learning TFLOPS in Titan V, compared to 14 single precision, seven double precision, and 112 machine learning TFLOPS on V100—but with memory bandwidth of a mere 653GB/s, compared to 900GB/s for the compute card.
The high price and compute focus mean that in spite of its physical appearance, the Titan V is aimed pretty squarely at the “Pro” side of the “prosumer” customer that the Titan line has traditionally been aimed at. It’s inevitable that some deep-pocketed gamers will pick up a Titan V and use it as nothing more than a graphics card, but that’s certainly not the core market.