Google TPU (Tensor Processing Units)

What:

GPU are a general-purpose parallel processor. TPUs are “tensor” processing units - silicon designed specifically for doing matrix multiplication (compiled by TensorFlow’s / PyTorch’s compiler).

GPUs enable complex control logic. TPUs don’t.