Exciting developments in GPU interconnect speeds - Nvidia's A100/H100 at 600/900 GB/s with a promise of 1.8 TB/s by Blackwell. Faster data transfer between GPUs than reading from RAM. Important to consider compute and bandwidth in decentralized AI workloads. #NearIndia