Google claims its new AI software cuts inference latency by over 90% — but there’s a catch

Google’s eighth-generation TPU announcement on Monday included more than new chips, introducing TPU Sync, an open-source system designed to speed The post Google claims its new AI software cuts inference latency by over 90% — but there’s a
Read the original at The New Stack ↗