A Survey Comparing Specialized Hardware and Evolution in CPU, GPU AND TPU for Neural Network

• Author(s): Francis Chigozie ; Odikwa Ndubuisi ; Onyemaobi Bethram Chibuzo
• Paper ID: 1707828
• Page: 1296-1305
• Published Date: 08-05-2025
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 8 Issue 10 April-2025

Abstract

This survey paper is focused on the genesis of GPU AND TPU from first generation and their architectures. The paper compares CPUs, GPUs, and TPUs, their hardware architectures, their similarities and differences were extensively discussed. The batch of data are immensely used these days but they require more time, computation and energy. Due to the greater demand and attractive options for architects to explore, companies are continuously working to reduce training and inference response time. Pertinent to the demands and cost factors different kinds of ASICs (application specific integrated circuits) are developed and research is increased in this area. Many models of CPUs, GPUs and TPUs have been developed to support these networks and to improve training and inference phase. The hardware of CPUs and GPUs can be sold to businesses while Google offers TPU processing for everyone from the cloud. When the data is away from the computational source, it increases the overall cost and to reduce this cost companies implements memory management and caching techniques close to ALUs.

Keywords

GPU, TPU, CPU, Deep Learning, ALU, framework.

Citations

IRE Journals:
Francis Chigozie , Odikwa Ndubuisi , Onyemaobi Bethram Chibuzo "A Survey Comparing Specialized Hardware and Evolution in CPU, GPU AND TPU for Neural Network" Iconic Research And Engineering Journals Volume 8 Issue 10 2025 Page 1296-1305

IEEE:
Francis Chigozie , Odikwa Ndubuisi , Onyemaobi Bethram Chibuzo "A Survey Comparing Specialized Hardware and Evolution in CPU, GPU AND TPU for Neural Network" Iconic Research And Engineering Journals, 8(10)