The Overview of GPU architecture components includes various key elements such as GPU Core Architecture, Shader Cores, Control Units, and Execution Units. These components work together to process data efficiently and handle complex graphics rendering tasks. Additionally, the Memory Hierarchy, including Register File, Shared Memory, L1/L2 Cache, Global Memory, Constant Memory, and Texture Memory, plays a crucial role in storing and accessing data quickly for improved performance.