This is a HPC guide for newbies. You DO NOT have to see into it but at a glance.
1. History
Wikipedia is good.
https://en.wikipedia.org/wiki/Supercomputer
2. Stack
2.1. Hardware
Storage
Network
Server
Cooler
2.2. Software
Infrastructure deployment
Parallel Filesystem
Workload Management
Development