This is a HPC guide for newbies. You DO NOT have to see into it but at a glance.

1. History

Wikipedia is good.
https://en.wikipedia.org/wiki/Supercomputer

2. Stack

2.1. Hardware

Storage
Network
Server
Cooler

2.2. Software

Infrastructure deployment
Parallel Filesystem
Workload Management
Development