Here are a list of study materials that I highly recommend:

<h2>TextBooks</h2>
<dl>
  <dt><a href="https://link.springer.com/referencework/10.1007/978-0-387-09766-4">Encyclopedia of Parallel Computing</a></dt>
  <dd>A comprehensive book about key concepts in parallel computing. Entries are all written by established researchers in the field.</dd>

  <dt><a href="https://shop.elsevier.com/books/optimizing-compilers-for-modern-architectures/allen/978-0-08-051324-9">Optimizing Compilers For Modern Architectures; A Dependence Based Approach</a></dt>
  <dd>A classic textbook on auto-parallelization and locality optimizations.</dd>
</dl>

<h2>Online Courses</h2>
<dl>
  <dt><a href="https://sites.google.com/lbl.gov/cs267-spr2021?pli=1">UC Berkeley CS267 - Applications of Parallel Computers</a></dt>
  <dd>A great course covering an overview of the parallel architecture, some of the most popular parallel programming tools and a broad set of parallelization strategies.</dd>
  <dt><a href="https://ocw.mit.edu/courses/6-172-performance-engineering-of-software-systems-fall-2018/">MIT 6.172 - Performance Engineering of Software Systems</a></dt>
  <dd>Topics include performance analysis, algorithmic techniques for high performance, instruction-level optimizations, caching optimizations, parallel programming, and building scalable systems.</dd>
</dl>


<h2>CUDA Programming Tutorials</h2>
<dl>
  <dt><a href="https://www.olcf.ornl.gov/cuda-training-series/">CUDA Training Series</a></dt>
  <dd>The best CUDA tutorial for beginners I've ever seen. Recordings are available for each chapter.</dd>
  <dt><a href="https://www.youtube.com/watch?v=F620ommtjqk&list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2&ab_channel=Udacity">Intro to Parallel Programming</a><dt>
    <dd>A great online course by Prof. David Owens that covers fundamental ideas of parallel programming, and teaches CUDA programming. The interview parts is a bonus.</dd>
</dl>



<h2>Historical Perspectives</h2>
<dl>
  <dt><a href="https://link.springer.com/book/10.1007/978-3-031-01768-1">Parallel Processing, 1980 to 2020</a></dt>
  <dd>A historical survey of parallel processing by Robert Kuhn and David Padua.</dd>
</dl>

<h2>Seminars (Latest Research Topics)</h2>
<dl>
  <dt><a href="https://www.youtube.com/@spcl/featured">SPCL Bcast</a></dt>
  <dd>An online seminar series that covers a broad range of topics around parallel and high-performance computing, scalable machine learning, etc from SPCL at ETH.</dd>

  <dt><a href="https://link.springer.com/book/10.1007/978-3-031-01768-1">MIT Fast Code Seminar</a></dt>
  <dd>A great seminar series on the theory and practice of performance engineering.</dd>
</dl>