Reading

Papers

paper
Attention Is All You Need

Vaswani et al., NeurIPS 2017

The architecture is elegant but the training stability tricks in the appendix are what made it work in practice.


paper
Dynamo: Amazon's Highly Available Key-value Store

DeCandia et al., SOSP 2007

Read this to understand eventual consistency — not the theory, the engineering tradeoffs.


paper
Reflections on Trusting Trust

Ken Thompson, Turing Award Lecture 1984

Four pages. Changed how I think about software supply chains permanently.


paper
In Search of an Understandable Consensus Algorithm (Raft)

Ongaro & Ousterhout, USENIX ATC 2014

If you've only read the Paxos papers, read this. Same guarantees, actually implementable.

Blogs & Essays

blog
Ephemeralization

Paul Graham


blog
The Grug Brained Developer

grugbrain.dev

Complexity is the enemy. Return to this every six months.

Books

book
A Philosophy of Software Design

John Ousterhout

Better than Clean Code for experienced engineers. Deep modules, not shallow ones.


book
The Art of Doing Science and Engineering

Richard Hamming

Chapter on "You and Your Research" is worth the whole book.


book
The Feynman Lectures on Computation

Richard Feynman

Reversible computing and the thermodynamics of information. Underhyped.