OpenAI's new GPT-4 language model showcases remarkable advances in AI, with multimodality and scan-and-solve capabilities pushing the frontier of machine understanding. However, as GPT-4 gains impressive skills, it also inherits familiar flaws. This newsletter explores what GPT-4 can do, its technical architecture, and why we should temper our enthusiasm with realism.