I went to performance settings and set cache type to memcache, clicked save, and then all pages came up blank – it turned out that I'd not installed the php5-memcache package. It would be nice if moodle would say "your PHP doesn't have memcache support enabled" and then carry on with caching disabled.