The Limits of Direct Attention