Model Whisperers: How Evals and Prompts Shape Agent Behavior