The White House is downplaying some behind-the-scenes remarks made about the budget battle that were caught on tape.