"Then I abandoned my orders. And my partner. I stopped fighting."

It's as simple as that, as far as he's concerned. The details and motivation don't matter as much as the results. People died because of him. It explains well enough why Wash would be cautious leaving a teammate -- or former teammate -- in his charge.

He's no longer looking at York, not directly, his gaze focused on some point off to the side.