Then they don't know what it is to lead.

[He's aware enough to realize that he might not have wanted those leadership roles, but others had given them to him because they believed he would be good at it, and trusted him to do it. He supposes that was all he had ever wanted -- for his bastard status not to be a factor in something for once.]

That seems appropriate. All I can do is hope that I didn't let anyone down, except that I know that I did.