I agree with this. His character was written in a way that seemed a bit fatalistic, but also very loyal. Possibly he would regret not having fought more for Elizabeth, but I don't think he would have been ready for family life. And quite honestly, the combination of a black man and a white woman at that time would have made living under cover more difficult.