You have no right to utter those words. The only thing that held you back from asking her was yourself. What held him back was her. He perfectly knew her thoughts and he respected every bit of them. He certainly had second thoughts but in the end, he kept his resolution. He dared not break her again, while you only feared to break yourself.
You said none of them had to try hard. That he didn't need to. After all, they were closer than you and her together, but that's just bullshit. You're just a bystander. You know nothing of what they have gone through.You are completely clueless that the smiles you see from them now are products of their resilience. Tears were shed and hearts were broken but they held on.
When you see them walk together, the only thing that goes through your mind is that you should have been him. It has always been about yourself never about them, never about her. Always do you tell her that you will protect her but do you not see that she already has her knight?