You read the history of those veterans who endured wars and came out with ptsd but managed to survive it?
Strong people who fought against a lot of trauma and pain. When hit by infidelity and experienced that ptsd, then they broke. They survived war but not betrayal.
To put into perspective, because all traumas are bad and worth of respect we are not playing rank the worst, however this is what your husband chose to put you through.
Maybe as a ex military this lands in his thick, selfish skull.
He now shift blame because you can’t "be so bad to confront him as he is so down".
I would say he is right.
Leave him get comfort with phone sex online flirts and all the thing he likes. They can take care of his ass.
You girl, pack your stuff and go take care of your trauma, friends or family, some short weekend trip if you can get it, in a word breathe.
While doing the hard 180.
If the narcissist finds out that is strange wifey is not showing up at his service, he will come around. And find the door closed.
Maybe that will give him pause to understand just how fucked up he is, and if he starts seriously working on his gigantic issues, then and only then you can maybe, if you still want, confront him and demand to spill the beans about his lies and manipulation. And drop him again at the first sign of lies and trickle truths.
Put yourself first girl. You are the victim of abuse her.
Not your abuser caretaker