Well, try to avoid the Enclave until you get the power armor. Also, you didn't go with the best choice of perks, but that's not too serious. Other than that, you should not have a lot of problems with that build. That the only thing that should bother you are enemy criticals.
If you're thinking of restarting, try to get perks that enhance your HtH fighting, and give you more action points. That should make things a bit easier.