Can stress really stop me from orgasming?

It can. Arousal depends on being able to relax and focus on sensation, and stress, anxiety and distraction all compete for your attention. Worrying about whether you'll orgasm adds another layer of pressure. Slowing down, taking orgasm off the table for a while and practicing mindful, sensation-focused touch can help. If anxiety is affecting your life more broadly, consider talking to a professional.