I have low blood pressure just like you. I'm very athletic though, that's the reason for my low pressure and pulse.
I have taken it on as as needed basis (for esophageal spasms) for 16 years. I can tell you that there is no contraindication for the xanax and benedryl. I had an allergic reaction to eating sea salt a few years ago. I broke out in hives all over. I too was concerned about this combo, so I called the pharmacist and he said to definitely take the benedryl.
The only effect would be that I'd have the best nights sleep ever, he said chuckling.
I since have confirmed the above with my physician as well.