I have....many times. Its all situational though. I didn't rifle hunt for 7 years or so until last season. I got to where I was only hunting with my bow. But a lot of times, when I was rifle hunting, I had 2 sets or more on the same property. Some were in some pretty thick areas where I would only use my bow. Others aloud for further shots and I'd have my rifle with me to hunt them if the wind wasn't right in the thick sets, and vice versa. I have even had them both in the stand with me a few times. My main rifle has a 4.5x14 pwr scope and inside of about 25 yards it can be hard to get on the target very quickly.
Now, having said that. Its a pain in the butt taking both sometimes. A bow takes up a pretty decent profile, especially when its cased. And I look like Sanford and Son when I go hunting as it is. If I'm already taking the bow like it sounds from you above. Then adding a rifle isn't an issue. Adding a bow sometimes can be because of the room it takes up and such. Good luck!!