I never have liked carrying my rifle anywhere besides in my hands or arms.
I have a pack with the rifle sleeve and I just don't like it. I was asked once why I wasn't using it and I just said that I use my rifle as a counter balance when hiking, it has helped me to avoid a few spills.