Yea, that sounds similar to how I have always tended to view it - that taking care of my body is an important part of taking care of myself, and therefore sort of indirectly spiritual, in that we experience all of our life, including our spirituality, at least partly through our bodies. But Tibetan yantra yoga, and kundalini yoga in the Indian traditions, are interesting variations on this - the poses are actually meant to trigger openings in the chakras and related channels, providing 'doorways' into profound spiritual realizations. And in some karate forms that emphasize Zen, being one with the movement is also considered a spiritual doorway in and of itself, which I can also relate to.