I do it all the time. We have so many deer here that I see at least 5 evey time I am in the stand. I have left my bow hang on the rope while I watched 17 feed under me.
I think you are a sportsman. Our deer NEED thinned, but when you see few and let one walk, I admire you.