That's very typical. Welcome to hunting in the Great Northwest, I think you have to work as hard to find them here as you do most anywhere. It just makes it that much more rewarding when that day comes. Good luck.
If you're lucky enough to be on private land and can leave your stand up during the off season you can tie an old piece of cloth or something of the sort to your stand. I like to use an old camo bandana that I have. That way the deer get used to the movement and eventually don't bother even looking up when there is slight movement. This may just give you the time to draw your bow or raise your gun without being detected.