That is the trouble in rasing deer in a high fence area like live stock. They can alter the genes to where there is massive antler growth. This increases the trophy potental for someone that wants to buy the antlers by the scoring inch but can never really brag about it.
If you're lucky enough to be on private land and can leave your stand up during the off season you can tie an old piece of cloth or something of the sort to your stand. I like to use an old camo bandana that I have. That way the deer get used to the movement and eventually don't bother even looking up when there is slight movement. This may just give you the time to draw your bow or raise your gun without being detected.