Your pins might not be parallel to your string, your sight axis is likely off or the sight bar is not flush to the bow. Especially if you are using different pins at further distances...and the further you go the further out it is. It could also be fletching contact to your rest.
Like was stated, what is your setup?
LC
__________________
|