What's the wiccan rede?
Do what you will, harm ye none.
I agree you can't have people manipulating others by magical will, it'll just be a rather weak work, a bit like the most awful film ever, The Wickerman.
You could have the character of the witch use her personality and intelligence...