If you interact with someone I don't care for a lot, I might mess around and unfollow you too.