So this is Gatekeeper in action. (the non-MAS version of my Mac App)