The Overseer was trying to do his job of making sure people stay in the Vault until it's meant to open, not because he thought everyone in the wasteland was a bloodthirsty savage (or a mutant that needed to be put down)
And yes, I agree that it's not all about brainwashing, but I seriously...