Ah, that makes sense. No, there's no early limit, but I just run away if I meet him that early, unless I'm going melee or unarmed specialist (which probably means I'm playing with IN<4). I mean, if I didn't tag any relevant combat skills, why should I be expected to win that fight?
The later...