That's silly as well... I hate smokers. To me, their charisma doesn't improve, even better, it decreases.
So it would really depend on who you are talking to. Imagine talking to Lynette smoking a cig compared to doing the same thing around Lara from the Den. (also depends on their sex)