My thoughts, too.
Also, I would like this to extend to my dialogue choices. I know it (at times) impacts my Faction Rep, but certain options are purely evil/cruel and should be hit with the negative Karma, too. Or the quests that I agreed to complete - but for a price - should not grant...