Yeah, but that makes the all-or-nothing proposition de-facto useless. Laws will be passed that punish unpopular speech not for their content, but for the harm they cause [society|our children|national security|economic security].

Technically, the speech was allowed. But when harms can be conjured up for any scenario, the speech is not really free anymore.

I'm NOT saying that libel, slander, defamation, and incitement shouldn't be actionable things. I'm just saying that it's impossible to allow all types of speech unless you're willing to strike those concepts altogether.