The only way you can make this argument work is if you’re talking about celebrities and such who have insisted that they don’t feel comfortable with smut art and fan fiction being made of them just to have people (mostly kids on tumblr) go ahead and do it anyway.
Other than that, no. It really doesn’t work. And the fact that people keep pushing this argument and expecting different results is madness in definition.