What you’re calling “labelling” here is no longer “labelling” in the strict machine learning sense. It’s much more ambiguous.
I’m glad we agree. As long as language is not necessary for your version of “labelling” I think we still agree.
But the labelling is occurring outside the internal representation, within the consensus reality. Language is necessary for this type of labelling.