This came out yesterday. I’m surprised no one is talking about it yet. It is really impressive.
Basically you create an NLP DL network that is really really big, then you show it the entire internet. Now by handing it a blurb of text, it will generate more text with the same sentiment, and the text is extremely convincing (it reads like human text). That’s because it sampled huge amounts of human text and is putting it together from millions of sources (the model has 7.5 Billion parameters).
Here is thoughtful take from @Carlos_Perez:
This is going to feed the idea that to get to AGI we just need to create bigger deep learning systems. But of course we know this is still just a clever probabilistic model.
The repurcussions of this weak AI technology is still staggering. Our world is changing fast.