This one and your other article yesterday on Google's Titans architecture show Google's attention (unintended pun) to actually correcting some of the serious limitations in current Transformer AIs. Very good for Google.

Meanwhile OpenAI is putting effort into porn.

It's embarrassing, isn't it?