Transformers: the Google scientists who pioneered an AI revolution
Here's a quote from the source site... Their paper paved the way for the rise of large language models. But all have since left the Silicon Valley giant. Like many breakthroughs in scientific discovery, the one that spurred an artificial intelligence revolution came from a moment of serendipity. In early 2017, two Google research scientists, Ashish Vaswani and Jakob Uszkoreit, were in a hallway of the search giant’s Mountain View campus, discussing a new idea for how to improve machine translation, the AI technology behind Google Translate. The AI researchers had been working with another colleague, Illia Polosukhin, on a concept they called “self-attention” that could radically speed up and augment how computers understand language. Polosukhin, a science fiction fan from Kharkiv in Ukraine, believed self-attention was a bit like the alien language in the film Arrival, which had just recently been released. The extraterrestrials’ fictional lang...