Transformers: the Google scientists who pioneered an AI revolution

 Here's a quote from the source site...

Their paper paved the way for the rise of large language models. But all have since left the Silicon Valley giant.


Like many breakthroughs in scientific discovery, the one that spurred an artificial intelligence revolution came from a moment of serendipity. 

 In early 2017, two Google research scientists, Ashish Vaswani and Jakob Uszkoreit, were in a hallway of the search giant’s Mountain View campus, discussing a new idea for how to improve machine translation, the AI technology behind Google Translate. 

 The AI researchers had been working with another colleague, Illia Polosukhin, on a concept they called “self-attention” that could radically speed up and augment how computers understand language. 

 Polosukhin, a science fiction fan from Kharkiv in Ukraine, believed self-attention was a bit like the alien language in the film Arrival, which had just recently been released. The extraterrestrials’ fictional language did not contain linear sequences of words. Instead, they generated entire sentences using a single symbol that represented an idea or a concept, which human linguists had to decode as a whole.

Read more at https://www.ft.com/content/37bb01af-ee46-4483-982f-ef3921436a50

We are live! The "Ai For Creative Expression" Course is now available at https://aiart.getlearnworlds.com/ for anyone to create incredible artistic works like this

Comments

Post a Comment

Popular posts from this blog

As AI porn generators get better, the stakes get higher

Image
 Here's a quote from the sources site... Porn generators have improved while the ethics around them become stickier A s generative AI enters   the mainstream, so, too, does AI-generated porn. And like its more respectable sibling, it’s improving. When TechCrunch  covered  efforts to create AI porn generators nearly a year ago, the apps were nascent and relatively few and far between. And the results weren’t what anyone would call “good.” The apps and the AI models underpinning them struggled to understand the nuances of anatomy, often generating physically bizarre subjects that wouldn’t be out of place in a Cronenberg film. People in the synthetic porn had extra limbs or a nipple where their nose should be, among other disconcerting, fleshy contortions. Fast-forward to today, and a search for “AI porn generator” turns up dozens of results across the web — many of which are free to use. As for the images, while they aren’t perfect, some could well be mistaken for prof...
Read more

Thales boosts cybersecurity credentials with $3.6bn Imperva acquisition

Image
 Here's a quote from the source site... The French defence contractor sees a future in cyber – as well as kinetic – warfare, and is building its business accordingly. Thales is beefing up its  cybersecurity  offering with the acquisition of US vendor Imperva for $3.6bn. The news, which comes hot on the heels of the company’s planned $1.1bn purchase of Cobham Aerospace Communications, reflects a growing focus on cyber – rather than kinetic – warfare from the French defence contractor. We are live! The "Ai For Creative Expression" Course is now available at  https://aiart.getlearnworlds.com/  for anyone to create incredible artistic works like this Shares in Thales fell when the announcement was made on Tuesday morning. Imperva is currently owned by tech private equity firm  Thoma Bravo , and the deal is expected to close next year, a Thales statement said. What is Thales getting by purchasing Imperva? Founded in 2002, US-headquartered Imperva operates in 180...
Read more

Stability AI Team Introduces FreeWilly1 and FreeWilly2: New Open Access Large Language Models (LLMs)

Image
 Here's a quote from the source site... FreeWilly1 and its successor FreeWilly2 are powerful new open-source Large Language Models (LLMs) developed by Stability AI’s CarperAI team. Both models perform exceptionally well in reasoning competitions using many different metrics. Supervised fine-tuning (SFT) in the industry-standard Alpaca format was used to fine-tune the FreeWilly1 model, built on top of the original LLaMA 65B foundation model. FreeWilly2 uses the LLaMA 2 70B base model to achieve performance on par with GPT-3.5 on some tasks. We are live! The "Ai For Creative Expression" Course is now available at  https://aiart.getlearnworlds.com/  for anyone to create incredible artistic works like this The FreeWilly models’ training was heavily influenced by Microsoft’s ground-breaking approach, described in the article “Orca: Progressive Learning from Complex Explanation Traces of GPT-4.” The team prompted language models with high-quality instructions to generate our co...
Read more