Stability AI Team Introduces FreeWilly1 and FreeWilly2: New Open Access Large Language Models (LLMs)

 Here's a quote from the source site...

FreeWilly1 and its successor FreeWilly2 are powerful new open-source Large Language Models (LLMs) developed by Stability AI’s CarperAI team. Both models perform exceptionally well in reasoning competitions using many different metrics. Supervised fine-tuning (SFT) in the industry-standard Alpaca format was used to fine-tune the FreeWilly1 model, built on top of the original LLaMA 65B foundation model. FreeWilly2 uses the LLaMA 2 70B base model to achieve performance on par with GPT-3.5 on some tasks.

We are live! The "Ai For Creative Expression" Course is now available at https://aiart.getlearnworlds.com/ for anyone to create incredible artistic works like this


The FreeWilly models’ training was heavily influenced by Microsoft’s ground-breaking approach, described in the article “Orca: Progressive Learning from Complex Explanation Traces of GPT-4.” The team prompted language models with high-quality instructions to generate our copy of the dataset, which contains 600,000 data points (approximately 10% of the dataset size utilized in the original Orca work).

Using this method, the researchers generated 500,000 cases using a less complex LLM model and an extra 100,000 using a more complex LLM model. They thoroughly screened these datasets, removing cases originating from evaluation benchmarks to guarantee valid comparisons. Their approach to synthetically generated datasets is validated by the FreeWilly models performing exceptionally well across multiple benchmarks despite training on only a tenth of the sample size used in the original Orca paper.

Read more at https://www.marktechpost.com/2023/07/23/stability-ai-team-introduces-freewilly1-and-freewilly2-new-open-access-large-language-models-llms/

Comments

Post a Comment

Popular posts from this blog

As AI porn generators get better, the stakes get higher

Image
 Here's a quote from the sources site... Porn generators have improved while the ethics around them become stickier A s generative AI enters   the mainstream, so, too, does AI-generated porn. And like its more respectable sibling, it’s improving. When TechCrunch  covered  efforts to create AI porn generators nearly a year ago, the apps were nascent and relatively few and far between. And the results weren’t what anyone would call “good.” The apps and the AI models underpinning them struggled to understand the nuances of anatomy, often generating physically bizarre subjects that wouldn’t be out of place in a Cronenberg film. People in the synthetic porn had extra limbs or a nipple where their nose should be, among other disconcerting, fleshy contortions. Fast-forward to today, and a search for “AI porn generator” turns up dozens of results across the web — many of which are free to use. As for the images, while they aren’t perfect, some could well be mistaken for prof...
Read more

Thales boosts cybersecurity credentials with $3.6bn Imperva acquisition

Image
 Here's a quote from the source site... The French defence contractor sees a future in cyber – as well as kinetic – warfare, and is building its business accordingly. Thales is beefing up its  cybersecurity  offering with the acquisition of US vendor Imperva for $3.6bn. The news, which comes hot on the heels of the company’s planned $1.1bn purchase of Cobham Aerospace Communications, reflects a growing focus on cyber – rather than kinetic – warfare from the French defence contractor. We are live! The "Ai For Creative Expression" Course is now available at  https://aiart.getlearnworlds.com/  for anyone to create incredible artistic works like this Shares in Thales fell when the announcement was made on Tuesday morning. Imperva is currently owned by tech private equity firm  Thoma Bravo , and the deal is expected to close next year, a Thales statement said. What is Thales getting by purchasing Imperva? Founded in 2002, US-headquartered Imperva operates in 180...
Read more