Llama 3.1, the most recent iteration of Meta’s artificial intelligence technology, was unveiled on Tuesday.
There are three versions of the newest Llama technology available; the largest and most powerful AI model produced by Meta to date is found in one version.
The most recent Llama model is still accessible for free since, like earlier iterations, it is open source.
According to Meta, Llama 3.1 405B, a model with 405 billion parameters, will be released.
A model’s ability to solve problems is closely correlated with its parameters, and models with more parameters typically perform better than those with fewer.
In April of last year, Meta hinted that it was developing an open-source model that would outperform the best private models from OpenAI and other businesses, a first for the AI sector.
With this most recent release, Meta demonstrates that there are other ways to develop AI besides the closed method that the majority of AI businesses support.
However, the business is also positioning itself at the forefront of the discussion over the risks associated with releasing AI unchecked.
By default, Llama is trained by Meta to avoid providing damaging output; however, this protection can be removed from the model through modification.
Along with expanding the Llama-based Meta AI assistant’s language and country of availability, it also adds a capability that allows it to create graphics based on a person’s unique likeness.
By the end of this year, CEO Mark Zuckerberg now believes Meta AI to overtake ChatGPT as the most popular assistant.
Newsng gathered that a dataset of 15 trillion tokens from 2024 was utilised by Meta to train Llama 3.1 405B.
Tokens are word fragments that are easier for models to internalise than entire words; 15 trillion tokens is an astounding 750 billion words.
Although Meta utilised the base set to train previous Llama models, so it’s not exactly a new training set, the company says that in generating this model, it improved its data curation processes and used “more rigorous” approaches to quality assurance and data filtering.
We earlier reported that Meta has been fined $220 million by the Nigerian government for allegedly breaking local consumer, data protection, and privacy laws.