Challenge OpenAI! Israel AI21 Labs launches latest language model: Jurassic-X

Recently, AI21 Labs completed a US$64 million Series B financing, valuing the company at US$664 million. This round of financing was led by Allen Innovation Capital Fund, with participation from Mobileye CEO and co-founder Amnon Shashua, Walden Catalyst, Pitango, TPY Capital and Mark Leslie, bringing A21 Labs’ total financing to $118.5 million.

AI21 Labs was co-founded in 2017 by Goshen, Shashua and Stanford University professor Yoav Shoham. The company's first product is Wordtune, an AI-powered writing aid designed to compete with Grammarly that suggests new wording as users type. In August last year, AI21 released the platform AI Studio and launched a "pay-as-you-go" service for the Jurassic-1 model - developers can customize the model and fine-tune it based on the unique data sets they require.

Jurassic-1 series models can be used for paraphrasing (such as generating short product names from product descriptions), extracting numbers from text, by topic or category tag emails and notes. These models can also summarize content, including snippets of articles, reports, and PDF files, through a feature in Wordtune called Wordtune Read.

However, because language models are trained by large amounts of data on the Internet (including social media), they can be adapted to the conditions encountered during the training process. Similar language to generate toxic and biased text. AI21 Labs’ model is no exception.

Although AI21 Labs requires customers to agree to a terms of use policy and usage guidelines, it has not implemented filtering of potentially toxic content generated by its API. In response, AI21 Labs stated that its model is "slightly less biased" than GPT-3 and said that they are manually reviewing and fine-tuning the model to combat abuse.

According to Goshen, the latest version of the Jurassic-1 model, Jurassic-X, uses the so-called "modular reasoning knowledge system", using "discrete" methods such as online calculators and currency converters. reasoning experts" to enhance their answers. Jurassic-X can answer "non-trivial" mathematical operations expressed in natural language, as well as simplify "complex" problems that may stumble other language models. Compared with Jurassic-1, Jurassic-X overcomes the shortcomings of the predecessor model such as being poor at reasoning, expensive to update, and unable to effectively process time series data.

Of course, it is worth noting that AI21 Labs has not commissioned a comparison of its Jurassic-X model with other commercial language models, so the current full basis is only from the statement.

The company’s recent marketing stunts don’t inspire huge confidence, but rather raise questions. In June, AI21 Labs launched a chatbot modeled after the legal opinions of the late Supreme Court Justice Ruth Bader Ginsburg. However, some experts in artificial intelligence technology characterize this as misleading. Responding to criticism, AI21 Labs said the chatbot was "just an experiment" and admitted it could give inaccurate answers and should be "treated with caution."

#For this round of financing, Goshen said that the new funds will be used for research and development, especially the development of larger and more complex language models, as well as recruitment. Talent. AI21 Labs currently has 120 employees, and they plan to hire about 50 more employees by the end of the year to buck macroeconomic trends.

When asked about revenue, Goshen declined to disclose exact numbers, as well as estimates of growth. He said the studio has hundreds of "paying clients and design partners," but he declined to name them. In addition, he said there are more than 10,000 users of the free plan, while Wordtune has "millions" of users.

Given the cost of training complex models, investors may face significant pressure to expand.

AI21 Labs’ own research shows that developing a text generation model with 1.5 billion parameters (i.e., the variables the model uses to generate and analyze text) costs up to $1.6 million. The Jurassic-1 model contains 178 billion parameters, not including the hosting fees to service the model; AI21 Labs said it retains the services of "several" third-party cloud providers in the United States and abroad.

"The lack of market knowledge is because language model technology is still nascent and just being adopted." Goshen said, "With the new funding, AI21 Labs will continue to deliver Its mission is to build AI systems with unprecedented natural language understanding and generation capabilities."

"As more companies move to remote work, people need words to communicate their Content that would typically be shared verbally. The core capabilities of our proprietary large-scale language models allow for the ingestion of vast amounts of enterprise data using... custom content creation, summarization and classification."

Are you optimistic about AI21?

The above is the detailed content of Challenge OpenAI! Israel AI21 Labs launches latest language model: Jurassic-X. For more information, please follow other related articles on the PHP Chinese website!