The Deep View: New US open model takes on China’s top AI

New US open model takes on China’s top AI

China and Europe have typically led the charge on open models. Now, another US company is joining the fray with a significant entrant into the race.

On Wednesday, Thinking Labs, the AI startup founded by ex-OpenAI CTO Mira Murati, launched its first model: Inkling. The model sets itself apart from leading AI labs in the US in a very important way: it is open-weight, allowing customers to customize it directly to their needs through fine-tuning and training. To suit that purpose, the model was built to perform across a wide range of areas. Or, as Thinking Machines describes it, it’s a “generalist model” that can reason about text, images, and audio rather than being proficient in just one domain. This can be observed in benchmark performance, which isn’t best-in-class but is consistent across specialties, as seen in the image below. Tweet screenshotOther model features include:

Parameters: Mixture-of-Experts transformer model with 975 billion total parameters, 41 billion active.

Context window: Up to one million tokens 

Pretrained: On 45 trillion tokens of text, images, audio and video, allowing it to be proficient across all three. 

Lightweight counterpart: Inkling-Small, a lighter-weight model with 12 billion active parameters.

Fine-tuning: To make customization accessible, the company says it is making Inkling available on Tinker, the company’s training API platform. 

Cost-efficiency: Inkling’s “controllable thinking effort” allows users to customize the cost/performance curve.Until now, most open-source models have been developed in other countries, with China leading the way. These models are good for the ecosystem because they allow people and organizations to more deeply specialize the models, adjust their behavior, run them locally, and even save money. Though, as Thomas Randall, Research Director at Info-Tech Research Group, told The Deep View, they may not be for everyone. “If organizations have use cases where cost control, sovereignty, fine-tuning, deployment flexibility, or domain-specific performance matter, then open-source models are relevant,” said Randall. “For the highest-risk or most complex work (e.g., legal, medical, cyber, or regulated decisions), closed frontier model providers are preferable because of safety tooling, support models, auditability, and more mature deployment ecosystems.” Still, for the US to compete in the open-weights model space, it has a lot left to do, despite recent entrants from not only Thinking Machines but NvidiaGoogle and OpenAI. A closer look at benchmark performance shows that many of China’s leading labs, which have also taken a generalist approach with their open-weight models, have outperformed Inkling on benchmarks. That includes GLM 5.2, DeepSeek V4 Pro, and Kimi K2.6. Kimi K3 also just released on Thursday, and it’s Kimi’s most capable model to date, with 2.8 trillion parameters.Competition is the lifeblood of any industry. This is especially true for the state of AI we are in now, where enterprises and AI builders are prioritizing cost, and open-weight models provide a tangible solution while applying pressure on the leading labs to be more cost-conscious. Just this month, OpenAI and Meta have both released new models, each highlighting their cost efficiency. Still, it is important to keep in mind the broader backdrop, including the rising costs of finite resources such as data centers and energy. Open-weight models still need the same compute power, even if they cost less than proprietary models. 
 LINKS

Unknown's avatar

About michelleclarke2015

Life event that changes all: Horse riding accident in Zimbabwe in 1993, a fractured skull et al including bipolar anxiety, chronic fatigue …. co-morbidities (Nietzche 'He who has the reason why can deal with any how' details my health history from 1993 to date). 17th 2017 August operation for breast cancer (no indications just an appointment came from BreastCheck through the Post). Trinity College Dublin Business Economics and Social Studies (but no degree) 1997-2003; UCD 1997/1998 night classes) essays, projects, writings. Trinity Horizon Programme 1997/98 (Centre for Women Studies Trinity College Dublin/St. Patrick's Foundation (Professor McKeon) EU Horizon funded: research study of 15 women (I was one of this group and it became the cornerstone of my journey to now 2017) over 9 mth period diagnosed with depression and their reintegration into society, with special emphasis on work, arts, further education; Notes from time at Trinity Horizon Project 1997/98; Articles written for Irishhealth.com 2003/2004; St Patricks Foundation monthly lecture notes for a specific period in time; Selection of Poetry including poems written by people I know; Quotations 1998-2017; other writings mainly with theme of social justice under the heading Citizen Journalism Ireland. Letters written to friends about life in Zimbabwe; Family history including Michael Comyn KC, my grandfather, my grandmother's family, the O'Donnellan ffrench Blake-Forsters; Moral wrong: An acrimonious divorce but the real injustice was the Catholic Church granting an annulment – you can read it and make your own judgment, I have mine. Topics I have written about include annual Brain Awareness week, Mashonaland Irish Associataion in Zimbabwe, Suicide (a life sentence to those left behind); Nostalgia: Tara Hill, Co. Meath.
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a comment