Today, virtually every cutting-edge AI product and model uses a transformer architecture. Large language models (LLMs) such as GPT-4o, LLaMA, Gemini and Claude are all transformer-based, and other AI ...

I talk with Recursal AI founder Eugene Cheah about RWKV, a new architecture that This essay is a part of my series, “AI in the Real World,” where I talk with leading AI researchers about their ...

IBM Corp. on Thursday open-sourced Granite 4, a language model series that combines elements of two different neural network architectures. The algorithm family includes four models on launch. They ...

Researchers at the Tokyo-based startup Sakana AI have developed a new technique that enables language models to use memory more efficiently, helping enterprises cut the costs of building applications ...

After years of dominance by the form of AI known as the transformer, the hunt is on for new architectures. Transformers aren’t especially efficient at processing and analyzing vast amounts of data, at ...

Researchers from Japan combined social media posts with transformer-based deep learning models to effectively detect heat stroke events. This approach demonstrated strong performance in identifying ...