Large Tabular Models Outperform LLMs on Structured Data
Google/DeepMind
Feedzai
Mastercard
Amazon Web Services
Startup Fundamental emerged from stealth mode with its tabular model NEXUS, securing $275 million in funding. The model is already used by Amazon Web Services, while Google and other companies are developing their own Large Tabular Models (LTMs) for analyzing tabular data, a task where LLMs struggle.
Large language models (LLMs) that power generative chatbots struggle with analyzing structured tabular data — the primary data format for business. The startup Fundamental has developed a new AI model — a large table model (LTM) called NEXUS — designed specifically for working with tables. Unlike LLMs, NEXUS models the structure of tabular data directly, processing not only numerical values but also the context of their meaning and relationships. The model is pretrained on billions of tables and does not use client data. Amazon Web Services has integrated NEXUS into Amazon SageMaker. Competitors are also emerging: Google launched the TabFM model, while Feedzai and Mastercard released their own LTMs for the financial sector. Researchers have presented models such as FlexTab, TabICL, and iLTM. According to experts, the future lies in automated data analysis, which can be performed by combinations of LLMs and LTMs.
Source: IEEE Spectrum AI —
original
