Databricks research shows multi-step agents consistently outperform single-turn RAG when answers span databases and documents

Data teams building AI agents keep running into the same failure mode. Questions that require joining structured data with ...
TMCnet

Kumo Launches KumoRFM-2, the First Foundation Model to Outperform Machine Learning on Enterprise Data, Scaling to 500 Billion Rows

Built on a new architecture KumoRFM-2 achieves state-of-the-art results across 41 predictive tasks and four major benchmarks, ...

Spark creator bags computing gong for making big data a little bit smaller

When Zaharia started work on Spark around 2010, analyzing "big data" generally meant using MapReduce, the Java-based ...

EDB Postgres(R) AI Delivers Superior Predictability vs. Cloud Data Warehouses in High-Concurrency Benchmark, Unveils Q1 Platform Updates to Power the Agentic AI Era

Independent benchmark by McKnight Consulting Group reveals EDB Postgres AI for WarehousePG delivers up to 58% cost savings and more consistent concurrent performance, while new platform features ...
Business Wire

Accenture and Databricks Accelerate Enterprise Adoption of AI Applications and Agents at Scale

Clients across industries, such as Albertsons, BASF, and Kyowa Kirin International are working with Accenture and Databricks to build agent-ready databases and AI applications on their enterprise data ...
Women's Wear Daily

Walmart’s Spark Delivery Program Under Fire in $100M FTC Settlement Over Pay, Tips

Walmart will pay up to $100 million to settle a complaint by the Federal Trade Commission (FTC) and 11 states alleging the company withheld tips and misrepresented wages to drivers who deliver orders ...
GitHub

Apache Spark Connector for SQL Server and Azure SQL

Born out of Microsoft’s SQL Server Big Data Clusters investments, the Apache Spark Connector for SQL Server and Azure SQL is a high-performance connector that enables you to use transactional data in ...
GitHub

Query your Delta Tables as a Graph

Databricks provides tables designed for massive scale, enabling efficient storage and querying of tens of billions of triples with features like time travel No ETL or migration needed—just query your ...
InfoQ

Autonomous Big Data Optimization: Multi-Agent Reinforcement Learning to Achieve Self-Tuning Apache Spark

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
Tweakers

Medior Data Engineer

Fugro is a global leader in Geo‑data, building a modern cloud‑based lakehouse platform on Databricks to unlock high‑quality, governed data at scale. As we accelerate our digital transformation, we are ...