Category: Engineering

We are excited to announce a new data type called variant for semi-structured data. Variant provides an order of magnitude performance improvements compared with storing these data as JSON strings, while maintaining the flexibility for supporting highly nested and evolving schema. Working with semi-structured data has long been a foundational capability of the Lakehouse. Endpoint […]

Delta Lake has proven to be the most popular and fastest lakehouse format over the years. Delta Lake Universal Format (UniForm), now available in GA, builds on Delta Lake’s rich connector ecosystem to combine Delta Lake’s superior price-performance with access to every tool in your stack. With Delta Lake UniForm, you can write a single […]

In a previous post, we introduced our systems for running marketing campaigns. Although we sent millions of messages daily, we had little insight into their effectiveness. Did they engage our users with our promotions? Did they encourage more transactions and bookings? As Grab’s business expanded and the number of marketing campaigns increased, understanding the impact […]

Following the announcement we made around a suite of tools for Retrieval Augmented Generation, today we are thrilled to announce the general availability of Mosaic AI Vector Search in Databricks. What is Mosaic AI Vector Search? Vector Search enables developers to improve the accuracy of their Retrieval Augmented Generation (RAG) and generative AI applications through similarity […]

Following the announcement we made around a suite of tools for Retrieval Augmented Generation, today we are thrilled to announce the general availability of Databricks Vector Search.  What is Databricks Vector Search? Vector Search enables developers to improve the accuracy of their Retrieval Augmented Generation (RAG) and generative AI applications through similarity search over unstructured […]

In the fast-paced landscape of data science and engineering, integrating Artificial Intelligence (AI) has become integral for enhancing productivity. We’ve seen many tools emerge and transform the lives of data practitioners, making complex tasks easier and encouraging innovation. When we launched Databricks Assistant in Public Preview in July of 2023, we designed it exclusively for […]

Last year, we launched foundation model support in Databricks Model Serving to enable enterprises to build secure and custom GenAI apps on a unified data and AI platform. Since then, thousands of organizations have used Model Serving to deploy GenAI apps customized to their unique datasets. Today, we’re excited to announce new updates that make […]

In December, we announced a new suite of tools to get Generative AI applications to production using Retrieval Augmented Generation (RAG). Since then, we have seen an explosion of RAG applications being built by thousands of customers on the Databricks Data Intelligence Platform. Today, we are excited to make several announcements to make it easy […]

Teams at eBay regularly draw on the company’s decades of data from billions of listings to find customer insights that help them enhance their experience on the platform. Now sellers can tap into that same trove of sold items data right within eBay’s mobile app, using a service called Product Research that lets them research […]

Are you a U.S. college or university student with a knack for solving thorny problems using machine learning? Sign up for eBay’s annual University Machine Learning Competition and your skills could land you a 2025 summer internship at eBay. eBay serves up a unique ecommerce challenge and dataset for each year’s contest, inviting qualified students […]