Category: Engineering

Dataricks is thrilled to announce the General Availability (GA) of Primary Key (PK) and Foreign Key (FK) constraints, starting in Databricks Runtime 15.2 and Databricks SQL 2024.30. This release follows a highly successful public preview, embraced by hundreds of weekly active customers, and further represents a significant milestone in enhancing data integrity and relational data […]

Today, we’re thrilled to announce that Mosaic AI Model Training’s support for fine-tuning GenAI models is now available in Public Preview. At Databricks, we believe that connecting the intelligence in general-purpose LLMs to your enterprise data – data intelligence – is the key to building high-quality GenAI systems. Fine-tuning can specialize models for specific tasks, […]

At eBay, helping sellers grow their business is our top priority. This focus on seller growth is what originally led to the creation of advertising in 2015, and now, we are excited to introduce the next iteration of advertising on eBay. Today, eBay Advertising is unveiling a reimagined and redesigned advertising experience. From a new […]

eBay’s magical listing tool has been named “Best Overall Generative AI Solution” in the 2024 AI Breakthrough Awards, an annual program that celebrates innovative use of technology from companies and products around the world.  eBay’s magical listing experience leverages generative AI to simplify the product listing experience for sellers, sparing them time and effort.  The […]

Databricks announced the public preview of Mosaic AI  Agent Framework & Agent Evaluation alongside our Generative AI Cookbook at the Data + AI Summit 2024.  These tools are designed to help developers build and deploy high-quality Agentic and Retrieval Augmented Generation (RAG) applications within the Databricks Data Intelligence Platform.   Challenges with building high-quality Generative AI […]

Enhancing DLT development experience is a core focus because it directly impacts the efficiency and satisfaction of developers building data pipelines with DLT. We are excited to announce some enhancements to the DLT development experience with notebooks. These new features provide a seamless and intuitive DLT development interface, and help you build and debug your […]

eBay‘s Christine Su has landed on Fast Company’s annual Queer 50 list for a second consecutive year, the media brand announced on Tuesday. The list celebrates “LGBTQ leaders who are leading across industries, including business, tech, finance, venture capital, and media,” wrote Fast Company Senior Editor Julie Herbst.  In her role as Head of Product, […]

Today, we are excited to announce Databricks LakeFlow, a new solution that contains everything you need to build and operate production data pipelines. It includes new native, highly scalable connectors for databases including MySQL, Postgres, SQL Server and Oracle and enterprise applications like Salesforce, Microsoft Dynamics, NetSuite, Workday, ServiceNow and Google Analytics. Users can transform […]

Over the last year, we have seen a surge of commercial and open-source foundation models showing strong reasoning abilities on general knowledge tasks. While general models are an important building block, production AI applications often employ Compound AI Systems, which leverage multiple components such as tuned models, retrieval, tool use, and reasoning agents. AI systems […]

Delta Lake has over 20M+ monthly downloads. BigQuery, now with first-party support for Delta Lake, builds on Delta’s rich connector ecosystem and seamlessly integrates with Databricks. In this blog, we will cover:   Delta Lake on Google Cloud Building an open data lakehouse with Databricks and BigQuery How to read Delta Lake in BigQuery Delta […]