The cloud-hosted environment, described by Databricks as being deployed by more than 150 firms, aims to simplify the use of the open-source cluster compute engine and cut the time spent developing, ...

At its Data + AI Summit, Databricks today made the requisite number of announcements one would expect from a company's flagship developer event. Among those are the launch of Delta Lake 2.0, the next ...

Apache Spark is a project designed to accelerate Hadoop and other big data applications through the use of an in-memory, clustered data engine. The Apache Foundation describes the Spark project this ...

Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...

Hydrolix, the company transforming the economics of log data with its streaming data lake platform, is unveiling a new Apache Spark connector that democratizes the power of Databricks to customers’ ...