Big Data / Large-Scale

Lakes, lakehouses and distributed engines for data too big for one machine.

  • 82 Tracked terms
  • Last 30 days Feed window

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.

  • +42 more

Latest in Big Data / Large-Scale


prnewswire.com > news-releases > platform9-named-a-visionary-in-2026-gartner-magic-quadrant-for-server-virtualization-platforms-302880735.html

Platform9 Named a Visionary in 2026 Gartner® Magic Quadrant™ for Server Virtualization Platforms

4+ day, 5+ hour ago   (234+ words) Sep 16, 2026, 11:05 ET SAN JOSE, Calif., Sept. 16, 2026 /PRNewswire/ -- Platform9, the company simplifying private cloud infrastructure, today announced that it has been named as a Visionary in the 2026 Gartner® Magic Quadrant™ for Server Virtualization Platforms. "Server virtualization platforms can be used by enterprises…...


hackernoon.com > delta-lake-uniform-is-the-real-fix-for-the-snowflake-vs-databricks-standoff

Delta Lake UniForm Is the Real Fix for the Snowflake-vs-Databricks Standoff | HackerNoon

1+ day, 21+ hour ago   (403+ words) Second copies are the real tax. Datasets get duplicated across both platforms simply so each team can use the tool suited to its job. That means double storage cost, two sets of transformation jobs to keep in sync, and inevitably…...


cryptonexa.com > a16z-interlocking-directorates-probe-draws-doj-scrutiny-over-databricks-and-fivetran-boards

a16z Interlocking Directorates Probe Draws DOJ Scrutiny Over Databricks and Fivetran Boards - CryptoNexa

1+ day, 5+ hour ago   (404+ words) The a16z interlocking directorates probe has been running for nearly a year, with the US Department of Justice examining whether Andreessen Horowitz partners holding board seats at competing AI data companies violates the Clayton Act’s prohibition on overlapping directorships. No enforcement…...


dev.to > hamza_dev_talks > mlops-best-practices-2026-1d54

MLOps Best Practices 2026

1+ day, 6+ hour ago   (1328+ words) {"title": "MLOps Best Practices 2026: Scaling AI from Prototype to Enterprise Production", "content": "### Introduction\n\nThe landscape of machine learning has undergone a seismic shift. We are no longer in the era of isolated Jupyter notebooks and sporadic model deployments; we…...


medium.com > @sreedeepsinha > databricks-is-changing-how-workspace-object-permissions-work-7c7b73eae156

Databricks Is Changing How Workspace Object Permissions Work

1+ day, 3+ hour ago   (1270+ words) Access permissions are changing. Instead of using only the groups assigned to a workspace, the system will use all account groups you …...


tradingview.com > news > zacks:aaed2a55e094b:0-snowflake-vs-adobe-which-enterprise-ai-stock-is-a-better-buy

Snowflake vs. Adobe: Which Enterprise AI Stock Is a Better Buy?

3+ day, 22+ hour ago   (641+ words) Snowflake SNOW and Adobe ADBE are major players in enterprise software, with both companies increasingly integrating AI across their platforms. Snowflake focuses on providing a unified enterprise data and AI platform, while Adobe is expanding generative and agentic AI across…...


hackernoon.com > mastering-databricks-a-developers-guide-to-lakehouse-architecture-and-pyspark-pipelines

Mastering Databricks: A Developer’s Guide to Lakehouse Architecture & PySpark Pipelines | HackerNoon

4+ day, 21+ hour ago   (198+ words) Databricks has become the cornerstone of modern data engineering, analytics, and AI workflows. Built on top of Apache Spark, it enables engineering teams to process petabyte-scale datasets, deploy machine learning models, and streamline analytics—all within a unified platform integrated…...


medium.com > @geekycodes > broadcast-variables-in-pyspark-a-practical-guide-to-distributed-data-processing-40baccc3c490

Broadcast Variables in PySpark: A Practical Guide to Distributed Data Processing

1+ day, 12+ hour ago   (127+ words) When working with large datasets in Apache Spark, performance often depends on how efficiently data is distributed across executors. One common problem occurs when every executor repeatedly needs access to the same relatively small piece of data. Instead of sending…...


dev.to > sharpvik > bloated-clouds-anyone-1jhc

Bloated Clouds, Anyone?

1+ day, 18+ hour ago   (20+ words) TL;DR Conventional cloud platforms had to serve everyone, and they became bloated with... Tagged with devops, cloud, kubernetes, webdev....


medium.com > @foodforthought.elevateyourself > the-economy-of-data-what-is-your-life-worth-5be79e692945

The Economy of Data: What Is Your Life Worth?

1+ day, 16+ hour ago   (37+ words) I often sit down and wonder what will the future look like?What will a typical day in 2040 will look like.Everyday and every year technology advances in …...