#apachespark #opensource | Apache Spark
0:59
#apachespark #opensource | Apache Spark
1 day ago
linkedin.comApache Spark
Apache Spark on X: "Apache Spark Data Source V2 is Spark’s way to support native table formats, not only files. Szehon Ho walks through why that exists. Early Spark read and wrote file formats such as Parquet and used a thin Hive Metastore catalog. Apache Iceberg and Delta Lake added a much richer metadata layer so engines can run large, transactional operations. DSV2 expands that surface so a data source can plug that metadata into Spark, including through catalogs. 🎥 https://t.co/qVGxuXp4ha #
0:59
Apache Spark on X: "Apache Spark Data Source V2 is Spark’s way to support native table formats, not only files. Szehon Ho walks through why that exists. Early Spark read and wrote file formats such as Parquet and used a thin Hive Metastore catalog. Apache Iceberg and Delta Lake added a much richer metadata layer so engines can run large, transactional operations. DSV2 expands that surface so a data source can plug that metadata into Spark, including through catalogs. 🎥 https://t.co/qVGxuXp4ha #
19 hours ago
x.com
In machine learning, data is everything. So the engine that moves all that data ends up setting the price of the work. Apache Spark has historically been one of the primary engines doing that job… | Kevin Roney
2:06
In machine learning, data is everything. So the engine that moves all that data ends up setting the price of the work. Apache Spark has historically been one of the primary engines doing that job… | Kevin Roney
1 week ago
linkedin.comKevin Roney
#databricks #dataengineering #apachespark #realtime #lakehouse | SGS Analytics
0:56
#databricks #dataengineering #apachespark #realtime #lakehouse | SGS Analytics
1 day ago
linkedin.comSGS Analytics
#dataengineering #apachespark #cloudcosts | Ariel Orbach | 75 comments
#dataengineering #apachespark #cloudcosts | Ariel Orbach | 75 comments
16 hours ago
linkedin.comAriel Orbach
Caveman vs 10 Billion Rows 🪨 #shorts #apachespark #databricks #dataengineering #bigdata
0:30
Caveman vs 10 Billion Rows 🪨 #shorts #apachespark #databricks #dataengineering #bigdata
3 days ago
YouTubeThe Data Cave
Why Spark Is Lazy on Purpose #Shorts
1:04
Why Spark Is Lazy on Purpose #Shorts
2 hours ago
YouTubeQwizo
0:38
Is Big Data Just a Lot of Data? The 3 Vs Explained
4 days ago
YouTubeThe AI Mastery Academy
1:16
0.1 + 0.2 ≠ 0.3?! 😱 PySpark Explained #shorts
5 days ago
YouTubeVJ Tech Talks
1:59
🤔 How does Apache Spark transfer data between Executors?
34 views8 hours ago
YouTubeThe Data Engineer Girl
2:02
Stop Using collect() in PySpark! 😱 #Databricks #Shorts
1 day ago
YouTubeVJ Tech Talks
0:33
Why Apache Spark Is 100x Faster Than Hadoop! ⚡ #shorts
5 views4 days ago
YouTubeSagar Shingare
1:13
Why Your Pipeline Retry Doubled Your Data #shorts
2 days ago
YouTubeData Engineering with Subhadip
0:41
"Databricks is managed Spark" is half an answer #databricks #dataengineering #shorts
13 hours ago
YouTubeSchema Drift
0:46
Batch vs Stream Processing: Kaunsa Kab Use Karein?
2 days ago
YouTubeLaela Zorana | ML + Cloud (Hindi)
0:48
The Secret to Efficient Time-Series Storage 🤫 #dataengineering #tech
2 days ago
YouTubeSystems Architecture Hub
0:40
Why Can collect() Crash Your Spark Driver? #Shorts
2 views2 days ago
YouTubeLearners Dream
1:00
How Alibaba uses Apache Flink?
10 views2 days ago
YouTubeSaurabh Mahawar
See more
Static thumbnail place holder