Published
This talk will introduce PySpark a framework for cluster scale data-intensive computing. PySpark is a deeply integrated set of Python API bindings for the popular Spark computation engine. Spark provides rich data-flow abstractions and sophisticated use of distributed caching to speed up complex analytic processing by several orders of magnitude. It interfaces directly with popular storage layers (e.g. Hadoop HDFS) and is optimized for advanced analytic functions such as machine learning, OLAP processing, and ETL. The talk will introduce the PySpark API and architecture, present use cases, and walk through a demo.
- Category
- Computing
- Tags
- Python, data analysis, PySpark, machine learning
Sign in or sign up to post comments.
Be the first to comment
Up Next
-
05:50
Quantum Computing As Fast As Possible
-
12:21
INTRODUCTION TO CLUSTER COMPUTING
-
03:01
SHIELD GAMING: Cluster Truck Let's Play
-
46:17
Cluster Computing And MapReduce Lecture 1
-
02:23
Photo Lighting Sets: 5 Fast Facts
-
03:38
Parallel Computing Explained - Fast Tech Skills
-
02:21
Quickly start a cluster with Compute Engine
-
07:13
Physical Lighting in Iray for 3ds Max
-
55:53
Mod-29 Lec-41 Cluster, Grid And Cloud Computing
-
00:12
AudioBook DNA Computing: New Computing Paradigms (Texts In Theoretical Download
-
30:31
Losing Your Loops Fast Numerical Computing With NumPy
-
02:55
CNET Update - Galaxy S5 Mini in cluster of spinoffs
-
06:20
Parallel And GPU Computing Tutorials, Part 9: GPU Computing With MATLAB
-
31:32
Fog Computing Expo: Careful Examination Of Fog Computing
-
01:41
Noon Smart Lighting System review: Smart lighting with bulbs you own
-
05:26
Bessel Studio Lighting
-
20:58
My new $10,000 lighting kit
-
01:51
NVIDIA GPUs Power the SC18 Student Cluster Competition
-
01:59
Quantum Computing Versus Traditional Computing
-
03:19
7 Best Photo Lighting Sets 2019
-
03:52
Pixar's Fast Lighting Preview with NVIDIA Technology
-
02:31
SC18 Student Cluster Competition: Purdue University Team Spotlight
Loading...