Published
This talk will introduce PySpark a framework for cluster scale data-intensive computing. PySpark is a deeply integrated set of Python API bindings for the popular Spark computation engine. Spark provides rich data-flow abstractions and sophisticated use of distributed caching to speed up complex analytic processing by several orders of magnitude. It interfaces directly with popular storage layers (e.g. Hadoop HDFS) and is optimized for advanced analytic functions such as machine learning, OLAP processing, and ETL. The talk will introduce the PySpark API and architecture, present use cases, and walk through a demo.
- Category
- Computing
- Tags
- Python, data analysis, PySpark, machine learning
Sign in or sign up to post comments.
Be the first to comment
Up Next
-
01:51
NVIDIA GPUs Power the SC18 Student Cluster Competition
-
30:31
Losing Your Loops Fast Numerical Computing With NumPy
-
00:12
AudioBook DNA Computing: New Computing Paradigms (Texts In Theoretical Download
-
03:01
SHIELD GAMING: Cluster Truck Let's Play
-
02:23
Photo Lighting Sets: 5 Fast Facts
-
02:21
Quickly start a cluster with Compute Engine
-
03:52
Pixar's Fast Lighting Preview with NVIDIA Technology
-
03:38
Parallel Computing Explained - Fast Tech Skills
-
31:32
Fog Computing Expo: Careful Examination Of Fog Computing
-
46:17
Cluster Computing And MapReduce Lecture 1
-
05:50
Quantum Computing As Fast As Possible
-
03:19
7 Best Photo Lighting Sets 2019
-
05:26
Bessel Studio Lighting
-
02:31
SC18 Student Cluster Competition: Purdue University Team Spotlight
-
02:55
CNET Update - Galaxy S5 Mini in cluster of spinoffs
-
55:53
Mod-29 Lec-41 Cluster, Grid And Cloud Computing
-
07:13
Physical Lighting in Iray for 3ds Max
-
20:58
My new $10,000 lighting kit
-
06:20
Parallel And GPU Computing Tutorials, Part 9: GPU Computing With MATLAB
-
01:59
Quantum Computing Versus Traditional Computing
-
12:21
INTRODUCTION TO CLUSTER COMPUTING
-
01:41
Noon Smart Lighting System review: Smart lighting with bulbs you own
Loading...