Skip to content

Shankar-Anumula/data-engineer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Data Engineering

Week10

# Spark shared variables - Broadcast and Accumulator
# sc.parallelize
# groupBYKey vs reduceByKey
# Paralellism - sc.defaultParallelism, sc.parallelize, sc.defaultMinPartitions
# Parallelism - repartition vs coalesce

Week 11

Releases

No releases published

Packages

No packages published