Uploaded byEdureka!
PySpark Dataframes Tutorial | Introduction to PySpark Dataframes API | PySpark Training | Edureka
The document outlines a pyspark certification training course focused on dataframes, highlighting their importance in processing structured and semi-structured data, especially in handling large datasets. It covers key features and classes of dataframes, including their creation and use cases, such as the FIFA World Cup and superheroes. The training aims to provide a comprehensive understanding of dataframes and their applications in data processing.
PySpark Dataframes Tutorial | Introduction to PySpark Dataframes API | PySpark Training | Edureka
- 1. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training PySpark Dataframe Tutorial
- 2. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Today’s Training Topics ❖ Need for Dataframes ❖ What are Dataframes ❖ Dataframes Features ❖ Sources of Dataframes ❖ Demo
- 3. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Why do we need Dataframes? Processing Structured And Semi-Structured Data
- 4. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Why do we need Dataframes? Processing Structured And Semi-Structured Data Handling Petabytes of Data
- 5. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Why do we need Dataframes? Processing Structured And Semi-Structured Data Handling Petabytes of Data Wide Range of Data Formats and Sources
- 6. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Why do we need Dataframes? Processing Structured And Semi-Structured Data Handling Petabytes of Data Wide Range of Data Formats and Sources Support for Multiple Languages
- 7. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training What are Dataframes? 2d labelled Data Structure Similar to SQL
- 8. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Features of Dataframes Distributed Lazy EVALs Immutable
- 9. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Creating a Dataframe(Sources) Dataframe
- 10. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training Important Classes • pyspark.sql.SQLContext • pyspark.sql.DataFrame • pyspark.sql.Column • pyspark.sql.Row • pyspark.sql.GroupedData • pyspark.sql.DataFrameNaFunctions • pyspark.sql.DataFrameStatFunctions • pyspark.sql.functions • pyspark.sql.types • pyspark.sql.Window
- 11. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training CREATING DATAFRAMES DEMO
- 12. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training FIFA WORLD CUP – USE CASEFIFA world Cup Use Case
- 13. PYSPARK CERTIFICATION TRAININGwww.edureka.co/pyspark-certification-training SUPERHEROS Use Case