PySpark Project End to End PySpark Real Time Project Implementation

Files Included :
1 Preview.mp4 (146.81 MB)
29 What is HDFS and Why to use HDFS.mp4 (8.18 MB)
30 HDFS Components and Metadata.mp4 (10.34 MB)
31 Data Blocks and Replication.mp4 (10.69 MB)
32 HDFS Read Mechanism Architecture.mp4 (5.8 MB)
33 Rack Awareness.mp4 (4.49 MB)
34 Exercise – HDFS CLI Help Commands.mp4 (10.03 MB)
35 Exercise – Bring Data from GitHub to Local to HDFS.mp4 (12.47 MB)
36 Exercise – Listing and Sorting Files and Directories in HDFS.mp4 (20.22 MB)
37 Exercise – Create or Remove Directories in HDFS.mp4 (41.38 MB)
38 Exercise – Copy Data from HDFS to Local.mp4 (20.29 MB)
39 Exercise – Copy data from Local to HDFS.mp4 (38.66 MB)
88 Create Objects – Spark Object.mp4 (20.41 MB)
89 Create Objects – Validate Spark Object.mp4 (19.49 MB)
90 Create Objects – Integrate Exception Handling.mp4 (38.22 MB)
91 Create Objects – Implement Logging.mp4 (67.1 MB)
92 Create Objects – Integrate Logging with Exception.mp4 (40.77 MB)
93 Create Objects – Add Custom Logger.mp4 (107.08 MB)
96 Data Ingestion – Load Prescriber Fact File.mp4 (33.77 MB)
100 Validation – Print Schema for any DataFrame.mp4 (26.28 MB)
97 Data Preprocessing – City Dimension.mp4 (111.25 MB)
105 Data Transform – City Report.mp4 (157.34 MB)
106 Data Transform – Prescriber Report.mp4 (101.91 MB)
107 Quick Note to Copy Code.mp4 (1.22 MB)
108 Quick Note on connect PyCharm to GCP.mp4 (3.22 MB)
109 Copy developed codes from Windows to GCP.mp4 (3.55 MB)
110 Create HDFS Folders to keep input city and Fact Files.mp4 (7.49 MB)
111 Write and Execute Unix Shell Script to Copy data into HDFS.mp4 (114.66 MB)
112 Code Changes in the scripts to accommodate HDFS Paths.mp4 (37.83 MB)
113 Perform a Test run using spark-submit at Cluster.mp4 (25.95 MB)
114 File Extraction – City and Prescriber Report.mp4 (219.47 MB)
115 Validations – City and Prescriber Reports.mp4 (17.27 MB)
118 Copy final City and Presc files HDFS to Local Server.mp4 (16.98 MB)
119 Prepare for S3 Transfer.mp4 (2.51 MB)
120 Set up Free Tier AWS Account and Create a S3 Bucket.mp4 (13.92 MB)
121 Set up AWS CLI Client, Create Profile and Access S3 Bucket.mp4 (30.82 MB)
122 Push Files to S3.mp4 (47.74 MB)
123 Set up Free Microsoft Azure Account and Create Containers.mp4 (31.16 MB)
124 Install azcopy at our Local Server.mp4 (22.66 MB)
125 Push Files to Azure Blobs.mp4 (52.66 MB)
132 Persist data at PostgreSQL Introduction.mp4 (1.39 MB)
Screenshot