Naixue-P8 Million Big Data Architect Phase I

Naixue-P8 Million Big Data Architect Phase I Resource Introduction:

Course Catalog

01 Spark Tuning

01 Preview of distributed computing application execution mechanism.mp4

02The phenomenon of data skew.mp4

03 The principle of data skew.mp4

04The dangers of data skew.mp4

05How is data skew caused?

06Avoid data source tilt HDFS.mp4

07Avoiding Data Skew-Kafka.mp4

08 Positioning Processing Logic - Stage and Task.mp4

09 Check the data distribution of the key that causes the tilt.mp4

10 classic interview questions.mp4

11Solutions to Data Skew 01Use Hive ETL to Preprocess Data.mp4

11Solution to data skew 02 Adjust the parallelism of shuffle.mp4

11Solution to data skew 03Adjust the parallelism of shuffle operation.mp4

11Solution to data skew 04Sampling skewed keys and splitting join operations.mp4

11Solution to data skew 05Convert reduce join to map join.mp4

11 Solution to Data Skew 06 Two-Phase Closure.mp4

11Solution to data skew 07Use random prefix and expand RDD to join.mp4

11Solution to Data Skew 08Task Crosscutting.mp4

11Solutions to data skew 09Combination of multiple solutions.mp4

11Solutions to Data Skew 10Custom Partitioner.mp4

12 Development and Tuning 04 Try to avoid using Shuffle operators.mp4

12 Development and Tuning 05 Shuffle Operation Using Map-Side Pre-aggregation.mp4

12 Development and Tuning 06 Using High-Performance Operators.mp4

12 Development and Tuning 07 Broadcast Large Variables.mp4

12 Development Tuning 08 Using Kryo to Optimize Serialization Performance.mp4

12 Development and Tuning 09 Optimizing Data Structure + Melting Through.mp4

12 Development Tuning 1-3.mp4

02 Apache Pulsar A trillion-scale cloud-native distributed messaging platform

01. Architecture design of the new generation trillion-level messaging system Pulsar.mp4

02. The core design of the new generation of trillion-level messaging system Pulsar.mp4

03. Application practice of Pulsar, a new generation of trillion-level messaging system.mp4

03 Data Lake

Free course - Methodology for building a platform for big data with hundreds of billions of traffic (1).mp4

Free course - Methodology for building a platform for big data with hundreds of billions of traffic (2).mp4

04 Live Class

01-Big Data Architecture Overall Design and Architecture Philosophy Essence (Part 1).mp4

02-Big Data Architecture Overall Design and Architecture Philosophy Essence (Part 2).mp4

03-Big Data Architecture Overall Design and Architecture Philosophy Essence (Part 2).mp4

04-Big Data Basic Platform Architecture Design and Practice (Part 1).mp4

05-Big Data Basic Platform Architecture Design and Practice (Part 2).mp4

06-Performance Transformation of Big Data Basic Platform.mp4

06-Performance Transformation of Big Data Basic Platform (Part 1) Supplementary Video-02(1).mp4

06- Performance Transformation of Big Data Basic Platform (Part 1) Supplementary Video-02.mp4

06- Performance Transformation of Big Data Basic Platform (Part 1) Supplementary Video-03.mp4

06- Performance Transformation of Big Data Basic Platform (Part 1) Supplementary Video-04.mp4

07-PB-level basic platform management and monitoring.mp4

08-Trillion-level cloud native Docker container cloud platform case design and practice.mp4

09—Architecture design and practice of PB-level big data task scheduling platform.mp4

10-PB-level big data task scheduling platform architecture design and practice (Part 2).mp4

11-The technical life of a millionaire architect.mp4

12-Offline Global Technology Warehouse.mp4

13-Big Data Middle Platform Data Governance.mp4

14-Data Lake Architecture Design and Practice.mp4

15-The Technical Life of a Millionaire Architect (2).mp4

16-Data query platform architecture design and practice.mp4

17-Search & recommendation based on big data platform architecture design and practice.mp4

18-The Technical Life of a Millionaire Architect (3).mp4

19-The Technical Life of a Millionaire Architect (4).mp4

20- New technology exploration: Pulsar, a 100 billion-level message engine.mp4

21-Big Data DA Layer Front-end Global Architecture Design and Practice (1).mp4

22-DA layer self-service BI and real-time statistical analysis system architecture design and practice (2).mp4

23-DA layer big data user portrait design and practice (3).mp4

24-Big Data User Portrait Design and Practice (Part 2).mp4

25-Million-dollar big data architect's technical growth and technical life.mp4

27 Big Data Cloud Solution Architecture Design (Part 1).mp4

28 Big Data Cloud Solution Architecture Design (Part 2).mp4

29 Self-developed task scheduling platform deployment process demonstration.mp4

30 Data Query Platform-iQuery Compilation and Installation.mp4

31 Big Data Middle Platform Operation.mp4

32 - Large-scale indicator platform architecture design and practice (1).mp4