コース概要

Foundations of Data-Intensive Platform Engineering

  • Introduction to data-intensive applications
  • Challenges in platform engineering for big data
  • Overview of data processing architectures

Data Modeling and Management

  • Principles of data modeling for scalability
  • Data storage options and optimization
  • Managing data lifecycle in a distributed environment

Big Data Processing Frameworks

  • Overview of big data processing tools (Hadoop, Spark, Flink)
  • Batch vs. stream processing
  • Setting up a big data processing pipeline

Real-Time Analytics Platforms

  • Architecting for real-time analytics
  • Stream processing engines (Kafka Streams, Apache Storm)
  • Building real-time dashboards and visualizations

Data Pipeline Orchestration

  • Workflow management with Apache Airflow and others
  • Automating data pipelines for efficiency
  • Monitoring and alerting for data pipelines

Platform Security and Compliance

  • Security best practices for data platforms
  • Ensuring data privacy and regulatory compliance
  • Implementing secure data access controls

Performance Tuning and Optimization

  • Techniques for optimizing data throughput and latency
  • Scaling strategies for data-intensive platforms
  • Performance benchmarking and monitoring

Case Studies and Best Practices

  • Analyzing successful data platform implementations
  • Lessons learned from industry leaders
  • Emerging trends in data-intensive platform engineering

Capstone Project

  • Designing a platform solution for a data-intensive application
  • Implementing a prototype of the data processing pipeline
  • Evaluating the platform's performance and scalability

Summary and Next Steps

要求

  • An understanding of basic data structures and algorithms
  • Experience with Java, Scala, or Python programming
  • Familiarity with basic concepts of databases and SQL

Audience

  • Software developers
  • Data engineers
  • Technical leads
 21 時間

参加者の人数



Price per participant

お客様の声 (3)

関連コース

Advanced Platform Engineering: Scaling with Microservices and Kubernetes

35 時間

DevOps and Platform Engineering: A Collaborative Approach

14 時間

Platform Engineering Fundamentals

14 時間

Platform Engineering for Business Strategy and Management

21 時間

Platform Engineering with Cloud-Native Technologies

28 時間

Platform Engineering for Developers

21 時間

Platform Engineering: Security and Compliance

28 時間

AI-Augmented Software Engineering (AIASE)

14 時間

AI Coding Assistants: Enhancing Developer Productivity

7 時間

FlexNet Publisher Fundamentals

14 時間

Impacted Function Point (IFP)

7 時間

SNAP IFPUG Software Size Estimation and Measurement

14 時間

Software Engineering

35 時間

Unit of Software Measurement Parameterization (UMSP)

7 時間

The Principal Engineer - Masterclass

14 時間

関連カテゴリー