Building Scalable Data Warehouses
Chapter 1: MPP Architecture and Storage Internals
Massively Parallel Processing Fundamentals
Decoupling Compute and Storage
Columnar Storage Formats and Compression
Micro-partitioning and Metadata Management
Hands-on practice: Inspecting Storage Profiles
Chapter 2: Advanced Data Modeling at Scale
Dimensional Modeling Constraints in Big Data
Data Vault 2.0 Implementation Patterns
Handling Semi-Structured Data
Schema Evolution and Versioning
Hands-on practice: Designing a Data Vault
Chapter 3: High-Throughput Ingestion Pipelines
Change Data Capture Architectures
Idempotency in Data Pipelines
Micro-batch vs Streaming Ingestion
Handling Late Arriving Data
Hands-on practice: Building a CDC Pipeline
Chapter 4: Query Optimization and Performance Tuning
Analyzing Query Execution Plans
Partition Pruning and Clustering Keys
Join Strategies: Broadcast vs Shuffle
Materialized Views and Caching Layers
Hands-on practice: Tuning High-Latency Queries
Chapter 5: Governance, Security, and Observability
Role-Based Access Control Hierarchies
Dynamic Data Masking and Tokenization
Row-Level Security Implementation
Resource Monitoring and Cost Control
Hands-on practice: Configuring Security Policies
Materialized Views and Caching Layers
Was this section helpful?
- Database Management Systems, Raghu Ramakrishnan, Johannes Gehrke, 2003 (McGraw-Hill Education) - Provides a comprehensive overview of database systems, including fundamental concepts of query optimization and materialized views.
- The Snowflake Elastic Data Warehouse, Benoit Dageville, Allison Lee, Tharindu Dananjaya, Shreya Prasad, Greg Rahn, Kenton Murray, Shishir Kumar, Karthik Raman, Steven Lee and Ashish Motivala, 2017 Proceedings of the VLDB Endowment (PVLDB), Vol. 10 (VLDB Endowment) DOI: 10.14778/3137628.3137637 - Describes the architecture of Snowflake, a prominent MPP data warehouse, detailing its decoupled storage and compute, and multi-tiered caching mechanisms (result cache, local SSD cache, remote storage), directly relevant to the course content.
- Using Materialized Views, Snowflake Documentation, 2024 (Snowflake) - Official documentation offering practical guidance on defining, managing, and leveraging materialized views within a modern cloud data warehouse, including transparent query rewriting and cost considerations.
© 2025 ApX Machine LearningEngineered with