Under Construction

All course tracks

Mobile and data engineering · 30 lessons · up to 10 minutes each

Data Engineering and Streaming

A planned data engineering path through batch, streaming, backfills, and lineage.

Coming Soon

One-time purchase · USD

Choose what to unlock

Access is attached to your account after payment is verified. No subscription.

One lesson

An individual lesson

This track has no lesson ready to buy yet. Each lesson becomes available only after it is built and reviewed.

$5.00Not available yet

Full category

Data Engineering and Streaming

Permanent access to the lessons published in this track when you buy. Future lessons are not included. 0 of 30 lessons are published; 0 are in owner review and 30 are Coming Soon.

$29.0030 lessons still in progress

Beginner

Lessons 1–10

  1. 01

    Data Engineering and Streaming: Sketch source and schema contract

    Topic: source and schema contract

    Draw a small map of source and schema contract in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner4 minComing Soon
  2. 02

    Data Engineering and Streaming: Name the parts of batch ingestion boundaries

    Topic: batch ingestion boundaries

    Label the main pieces in batch ingestion boundaries in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner5 minComing Soon
  3. 03

    Data Engineering and Streaming: Trace an example of event time and watermarks

    Topic: event time and watermarks

    Follow one input through event time and watermarks in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner6 minComing Soon
  4. 04

    Data Engineering and Streaming: Compare choices for transformation correctness

    Topic: transformation correctness

    Write down one practical difference between transformation correctness in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner7 minComing Soon
  5. 05

    Data Engineering and Streaming: Find the boundary in deduplication and idempotency

    Topic: deduplication and idempotency

    Mark where deduplication and idempotency in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner8 minComing Soon
  6. 06

    Data Engineering and Streaming: Inspect an example of stream partition keys

    Topic: stream partition keys

    Annotate a minimal example of stream partition keys in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner9 minComing Soon
  7. 07

    Data Engineering and Streaming: Connect late and malformed events to a neighboring concept

    Topic: late and malformed events

    Show how late and malformed events in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner10 minComing Soon
  8. 08

    Data Engineering and Streaming: Spot a failure mode in backfill and replay

    Topic: backfill and replay

    Describe one likely failure for backfill and replay in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner3 minComing Soon
  9. 09

    Data Engineering and Streaming: Read an official example of data quality monitoring

    Topic: data quality monitoring

    Summarize an official example of data quality monitoring in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner5 minComing Soon
  10. 10

    Data Engineering and Streaming: Choose a use case for lineage and retention

    Topic: lineage and retention

    Match one small use case to lineage and retention in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Beginner6 minComing Soon

Intermediate

Lessons 11–20

  1. 11

    Data Engineering and Streaming: Build an example with source and schema contract

    Topic: source and schema contract

    Create a small working example that uses source and schema contract in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate4 minComing Soon
  2. 12

    Data Engineering and Streaming: Compose batch ingestion boundaries with another component

    Topic: batch ingestion boundaries

    Combine batch ingestion boundaries in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate5 minComing Soon
  3. 13

    Data Engineering and Streaming: Configure event time and watermarks for a small case

    Topic: event time and watermarks

    Set up event time and watermarks in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate6 minComing Soon
  4. 14

    Data Engineering and Streaming: Validate inputs around transformation correctness

    Topic: transformation correctness

    Add a check around transformation correctness in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate7 minComing Soon
  5. 15

    Data Engineering and Streaming: Use deduplication and idempotency in a short workflow

    Topic: deduplication and idempotency

    Add deduplication and idempotency in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate8 minComing Soon
  6. 16

    Data Engineering and Streaming: Refactor stream partition keys into a reusable unit

    Topic: stream partition keys

    Extract stream partition keys in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate9 minComing Soon
  7. 17

    Data Engineering and Streaming: Exercise late and malformed events with sample data

    Topic: late and malformed events

    Run sample data through late and malformed events in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate10 minComing Soon
  8. 18

    Data Engineering and Streaming: Observe backfill and replay outputs

    Topic: backfill and replay

    Capture the result of backfill and replay in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate3 minComing Soon
  9. 19

    Data Engineering and Streaming: Recover from a data quality monitoring failure

    Topic: data quality monitoring

    Handle one expected failure from data quality monitoring in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate5 minComing Soon
  10. 20

    Data Engineering and Streaming: Document lineage and retention behavior

    Topic: lineage and retention

    Write a short usage note for lineage and retention in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Intermediate6 minComing Soon

Advanced

Lessons 21–30

  1. 21

    Data Engineering and Streaming: Test a boundary around source and schema contract

    Topic: source and schema contract

    Add an edge-case test for source and schema contract in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced4 minComing Soon
  2. 22

    Data Engineering and Streaming: Harden batch ingestion boundaries

    Topic: batch ingestion boundaries

    Add the relevant access, safety, or validation control to batch ingestion boundaries in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced5 minComing Soon
  3. 23

    Data Engineering and Streaming: Measure event time and watermarks

    Topic: event time and watermarks

    Record a small baseline for event time and watermarks in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced6 minComing Soon
  4. 24

    Data Engineering and Streaming: Reduce cost in transformation correctness

    Topic: transformation correctness

    Change one measurable cost in transformation correctness in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced7 minComing Soon
  5. 25

    Data Engineering and Streaming: Diagnose a deduplication and idempotency failure

    Topic: deduplication and idempotency

    Use an observable signal to explain a failure in deduplication and idempotency in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced8 minComing Soon
  6. 26

    Data Engineering and Streaming: Make stream partition keys repeatable

    Topic: stream partition keys

    Show that rerunning stream partition keys in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced9 minComing Soon
  7. 27

    Data Engineering and Streaming: Review trade-offs in late and malformed events

    Topic: late and malformed events

    Compare two documented approaches to late and malformed events in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced10 minComing Soon
  8. 28

    Data Engineering and Streaming: Improve backfill and replay maintainability

    Topic: backfill and replay

    Refine backfill and replay in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced3 minComing Soon
  9. 29

    Data Engineering and Streaming: Verify data quality monitoring end to end

    Topic: data quality monitoring

    Check that a complete small flow using data quality monitoring in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced5 minComing Soon
  10. 30

    Data Engineering and Streaming: Audit lineage and retention against its source docs

    Topic: lineage and retention

    Check the implementation of lineage and retention in the context of reliable ingestion, event time, replay, and data quality; save a short example or check that demonstrates the result.

    Advanced6 minComing Soon

Reference documentation

References support the selected track topics while its lesson content is built and reviewed progressively.

This track is a catalog outline only. Each lesson remains unavailable until it is built and personally reviewed.