Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.


This repository contains code that pulls data from a target Ed-Fi API and creates tables data marts in BigQuery that conform to the Analytics Middle Tier specificationserve the analytics use case.

Demonstration video:

More specifically, this repository is a Dagster workspace that contains a job designed to:

  • Extract data from a set of Ed-Fi API endpoints
  • Store the data as JSON files in a cloud based blob storage service
  • Query the JSON files from a cloud data warehouse to produce:
    • Tables that represent the Ed-Fi API endpoints
    • Tables that meet the spec of the Analytics Middle Tier
This repository currently supports Google Cloud Storage, BigQuery, and the subset of the Analytics Middle Tier necessary to power the Chronic Absenteeism Starter Kit use case.
    • Dimension and fact tables