Wednesday, April 6, 2022
3:45 PM - 5:00 PM
Getting data out of Ed-Fi to empower analytics and other needs is a revolving topic within the Ed-Fi community in which various solutions are emerging. This session will look at various topics such as Extract-Load-Transform (ELT) vs Extract-Transform-Load (ETL) and also bulk data out from Ed-Fi ODSs.
These broad session notes attempt to capture the spirit of the discussion and should not be interpreted as a transcript. Although Ed-Fi Alliance staff were involved in capturing these observations, the notes below should not be construed as official, complete, or 100% accurate.
The session started with a long summary of the various data out strategies found today and was not meant to be exhaustive. They speakers went into the pros and cons of the typical methods for data access and then proposed a solution that directed all data out to go through the API. Both Jeremy and Andrew then discussed their modern data stack and the benefits of that solution. A majority of the questions and discussions were from the audience to better understand that strategy from technology to human resourcing. Some topics that came up in the discussion included:
- All programming and technology stacks have json handling now
- This would allow the alliance to focus on change queries and populating the data
- Solutions built on Ed-Fi's API are much less fragile because it reduces some complexity on how it is stored within the operational data store
- The Analytics Middle Tier (AMT) is coupled to this conversation and will be held in a different session but both solutions can work together