Jump to content

Extract, load, transform

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Cnharris10 (talk | contribs) at 20:56, 12 February 2020 (Added Storage and Querying managed services across AWS, Azure, GCP for implementing ELT-based data lakes). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

ELT is an alternative to extract, transform, load (ETL) used with data lake implementations. In ELT models the data is not processed on entry to the data lake which enables faster loading times. ELT is a data pipeline model.[1] But ELT does require sufficient processing within the data processing engine to carry out the transformation on demand and return the results to the consumer in a timely manner. Since the data is not processed on entry to the data lake the query and schema do not need to be defined a-priori (often the schema will be available during load since many data sources are extracts from databases or similar structured data systems and hence have an associated schema).

Cloud Data Lake Components

Common Storage Options

Querying

References

  1. ^ Using Redshift Spectrum to load data pipelines Published by dativa.com on January 17, 2018, retrieved on April 3, 2019