Once the Data is loaded we will set up ETL Pipeline using AWS Glue to read the data from Redshift Database apply the SQL Transformation on the same and persist the result back to Redshift Table. We would be reading the data from the Redshift Database and writing back the result back to Redshift Table.
In this video, we would be showing a couple of ways to handle that use case.
Chapter #4: Serverless ETL Pipeline Handling Redshift Timestamp with Timezone AWS Glue & Apache SparkĮnd to End Serverless ETL Pipeline Demo handling Redshift Timestamp with TimeZone DataType which AWS Glue or Spark doesn't handle directly.