AWS Builder Center

You Don't Always Need Glue Between Kinesis and Redshift

When people ask how to get streaming data into Redshift, the usual answer is Kinesis → Firehose/Glue → S3 → COPY. That works for many workloads, but it can be overkill if you just need raw stream data queryable in Redshift quickly, with little or no transformation. Redshift supports native streaming ingestion from Kinesis Data Streams, available since late 2022. This article covers how it works, how to set it up, and when you still need Glue.

Most Kinesis-to-Redshift tutorials default to the same path: stream into Firehose or Glue, land it in S3, then  COPY  it into Redshift. That's the right call when you need a durable data lake copy or heavier transformations, but if all you actually need is the raw stream queryable in Redshift fast, it's an extra hop you can skip. Redshift has supported native streaming ingestion straight from Kinesis Data Streams since it went GA in late 2022, reading records directly into a materialized view with no Firehose, no Glue job, and no S3 staging in between, and most teams still don't use it. Setup is a Kinesis-read IAM role attached to your cluster or workgroup, an external schema pointing at the stream, and a materialized view built with  AUTO REFRESH YES  that you then extract typed columns from. It stops being the right tool once you need a durable raw copy in S3, transformations heavier than SQL can handle cleanly, or you're fanning the stream out to more than one destination, at which point Glue or Firehose earns its place back in the pipeline, sometimes running alongside streaming ingestion rather than instead of it. Everything here comes from public AWS documentation and general patterns, not any employer or proprietary system, and I'm not affiliated with AWS, just a builder pointing out where a common default adds a hop you might not need.
Any opinions in this article are those of the individual author and may not reflect the opinions of AWS.
Enjoyed reading this content? Let the author know!

Your likes, comments, shares, and saves help creators reach more builders.

Loading recommendations

Loading article