--

Hey Andriy, first of all thanks for asking such a brilliant question and would like to appreciate that you are correct on that part. But there can be a method to actually handle this situation. If you see as when you select Event based triggers, then in that case it becomes real time CDC as it will trigger the Appflow Job for each event and will create a seperate CSV on S3 bucket for each event in real time. But if you want to capture CDC in more batch fashion, then you can use On demand trigger or can schedule it based on your requirement, so automatically it will push all the changes in a single CSV file on S3 and then you can consume it. Hope that makes sense! Let me know if you have any other question. Thanks!

--

--

Rajas Walavalkar
Rajas Walavalkar

Written by Rajas Walavalkar

Technical Architect - Data & AWS Ambassador at Quantiphi Analytics. Worked on ETL, Data Warehouses, Big Data (AWS Glue, Spark), BI & Dashboarding (D&A).

No responses yet