Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Leveraging Argo Events and Argo Workflows for Scalable Data Ingestion

The Open Source Analytics Community (OSA COM)
413 subscribers
<__slot-el>
<__slot-el>
74 views 5 months ago
As Argo Workflows and Argo Events continue to gain popularity for their powerful capabilities in event-driven automation and complex job orchestration, this presentation will delve into how we used this architecture to process millions of records daily. You will gain insights into the specific architecture that integrates Argo Events and Argo Workflows to achieve efficient data aggregation and ingestion. We will discuss the challenges encountered during this process and share the strategies we employed to overcome these issues. Attendees will also learn how we use techniques like “Work avoidance” to ensure we don’t redo the work. ...more
...more
Leveraging Argo Events and Argo Workflows for Scalable Data Ingestion
1Likes
74Views
Dec 92024
As Argo Workflows and Argo Events continue to gain popularity for their powerful capabilities in event-driven automation and complex job orchestration, this presentation will delve into how we used this architecture to process millions of records daily. You will gain insights into the specific architecture that integrates Argo Events and Argo Workflows to achieve efficient data aggregation and ingestion. We will discuss the challenges encountered during this process and share the strategies we employed to overcome these issues. Attendees will also learn how we use techniques like “Work avoidance” to ensure we don’t redo the work.

Follow along using the transcript.

The Open Source Analytics Community (OSA COM)

413 subscribers