Skip to content
#

eventdrivenarchitecture

Here are 30 public repositories matching this topic...

This project demonstrates an event-driven architecture for parallel web scraping and processing tasks using AWS services. The scraper job, running on AWS Batch, collects data from multiple web pages simultaneously and stores it in S3. The processing job, triggered by AWS EventBridge, efficiently processes the scraped data and updates Google-Sheet.

  • Updated Apr 15, 2024
  • Python

Improve this page

Add a description, image, and links to the eventdrivenarchitecture topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the eventdrivenarchitecture topic, visit your repo's landing page and select "manage topics."

Learn more