Posts

Showing posts from September, 2023

Processing Notification and Queue data in AWS

Image
Data ingestion in Batch (typically large datasets) and Real time (trickle feeds) are the most common forms of ingesting data. In this blog let us look processing the data which has been ingested via Notifications and Queues. Notifications are typically used to inform users of events, while queues are typically used to store and process messages in a specific order. Examples of notifications : An email notification that you have received a new message. A push notification on your phone that a new app update is available. A pop-up notification on your computer that a new file has been downloaded. Examples of queues : A queue of print jobs waiting to be printed. A queue of emails waiting to be sent. A queue of tasks waiting to be executed by a background worker process. The table below summarizes some key concepts of Notifications and queues: Feature Notification Queue Purpose To inform