Working with Amazon S3 Object Lambda

Learn how to use S3 Object Lambda to process and transform your data as it is being retrieved from Amazon S3.

In some cases, these applications have different requirements for the same set of data and therefore, they might need a different view of the data.

For instance, a dataset created on Amazon S3 may include columns with personally identifiable information (PII). These columns might be visible when accessed by the IT department, but not needed when the same data is processed for reporting and should be redacted.

Until now, to tackle this use case on AWS, we had several options. Duplicate the data and perform additional transformations to the columns containing PII or create and manage infrastructure as a proxy layer in front of Amazon S3 to retrieve and transform the data as it is requested.

This post will demonstrate how to use S3 Object Lambda by solving a simple use case. We will generate sales and inventory related events to an Amazon S3 bucket, where multiple applications will be able consume these events.

Related posts:

A good Medium post needs good photos. The right image can make the difference between a member clicking or moving on. It can make the difference between curation and stagnation.

This was the first event we’ve organized that had an instructor-led interactive coding session. The new class-like format is part of our plan to expand Cryptozombies to cater to different learning…

The Business Council of Australia which includes some of Australia’s biggest companies has agreed to spend more than $3 billion in the next five years assisting indigenous businesses. The council’s…