Assignment Overview

Instead of spending hours debugging syntax errors, you will act as a Lead Enterprise Architect evaluating how a global retail giant ("GlobalMart") should implement Apache Spark to solve their data bottlenecks. You will analyze their requirements, choose the right components, and address data privacy constraints.

The Scenario

GlobalMart generates massive amounts of data daily from three main sources:

1. Point-of-Sale (POS) Transactions: Structured sales data stored in traditional databases.

2. User Clickstream Data: Millions of live clicks per second on their mobile app and website.

3. Customer Reviews & Feedback: Unstructured text data from social media and support tickets.

The executive team wants to use Apache Spark to build a recommendation engine and detect credit card fraud in real time.