Element / Retail - Automated Mapping of Nielsen Product Data
Automated Mapping of Nielsen Product Data
Problem :
Mapping Nielsen product data with regional sales figures required extensive manual effort. This process was time-consuming, error-prone, and led to outdated or incorrect KPIs in dashboards, forcing stakeholders to raise incidents repeatedly.
Solution :
A Natural Language Processing (NLP) script was developed to read product data from Azure Data Lake and intelligently map it with regional sales data. A PySpark script executed via Databricks and automated through Azure Data Factory (ADF) pipelines ensured timely and accurate execution every Mars period.
Outcome :
Manual intervention was reduced by 60%, mapping errors were significantly lowered, and stakeholders could rely on accurate, updated KPIs with zero dependency on support teams.