Senior Data Analyst - Databricks & PySpark (m / w / d)

Einleitungstext

As a digital system provider for Lidl's online business, we at Lidl e-commerce create efficient, scalable digital products and services and develop them further for the future. As a brand of the IT and digital division Schwarz Digits, our divisions are divided into Commerce Platforms, Marketing Tech & Enablement, Payment, New Digital Business Models and SCRM Loyalty Platforms.

Your tasks

• Perform exploratory data analysis on large datasets to identify inconsitencies, trends & anomalies
• Building ETL pipelines & curate data following medallion architecture
• Ensuring data quality & integrity : design and implement robust data quality frameworks, including unit tests and automated schema checks
• Apply statistical methods & techniques to answer business questions
• Experience with Databricks and Snowflake platforms
• Strong proficiency in SQL (nice to have), PySpark and Python (must have)
• Proficiency with local development tools including VSCode, PyCharm, and Git
• Experience in building reports
• Being able to work with or in a setup with : CI / CD, Unit & Integration Tests, Code Quality Tools , Vulnerability Scans
• Working in Cloud Environments