Lead Data Engineer

Role :   Lead Data Engineer

Skills :   AWS   S3, GLUE, Lambda, Python, Pyspark, Kinesis, DevOps

Location :   Frankfurt, Germany (Remote)

Type : Permanent

Language Requirement : Must be atleast B2 German Level and Fluent English Speaker

Hiring for Lead Data Engineer with AWS S3, GLUE, Lambda, Python, Pyspark, Kinesis, DevOps

Responsibilities :

• 5-8 years of experience in Data Engineering with a focus on cloud-based solutions.
• Strong expertise in AWS services like S3, Glue, Lambda, and IAM configurations.
• Develop and optimize data pipelines using AWS Glue and Lambda functions.
• Utilize Python to build reusable modules, APIs (Fast API / Flask / Djanog), and automation scripts.
• Lead project teams in designing end-to-end data pipelines and ETL workflows.
• Troubleshoot data processing issues and optimize performance for ETL workflows.
• Experienced in working with Python projects for Data Processing, Data Transformation, building reusable and modular components. Experience in Data Migration is a plus.
• Experienced in both classical Python developments, as well as in Python Notebooks.
• Experienced in AWS components such as S3, Glue, Lambda and Kinesis (KDS)
• Experienced with DevOps and Infrastructure oversight.
• Bachelor’s degree in computer science, Information Technology, or related fields.