Azure Data Engineer

JSAN Consulting provides technology consulting and staffing solutions throughout Europe, USA and APAC, and we pride ourselves on our highly professional and service focused approach.

Our unique value proposition of being better, faster and less expensive is compelling to our clients, most of whom regard us as a long term partner helping them to achieve their business objectives.

Headquartered in Berlin, Germany and with operations in four countries in Europe, providing recruitment services, technology consulting, software development and outsourcing services.

The Role

Your responsibilities will include :

• Platform Development and Management :
• Data Ingestion and Integration :
• Data Processing and Analytics :
• Data Storage and Management :
• Collaboration and Communication :
• CI / CD Pipelines Development :
• Testing and Quality Assurance :
• Documentation and Training :
• Design and develop big data platform architecture based on Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others
• Design and implement data ingestion pipelines for ingesting data from various sources such as databases, APIs, and other sources
• Develop and manage big data processing pipelines for performing data transformations, aggregations, and analytics using Apache Spark and other big data technologies
• Design and implement data storage mechanisms based on Azure cloud services such as Azure Data Lake Store, Azure Blob Storage, and others
• Work closely with other members of the team such as data scientists, data analysts, and software engineers to understand their requirements and integrate their solutions into the big data platform
• Develop and implement test strategies, plans, and cases for Azure SQL, Azure Databricks, and Azure Data Factory

Ideal Profile

Technical Skills :

• Expertise in Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others
• Expertise in big data processing technologies such as Apache Spark, Hadoop, and others
• Proficiency in programming languages such as Python, Java, Scala, and others
• Experience in developing and managing data integration pipelines using tools such as Azure Data Factory, Apache Nifi, and others
• Experience in developing and managing data storage mechanisms based on Azure cloud services such as Azure Data Lake Store, Azure Blob Storage, and others
• Bachelor's or Master's degree in Computer Science, Engineering, or related field
• 8+ years of experience in big data engineering, data warehousing, and data integration
• 3+ years of experience in cloud-based big data platform development using Azure cloud services
• Experience in developing CI / CD pipelines for Azure SQL, Azure Databricks, and Azure Data Factory
• Experience in developing and managing big data processing pipelines using Apache Spark, Hadoop, and other big data technologies

Soft Skills :

• Excellent problem-solving and analytical skills
• Strong communication and interpersonal skills
• Ability to work independently and in a team environment
• Strong attention to detail and commitment to quality
• Ability to manage multiple projects and priorities
• Willingness to learn and adapt to new technologies and approaches

What's on Offer?

• Work within a company with a solid track record of success
• Flexible working options
• Join a well known brand within IT Services
Vor 30+ Tagen