Azure Data Engineer
Job Description
Our client, a leading global IT service provider,is recruiting for aAzure Data Engineer to join their business in Germany.
Required Skills and Roles & Responsibilities :
Bachelor's or Master's degree in Computer Science, Engineering, or related field
8+ years of experience in big data engineering, data warehousing, and data integration
3+ years of experience in cloud-based big data platform development using Azure cloud services
Experience in developing CI / CD pipelines for Azure SQL, Azure Databricks, and Azure Data Factory
Experience in developing and managing big data processing pipelines using Apache Spark, Hadoop, and other big data technologies
Experience in developing and managing machine learning pipelines for building and deploying machine learning models on big data
Experience in developing and managing data visualization and reporting mechanisms
Design and develop big data platform architecture based on Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others
Design and implement data ingestion pipelines for ingesting data from various sources such as databases, APIs, and other sources
Develop and manage big data processing pipelines for performing data transformations, aggregations, and analytics using Apache Spark and other big data technologies
Design and implement data storage mechanisms based on Azure cloud services such as Azure Data Lake Store, Azure Blob Storage, and others
Work closely with other members of the team such as data scientists, data analysts, and software engineers to understand their requirements and integrate their solutions into the big data platform
Develop and implement test strategies, plans, and cases for Azure SQL, Azure Databricks, and Azure Data Factory
English language fluent, German language desirable.
Technical Skills :
Expertise in Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others.
Expertise in big data processing technologies such as Apache Spark, Hadoop, and others
Proficiency in programming languages such as Python, Java, Scala, and others
Experience in developing and managing CI / CD pipelines using tools such as Azure DevOps, Jenkins, and others
Experience in developing and managing data integration pipelines using tools such as Azure Data Factory, Apache Nifi, and others
Experience in developing and managing data storage mechanisms based on Azure cloud services such as Azure Data Lake Store, Azure Blob Storage, and others.
Freelance Data Engineer (Python & Azure)
Role: Data Engineer (Python & Azure). Working within an agile development team, you will work on a recently built Azure data platform, where you will be responsible for migrating legacy data and applications to the new platform. You will work alongside other Software Engineers, Data Engineers, User ...
Senior Cloud Data Engineer (m/w/d) Azure und Databricks
Senior Cloud Data Engineer (m/w/d) Azure und Databricks. Du konntest mehr als 5 Jahre nachweisbare Erfahrung als Data Engineer im Bereich Data&Analytics Lösungen (Microsoft und Databricks) oder in einer ähnlichen Position sammeln. Bei INFOMOTION arbeitest Du als Consultant (m/w/d) – Cloud Data Engin...
Freelance Data engineer - AWS or Azure, Germany or Netherlands
Freelance Data engineer - AWS or Azure, Germany OR Netherlands. My client a leading German Energy company are looking for 2x freelance Data engineers to join them in Germany or Netherlands, Remote. At least 4 years of experience in Data engineering. MUST be based in Germany or Netherlands to join a ...
Azure Data Engineer
Design and develop big data platform architecture based on Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others. Expertise in Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others. Experience in developing CI/CD...
Azure Cloud Engineer* for Data Platforms
Azure Cloud Engineer* for Data Platforms bei b. Azure Cloud Engineer* for Data Platforms. Analytics und Data Management spezialisierte technologieunabhängige Beratung. CI/CD Pipelines sind Dein Mittel der Wahl, um Infrastruktur auszurollen -> dabei ist Dir egal, ob es sich um Github Actions, Gitl...
Azure Data Engineer
Design and develop big data platform architecture based on Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others. Expertise in Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others. Design and implement data stor...
Azure Data Engineer
Design and develop big data platform architecture based on Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others. Expertise in Azure cloud services such as Azure HDInsight, Azure Databricks, Azure Data Lake Store, and others. Design and implement data stor...
Junior Data Scientist (m/w/d) in Neckarsulm
Als Data Science Team begleiten wir Lidl auf den Weg zu einem datengetriebenen und KI-befähigten Unternehmen. Erarbeitung von Problemstellungen gemeinsam mit den Fachbereichen bei denen Data Science einen echten finanziellen Mehrwert für Lidl liefert. Gute Kenntnisse in der Anwendung von Machine-Lea...
Azure Cloud DevOps Engineer (gn) M/W/D
Dich begeistert das Arbeiten mit Clouds?Du bringst mehrjährige Berufserfahrung mit der Cloud-Plattform Azure mit?Dann bist du hier genau richtig!....
Software Developer as Senior Software Engineer SAP GTS (m/f/d)
In your new role you will design, develop and maintain SAP software applications and systems like "SAP GTS" and "SAP GTS, edition for SAP HANA". Furthermore, you will write code, conduct testing, resolve issues and collaborate with teams to ensure that the software is functional, reliable and user-f...