Data Engineer
The Role
My client are seeking a talented Data Engineer to join their growing team. You will play a key role in designing, building, and maintaining our data pipelines and infrastructure.
This role requires a strong understanding of PostgreSQL databases and experience working with cloud platforms.
Responsibilities
Design, develop, and implement data pipelines for ingesting, transforming, and loading data from various sources into our data warehouse.
Optimize PostgreSQL databases for performance and scalability.
Develop and maintain SQL queries for data extraction, transformation, and analysis.
Work with cloud platforms (AWS preferred) to provision and manage data storage, compute resources, and containerized applications.
Write code in scripting languages (e.g., Python, Bash) to automate data engineering tasks.
Collaborate with data analysts, data scientists, and software engineers to ensure data quality and accessibility.
Document data pipelines, schemas, and procedures.
Stay up-to-date on the latest data engineering and cloud technologies.
Qualifications
Strong expertise in PostgreSQL, including database design, administration, performance tuning, and security.
Proficiency in SQL for data extraction, transformation, and analysis.
Experience with cloud platforms (AWS preferred) for data storage, compute resources, and services (e.g., S3, DynamoDB, Redshift, Aurora, Athena).
Experience with scripting languages (e.g., Python, Bash).
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Ability to work independently and as part of a team.
Ability to manage complex projects and interact effectively with other teams.
Bonus Points
Interest in working on providing solutions to environmental sustainability.
Experience with database change management systems like Liquibase, Flyway etc
Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
Experience with data warehousing concepts (e.g., dimensional modelling, slowly changing dimensions etc).
Certifications in cloud platforms or data engineering tools (e.g., AWS Certified Data Engineer).
Junior Cloud Data Engineer Supply Solutions (m/w/d) - System Engineering / Admin, Datenbankentwicklung/BI, Ingenieur
Durch unsere digitalen Lösungen aus den Bereichen MDM, BI, Analytics, Big Data sowie IoT gelingt es Unternehmen aus Daten relevantes Wissen zu generieren, Prozesse auf smarte Weise zu digitalisieren und somit die Welt von Morgen mit neuen Produkten zu begeistern. Unser Geschäftsbereich New...
Data Engineer (m/w/d)
Mehrjährige Consulting Praxis im Cloud, Data Warehouse, Data Management oder Data Lake Umfeld. Gute Kenntnisse in der Konzeptionierung, Architektur, Entwicklung und Implementierung von Cloud Datenplattformen (Data Warehousing, Data Lake oder Data Lakehouse) auf den Hyper Scalern AWS, Azure, GCP im Z...
Cloud Data Infrastructure Engineer (all genders)
Der Bereich Data Platform Solutions ist verantwortlich für die Umsetzung komplexer Big Data und Cloud Analytics Projekte für unsere namhaften Kunden. In deiner Rolle als Cloud Data Infrastructure Engineer bist du Teil eines innovativen und stetig wachsenden Teams und bis verantwortlich für stabile u...
Composable Data Stack Python Engineer
We are looking for a Software or Data Engineer who is experienced in high-performance Python data processing libraries (often referred to as the . You can use the library to move data from about anywhere into the most well-known SQL and vector stores, data lakes, storage buckets, or local engin...
Data Engineer Fintech (m/f/d) - Berlin or remote
Understand and transform raw data into actionable data products that Analytics and Data Science can use across Fintech and other data domains. Develop and maintain strong collaborative relationships with internal stakeholders, with a strong focus on data analysts, data scientists, and software engin...
Machine Learning Engineer / Data Scientist - Google Cloud (all genders)
Du siehst dich als Mischung aus Machine Learning Profi, Software Engineer und Hacker? Du konntest bereits Erfahrung im Bereich Deep Learning, Computer Linguistik sammeln darüber hinaus zeichnet dich dein hoher Qualitätsanspruch sowie deine Lernbereitschaft aus? Dann bist du bei uns im Google Cloud T...
Senior Data Engineer (m/w/d) – Python Entwickler
Datenplattform für Business Intelligence, Digital Analytics, Marketing Controlling und Data Science betreiben und kontinuierlich weiterentwickeln. Datenquellen an das Data Warehouse anbinden, die Qualitätssicherung der importierten Daten übernehmen, Datenarchitekturen sowie ETL-Prozesse konzipieren,...
Automation Data Engineer (f/m/d)
As an Automation Data Engineer you will gain hands-on experience in a dynamic and collaborative environment, working on real-world data challenges and contributing to our mission of leveraging data for impactful insights and innovation. Manage external data sources and integrations into automations ...
Data Engineer, Core Data Platform
The Data Platform team plays the central role in our data-driven strategy, designing and developing our data ecosystem, data processes and analytics capabilities. Data Engineer, Core Data Platform. Data Engineer, Core Data Platform. You will play a key role in designing and developing our data ecosy...
Senior Data Engineer (f/m/x) - Cash Data Technology
As a Senior Data Engineer (f/m/x) you'll be part of the team responsible for building Big Data platform capabilities, including ingesting pipelines, big data processing pipelines and data preparation. We have a strong focus on promoting technical excellence - our engineers work at the forefront of f...