Senior Data Engineer

Job description

Who We Are

Verve has created a more efficient and privacyfocused way to buy and monetize advertising. Verve is an ecosystem of demand and supply technologies fusing data media and technology together to deliver results and growth to both advertisers and publishersno matter the screen or location no matter who what or where a customer is. With 30 offices across the globe and with an eye on servicing forwardthinking advertising customers Verves solutions are trusted by more than 90 of the United States top 100 advertisers 4000 publishers globally and the worlds top demandside platforms. Learn more at .

Who You Are

Were looking for a Senior Data Engineer to join our Data Processing team at Verve. This team is responsible for designing and maintaining scalable realtime and batch data processing pipelines that enable highquality insights and analytics. The Data Processing team works closely with the Data Analytics and Data Science teams to ensure efficient data flows across the organization.

In this role youll focus on developing and optimizing data processing workflows ETL pipelines and streaming solutions. Precision efficiency and highquality deliverables are essential and youll report to the Engineering Manager Data Processing.

If you are passionate about working with big data technologies realtime data processing and optimizing largescale ETL workflows wed love to hear from you!

This is a hybrid position with three days per week in our Berlin office.

What You Will Do

Domain Expertise :

Design develop and maintain scalable efficient and costeffective data pipelines for realtime and batch data processing.

Build highperformance ETL workflows leveraging Kafka Apache Spark and Scala.

Implement best practices for data modeling storage and retrieval ensuring high availability and reliability.

Work with GCPbased data services including BigQuery Dataflow and Cloud Storage.

Optimize the performance and cost efficiency of data processing jobs.

Data Processing & Engineering

Architect and implement scalable streaming and batch processing solutions.

Develop realtime data processing pipelines using Kafka and Apache Spark Structured Streaming.

Ensure the stability and reliability of highvolume data ingestion pipelines.

Write clean testable and efficient code using Scala.

Ensure compliance with data privacy and security best practices.

Collaborative Work

Work closely with Data Analytics and Data Science teams to ensure data is processed stored and accessed efficiently.

Collaborate with the Data Analytics team to provide structured data for data warehouses reporting APIs and UIs.

Support the Data Science team by ensuring highquality data availability for machine learning models.

Work crossfunctionally with engineering and product teams to design endtoend data solutions.

Coordinate with global teams in different time zones to deliver projects successfully.

Extend optimized solutions to sister companies within Verve Group.

Job requirements

What you will bring

MustHave Qualifications :

5 years of experience as a Data Engineer working on largescale ETL / data processing pipelines.

Experience handling daily terabytes of data efficiently.

Strong knowledge of Apache Kafka for streaming data processing.

Strong expertise in Apache Spark (Scala) for batch and realtime processing.

Proficiency in orchestration tools like Apache Airflow.

Proficiency in GCP including services like BigQuery Dataflow and Dataproc.

Solid understanding of data modeling techniques including Star / Snowflake schema and state of the art Lakehouses.

Strong SQL skills including query optimization and performance tuning.

Familiarity with Apache Druid or other OLAP engines.

Strong knowledge of infrastructure as code (Terraform).

NicetoHave Qualifications :

Experience with AdTech or highvelocity data processing environments.

Handson experience with Hadoop ecosystem tools.

Knowledge of containerization (Docker Kubernetes).

Familiarity with BI tools like Looker

Basic DevOps knowledge

What We Offer

Be part of a multicultural team that is bringing advertising to the next level

You will learn and evolve in an empowering environment characterized by entrepreneurial actions

Responsibility independence and an opportunity to participate in projects that have a significant impact on Verves success

3 Wellness days per year (in Q1 Q2 & Q3) and Employee Assistance Program to help you maintain your wellbeing

Enhance your professional skills with a yearly training budget and improve your language skills through German and / or English classes

Work and Travel Program (monthly raffle after 2 years of employment)

We are eager to build a great team together and we appreciate your help through our Employee Referral Bonus

Align your interests with the companys success and take part in our Employee Shares Purchase Plan

You will be entitled to 27 holidays per year in addition to any of the public / bank holidays

Personalized Benefits Platform; with a budget of 100 EUR / month you can choose the benefits that fit you best from the following options :

Internet allowance

Mobility allowance such as BVG / HVV tickets and car / bicycle rental

Kindergarten daycare center subsidy

Sport membership and personal development

Shopping vouchers

Enjoy food and beverage benefits with colleagues and have fun during team events

Take advantage of our Employee offers and discounts

Corporate Pension Scheme

Verve provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race color religion age sex national origin disability status genetics protected veteran status sexual orientation gender identity or expression or any other characteristic protected by federal state or local laws.

LIHybrid

All done!

Your application has been successfully submitted!

Other jobs

Required Experience :

Senior IC

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1