Job Role - Spark Specialist
Location - Dresden, Germany
Mode - Hybrid
Type - B2B Freelance Contract
Responsibilities
- Designing a data warehouse (including different storage technologies, appropriate file system, Hardware footprint optimization, …)
- Exposure to big scale projects in similar industries, where data correctness and completeness is highly important
- Deployments in private cloud (using Kubernetes, docker images, …)
- Few Keywords : Spark, Delta Lake, Iceberg, Apache Hudi, Graph Database, HDFS, Parquet,
Profile
Experience & Seniority with Java (as main programming language)Proven experience in Data Engineering and Date WarehouseExperience with storing and reading big amount of data, including read / write performance tuning (across databases), hands-on with concrete real project situationsKow how in Spark, Delta Lake, Iceberg, Apache Hudi, Graph Database, HDFS, Parquet,