Senior Data Engineer - job 42 of 50

Job Summary

A company is looking for a Senior Data Engineer.

Key Responsibilities

• Create, maintain, and optimize the data platform and analytics architecture
• Develop and manage ETL processes using Spark and Kafka for data ingestion and transformation
• Collaborate with various teams to ensure data infrastructure meets organizational needs

Required Qualifications

• BS or MS degree in Computer Science, Informatics, Information Systems, or related fields, or equivalent work experience
• 5+ years of experience with Databricks platform using PySpark/Scala
• 5+ years of experience with big data technologies including Apache Spark and Apache Kafka
• Strong SQL experience with relational and non-relational databases
• Experience with cloud infrastructure provisioning using Terraform