Data Engineer - job 41 of 50

Job Summary

A company is looking for a Data Engineer to design and maintain scalable data infrastructure.

Key Responsibilities

• Design and build infrastructure on top of CDC from PostgreSQL to S3, Spark, Parquet, ClickHouse
• Maintain data infrastructure for analytics
• Formulate requirements for new data sources and integrate them into existing aggregate data models

Required Qualifications

• 3+ years of experience in data engineering
• Hands-on experience with the AWS cloud stack
• Experience working with PostgreSQL, S3, Spark, Airflow, Parquet, and ClickHouse
• Experience designing data marts and developing ETL processes
• Proficiency in or a desire to learn Python