Data Engineer II - job 4 of 21

Job Summary

A company is looking for a Data Engineer II to build and maintain scalable data pipelines and support analytics initiatives.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks, Apache Spark, and Python
• Collaborate with data engineering teams to integrate data from various source systems to Azure
• Ensure data quality, integrity, and security throughout the data pipeline and Lakehouse architecture

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
• 5+ years of experience in cloud development practices
• Strong expertise in cloud platforms (AWS, Azure, GCP) and virtualization
• Preferred experience with infrastructure automation tools (Terraform, Ansible, Kubernetes)
• Knowledge of cybersecurity best practices and disaster recovery planning