Senior Azure Data Engineer - Spark & Databricks

We are seeking a highly skilled and motivated Data Engineer to join a long-term project within a leading systemic bank, to be contracted via a major Microsoft Partner and collaborate with Microsoft itself. This is a unique opportunity to work at the intersection of finance and cutting-edge technology, contributing to the transformation of the bank’s data infrastructure.

As part of this engagement, you will be embedded within the bank’s data organization, reporting to a senior technical leader who in turn reports to the CTO, and collaborating closely with Microsoft’s account team. 

The position offers the opportunity to work remotely, with occasional on-site meetings in Athens (2–3 times per month).

Key Responsibilities:

• Design and implement scalable data pipelines and ingestion processes across Azure cloud environments
• Work with Apache Spark and the Azure Databricks platform to enable large-scale data processing
• Utilize Delta Lake to support data versioning, schema enforcement, and ACID-compliant transactions
• Collaborate with business and technical teams to integrate data from multiple sources including Azure Data Lake and Azure SQL Database
• Perform complex data transformations using DataFrame APIs and Spark SQL
• Develop and manage Delta Live Tables and orchestrate data workflows using Azure Data Factory
• Implement CI/CD workflows within Azure Databricks to streamline development and deployment
• Build SQL-based reporting layers and contribute to dashboard and data visualization development (e.g., Power BI)

Desired Skills & Experience:

• Proven experience in data engineering roles with a focus on Azure technologies
• Hands-on expertise in Apache Spark and Databricks
• Familiarity with Delta Lake and related architectural patterns
• Experience integrating structured and semi-structured data sources
• Proficient in SQL, Spark SQL, and Python (preferred)
• Exposure to CI/CD pipelines and modern DevOps practices within Azure
• Strong collaboration and communication skills in cross-functional teams

• Type of Engagement: Full-time contractor with a competitive remuneration (either I.K.A. employee or EU-based contracting company or Freelancer).

• Location: Remote-first within Greece, with the flexibility to attend occasional meetings near Maroussi Ring Road (2–3 times/month)
• Contracting Entity: Collaboration facilitated via a major Microsoft Partner but in essence the person belongs to the Bank and collaborates closely with the Microsoft Greece Branch.