Senior Data Engineer - Azure & Databricks

InventYOU AB; Kentucky; On-site; USD 120,000 - 180,000; Full time

Job summary

InventYOU AB is seeking an experienced Senior Data Engineer in the United States (Kentucky) to design and deliver scalable data solutions using Microsoft Azure and Databricks. You will work on modern data pipelines, Lakehouse architectures, data modeling and data quality while ensuring governance and performance standards.

The role emphasizes building reusable data products, collaborating with analytics, architecture, governance, security, and engineering teams, and contributing through Git,

Qualifications

• 5+ years of relevant professional experience.
• Strong experience with Azure Data Factory.
• Strong experience with Azure Databricks.
• Experience with Azure SQL.
• Strong knowledge of PySpark and Spark SQL.
• Experience with Delta Lake.
• Strong data modeling skills.
• Experience with data quality management.
• Experience working within Agile environments.
• Practical experience with Git, DevOps, and CI/CD pipelines.
• Proficiency in Greek and English.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Data Factory and Azure Databricks.
• Build and optimize Azure SQL, Data Lake, and Lakehouse solutions.
• Develop reusable data products and data models.
• Implement data quality controls, monitoring, and operational support.
• Develop and optimize solutions using PySpark and Spark SQL.
• Work with Delta Lake and Unity Catalog.
• Apply security, access control, governance, and performance standards.
• Collaborate with analytics, architecture, governance, security, and engineering teams.
• Contribute through Git, DevOps, automated testing, and CI/CD practices.

Skills

Azure Data Factory

Azure Databricks

Azure SQL

PySpark

Spark SQL

Delta Lake

Data Modeling

Data Quality

Git, DevOps, CI/CD

Greek & English

Security & Governance

Tools

Git

CI/CD pipelines

Delta Live Tables

Unity Catalog

Job description

We are looking for an experienced Senior Data Engineer to design and deliver scalable data solutions and reusable data products using Microsoft Azure and Databricks.

You will work across modern data pipelines, Lakehouse architectures, data modeling, data quality, governance, and performance optimization.

Key Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Data Factory and Azure Databricks
• Build and optimize Azure SQL, Data Lake, and Lakehouse solutions
• Develop reusable data products and data models
• Implement data quality controls, monitoring, and operational support
• Develop and optimize solutions using PySpark and Spark SQL
• Work with Delta Lake and Unity Catalog
• Apply security, access control, governance, and performance standards
• Collaborate with analytics, architecture, governance, security, and engineering teams
• Contribute through Git, DevOps, automated testing, and CI/CD practices

• 5+ years of relevant professional experience
• Strong experience with Azure Data Factory
• Strong experience with Azure Databricks
• Experience with Azure SQL
• Strong knowledge of PySpark and Spark SQL
• Experience with Delta Lake
• Strong data modeling skills
• Experience with data quality management
• Experience working within Agile environments
• Practical experience with Git, DevOps, and CI/CD pipelines
• Proficiency in Greek and English

Nice to Have

• Power BI
• Collibra
• Soda
• Delta Live Tables

You will be a great candidate for us if you

• Enjoy building scalable modern data platforms
• Have strong data engineering and analytical skills
• Care about data quality, performance, security, and governance
• Enjoy collaborating across engineering, analytics, and business teams

Why join inventYOU

• Work with Azure, Databricks, PySpark, and modern Lakehouse technologies
• Build enterprise-scale data solutions and reusable data products
• Collaborate with experienced data and technology professionals
• Continue developing your expertise in modern cloud data engineering