Senior Data Engineer — Cloud Pipelines & Data Platform

DataArt; New York (NY); On-site; USD 150,000 - 180,000; Full time

Benefits offered by this job

Vacation policy

Health insurance

Corporate events

Tech support

Job summary

DataArt is seeking a Senior Data Engineer to manage Databricks environments, orchestrate data pipelines, and ensure robust data governance across Azure cloud services. You will collaborate with business users to deliver reliable data assets and scalable analytics capabilities.

The role requires strong Python coding skills, experience with Snowflake/SQL Server, and proficiency in modern BI tools such as Tableau and Sigma.

Qualifications

• 3+ years of Databricks management experience.
• 3+ years of experience with integrated services on Azure.
• 3+ years of Python programming experience.
• 1+ year of experience with agentic coding assistants.
• Strong experience with data governance, security, and CDC.

Responsibilities

• Manage Databricks instances, onboarding datasets, permissions, security and governance.
• Set up automated pipelines to import data sources into the data warehouse.
• Create automated data refreshes, validation, and monitoring processes.

Skills

Databricks management

Azure services

Python programming

Data pipeline design

Data quality monitoring

Communication skills

Independent problem solving

Education

Bachelor's degree in Computer Science or related field

Tools

Snowflake

SQL Server

Tableau

Sigma

GitHub Actions

CI/CD pipelines

Job description

DataArt is seeking a Senior Data Engineer to manage Databricks environments, orchestrate data pipelines, and ensure robust data governance across Azure cloud services. You will collaborate with business users to deliver reliable data assets and scalable analytics capabilities.

The role requires strong Python coding skills, experience with Snowflake/SQL Server, and proficiency in modern BI tools such as Tableau and Sigma.