Senior Data Engineer - AI/Databricks on Azure (Remote)

Jobgether; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Food and meal allowances

Childcare assistance

Extended parental leave

Fitness and wellbeing programs

Profit-sharing (PLR)

Life insurance

Continuous learning platform

Online education partnerships

Language learning platform

Discount program

Wellbeing platform access

Job summary

Jobgether is seeking a senior data engineer to design and optimize cloud-based data pipelines using Azure, Databricks, PySpark and SQL. You will build scalable ETL/ELT workflows, implement CI/CD deployments, and collaborate with data scientists and engineers to deliver reliable data products.

You will mentor juniors, enforce data governance, monitor performance, and contribute to data architecture and migration projects as part of a global team.

Qualifications

• Senior-level data engineering with production-grade pipelines.
• Strong experience with Azure data services and Databricks.
• Proficiency in PySpark, Python, and SQL for transformation and automation.
• Experience with CI/CD practices and automated deployment workflows.
• Git/GitHub for source control and Azure DevOps for deployment automation.

Responsibilities

• Design, develop, maintain, and optimize ETL/ELT data pipelines using Azure, Databricks, and PySpark.
• Implement automated workflows for data ingestion, transformation, integration, processing, and delivery to downstream systems.
• Monitor pipeline performance and implement improvements to data processing workflows.
• Establish and maintain data quality controls and governance.
• Collaborate with business stakeholders and data scientists to deploy AI models in cloud environments.

Skills

Azure Data Services

Databricks

PySpark

Python

SQL

CI/CD

Git & GitHub

Azure DevOps

Data Modeling

Data Pipelines

Education

Bachelor's degree in Computer Science or related

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

Apache Spark

Databricks

Job description

Jobgether is seeking a senior data engineer to design and optimize cloud-based data pipelines using Azure, Databricks, PySpark and SQL. You will build scalable ETL/ELT workflows, implement CI/CD deployments, and collaborate with data scientists and engineers to deliver reliable data products.

You will mentor juniors, enforce data governance, monitor performance, and contribute to data architecture and migration projects as part of a global team.