Senior Azure Data Engineer — Pipelines & Databricks

Speridian

Austin (TX)

On-site

USD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Speridian in Austin, TX seeks a seasoned Data Engineer to design, build, and optimize Azure-based data pipelines. You will leverage Azure Data Factory and Databricks to deliver scalable data solutions, integrate data from multiple sources, and support analytics-driven decision making.

The role requires 8–12 years of data engineering experience, strong SQL/NoSQL skills, and expertise in data warehousing and ETL/ELT processes.

Qualifications

  • 8–12 years of experience as a data engineer.
  • Proficient in designing, developing, and maintaining data pipelines in Azure.
  • Expertise with Azure Data Factory (ADF) for data integration and orchestration.
  • Experience with Azure Databricks for data processing and analytics.
  • Deep knowledge of SQL and NoSQL databases.
  • Experience with data warehousing and data modeling.
  • Familiarity with ETL/ELT processes and tools.
  • Ability to optimize and troubleshoot data pipelines for performance and scalability.
  • Experience with version control and deployment tools like Git and Azure DevOps.
  • Strong understanding of cloud computing concepts, data security, and privacy.

Responsibilities

  • Develop and maintain data pipelines and ETL processes using Azure Data Factory (ADF) and Databricks.
  • Design and implement data storage solutions on Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage.
  • Create and manage data models and data warehouses using Azure Synapse Analytics.
  • Collaborate with cross-functional teams to gather and analyze business requirements and translate them into technical solutions.
  • Troubleshoot and optimize data processes to ensure high performance and data quality.
  • Implement data security measures to protect sensitive information.
  • Stay updated with the latest data engineering technologies and best practices.
  • Lead and mentor junior data engineers in the team.
  • Provide technical guidance and support to other teams and stakeholders.
  • Participate in code reviews and ensure adherence to coding standards and best practices.
  • Collaborate with DevOps teams to deploy and manage data pipelines and processes.
  • Conduct data analysis and provide insights to support business decisions.
  • Develop and maintain documentation for data processes and solutions.
  • Identify and troubleshoot data-related issues and provide timely resolutions.

Skills

Azure Data Factory
Azure Databricks
SQL
NoSQL
Data warehousing
ETL/ELT
Git/Azure DevOps
Cloud architecture
Mentoring
Agile

Education

Bachelor's or Master's in Computer Science/Engineering

Tools

Azure Synapse Analytics
Azure Data Lake Storage
Azure Blob Storage
Azure SQL Database
Databricks

Job description

Speridian in Austin, TX seeks a seasoned Data Engineer to design, build, and optimize Azure-based data pipelines. You will leverage Azure Data Factory and Databricks to deliver scalable data solutions, integrate data from multiple sources, and support analytics-driven decision making.

The role requires 8–12 years of data engineering experience, strong SQL/NoSQL skills, and expertise in data warehousing and ETL/ELT processes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Data Engineer: Pipelines & Databricks
Senior Azure Data Engineer: Pipelines & Databricks

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Senior Azure Data Engineer - Pipelines & Databricks
Senior Azure Data Engineer - Pipelines & Databricks

Insight Global (United States) • Portland (OR)

On-site
USD 120,000 - 160,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Ethereum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Azure Data Platform Engineer - Pipelines & Databricks
Azure Data Platform Engineer - Pipelines & Databricks

Sapsol Technologies Inc • Redmond (WA)

On-site
USD 110,000 - 150,000
Remote Senior Data Engineer – Azure & BI Pipelines Leader
Remote Senior Data Engineer – Azure & BI Pipelines Leader

wppmedia • United States

Remote
USD 120,000 - 180,000
Senior Azure Databricks Data Engineer: Scalable Pipelines
Senior Azure Databricks Data Engineer: Scalable Pipelines

Robotic Technologies Automation • Houston (TX)

On-site
USD 120,000 - 180,000
Data Engineer - Remote Azure/Databricks Pipelines
Data Engineer - Remote Azure/Databricks Pipelines

Fast Switch, Ltd. • Newington (CT)

Hybrid
USD 68,000 - 97,000
Data Engineer: Azure Databricks & ADF Pipelines
Data Engineer: Azure Databricks & ADF Pipelines

Ethereum Technologies LLC • Plano (TX)

On-site
USD 101,000 - 136,000
Azure Data Engineer: Spark, Delta Lake & Pipelines
Azure Data Engineer: Spark, Delta Lake & Pipelines

TechDigital Group • Pleasanton (CA)

On-site
USD 120,000 - 170,000