Senior Data Engineer

9nexus

United States

Remote

USD 120,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

9nexus is seeking a Senior Data Engineer in the United States to design, build, and maintain scalable data platforms and products. The role requires deep expertise in Python, SQL, Apache Spark, and cloud technologies across Azure and GCP.

You will own data ingestion pipelines, governance, and platform performance while mentoring junior engineers. The ideal candidate will have hands-on Spark 3.3+, experience with Databricks, and strong DevOps and IaC skills to drive cost optimization and

Qualifications

  • Strong experience with Python (PySpark) and SQL.
  • Hands-on with Apache Spark 3.3+ and Azure Databricks.
  • Experience with ADLS Gen2, Azure Data Factory, BigQuery, GCS/BigLake, and Dataproc.
  • Good knowledge of Azure and GCP cloud services, IAM, security, and monitoring.
  • Experience with Terraform, CI/CD, DevOps, and data quality frameworks.

Responsibilities

  • Design and develop scalable data ingestion and transformation pipelines.
  • Build and optimize data solutions using PySpark, Python, SQL, and Databricks.
  • Implement data governance, data quality, security, and lineage frameworks.
  • Drive data platform architecture, performance tuning, and cost optimization.
  • Develop CI/CD pipelines and Infrastructure as Code using Terraform/ARM.
  • Mentor junior engineers and establish coding standards and best practices.
  • Explore emerging technologies and leverage AI-assisted coding tools to accelerate development.

Skills

Python
SQL
Apache Spark
Azure Databricks
Cloud platforms (Azure & GCP)
Terraform
CI/CD
DevOps
AI-assisted development

Tools

Azure Databricks
Terraform
CI/CD tooling
ARM (Azure Resource Manager)

Job description

We are looking for an experienced Senior Data Engineer to design, develop, and maintain scalable enterprise data platforms and data products. The ideal candidate should have strong expertise in Python, SQL, Apache Spark, Azure Databricks, and cloud technologies across Azure and GCP.

Key Responsibilities
  • Design and develop scalable data ingestion and transformation pipelines.
  • Build and optimize data solutions using PySpark, Python, SQL, and Databricks.
  • Implement data governance, data quality, security, and lineage frameworks.
  • Drive data platform architecture, performance tuning, and cost optimization.
  • Develop CI/CD pipelines and Infrastructure as Code using Terraform/ARM.
  • Mentor junior engineers and establish coding standards and best practices.
  • Explore emerging technologies and leverage AI-assisted coding tools to accelerate development.
Required Skills
  • Strong experience in Python (PySpark, Pandas) and advanced SQL.
  • Hands-on experience with Apache Spark 3.3+ and Azure Databricks.
  • Experience with ADLS Gen2, Azure Data Factory, BigQuery, GCS/BigLake, and Dataproc.
  • Good knowledge of Azure and GCP cloud services, IAM, security, and monitoring.
  • Experience with Terraform, CI/CD, DevOps, and data quality frameworks.
  • Hands-on experience with AI tools and AI-assisted development.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Gennte Technologies • Pittsburgh

Hybrid
USD 100,000 - 140,000
Senior Data Engineer
Senior Data Engineer

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Sr. Data Engineer, Data Platform
Sr. Data Engineer, Data Platform

Mirion Technologies • United States

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

TechDigital Group • Chicago (IL)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Eden Prairie (MN)

On-site
USD 130,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Tredence Inc. • United States

On-site
USD 120,000 - 180,000
Senior Data Engineer - Scalable Pipelines & Cloud Analytics
Senior Data Engineer - Scalable Pipelines & Cloud Analytics

Initvalue • Fremont (CA)

Hybrid
USD 130,000 - 190,000
Data Engineer
Data Engineer

Compunnel Inc. • San Jose (CA)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Frederick Fox • Charlotte (NC)

On-site
USD 100,000 - 140,000