Senior Cloud Data Platform Engineer - Databricks & AI

Sigma Software

United States

Remote

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Sigma Software is seeking a Senior Data Engineer to design and scale cloud-native data platforms for a pioneering fusion energy company.

You will work on greenfield data initiatives, build near-real-time pipelines, and modernize large-scale data infrastructure using Databricks and AWS.

Join Sigma Software to work on innovative global projects where technology advances science and sustainability, driving engineering excellence and AI adoption within the data platform ecosystem.

Qualifications

  • 5+ years of experience in data engineering.
  • 3+ years production experience with Databricks and Delta Lake.
  • Strong Python, PySpark, and SQL skills.
  • Deep hands-on AWS expertise (S3, IAM, KMS, Lambda, etc.).
  • Experience with CI/CD and Terraform.
  • Experience with data quality tooling such as Great Expectations, Soda, pyDeequ, or Databricks Labs DQX.

Responsibilities

  • Design and build scalable cloud-native data platforms from greenfield to production.
  • Define and enforce data platform standards including Delta Lake and medallion architecture.
  • Refactor Spark and PySpark scripts for performance and maintainability.
  • Drive adoption of AI tooling and agentic workflows within the data engineering team.
  • Collaborate with the Customer’s scientific and engineering teams.
  • Monitor platform performance and cloud costs.

Skills

Python
PySpark
SQL
Databricks
AWS
Event-driven design
CI/CD
Data quality

Tools

Unity Catalog
Lakeflow Jobs/Workflows
Terraform
Databricks Asset Bundles
Git workflows
Great Expectations
Soda
pyDeequ

Job description

Sigma Software is seeking a Senior Data Engineer to design and scale cloud-native data platforms for a pioneering fusion energy company.

You will work on greenfield data initiatives, build near-real-time pipelines, and modernize large-scale data infrastructure using Databricks and AWS.

Join Sigma Software to work on innovative global projects where technology advances science and sustainability, driving engineering excellence and AI adoption within the data platform ecosystem.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Sigma Software • United States

Remote
USD 140,000 - 190,000
Senior Data Platform Engineer - CloudOps & Automation
Senior Data Platform Engineer - CloudOps & Automation

Sigma Software Group • United States

Remote
USD 120,000 - 170,000
Senior Software Engineer - Data Platform & Analytics
Senior Software Engineer - Data Platform & Analytics

sigmacomputing • San Francisco (CA)

On-site
USD 150,000 - 240,000
Equity
Health benefits
Flexible time off
+5
Data Platform Engineer: Build Scalable Cloud Pipelines
Data Platform Engineer: Build Scalable Cloud Pipelines

Sigma Computing • New York (NY)

On-site
USD 140,000 - 180,000
Equity
Flexible time off
Paid bonding time for new parents
+4
Data Platform Engineer: Snowflake & Databricks Builder
Data Platform Engineer: Snowflake & Databricks Builder

Sigma • New York (NY)

On-site
USD 140,000 - 180,000
Equity
Generous health benefits
Flexible time off policy
+5
Data Platform Engineer - Snowflake/Databricks, Equity
Data Platform Engineer - Snowflake/Databricks, Equity

Sigma • San Francisco (CA)

On-site
USD 140,000 - 180,000
Equity
Generous health benefits
Flexible time off policy
+5
Senior AI/ML Engineer: Build AI-Driven Data Apps
Senior AI/ML Engineer: Build AI-Driven Data Apps

sigmacomputing • San Francisco (CA)

On-site
USD 240,000 - 270,000
Equity
Health benefits
Flexible time off
+5
Senior Data Engineer - Databricks & AWS Cloud Pipelines
Senior Data Engineer - Databricks & AWS Cloud Pipelines

CloudBigD • Sunnyvale (CA)

On-site
USD 76,000 - 108,000
Data Platform Engineer: Snowflake, Databricks & Pipelines
Data Platform Engineer: Snowflake, Databricks & Pipelines

sigmacomputing • New York (NY)

On-site
USD 140,000 - 180,000
Equity
Health benefits
Flexible time off
+5
Senior Data Engineer, Databricks Platform on AWS
Senior Data Engineer, Databricks Platform on AWS

PCI Pharma Services • Rockford (IL)

On-site
USD 120,000 - 180,000