Data Engineer (Databricks + PySpark) | Delta Lake & AWS

Sigma Software; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Sigma Software is seeking a Middle Data Engineer to build scalable data solutions for a leading AdTech and analytics company. You will work with Data Lakehouse architectures, Databricks, PySpark, Delta Lake, and cloud-native tech to process large marketing and advertising data in batch and near real-time environments.

Join a team of experienced data engineers to deepen expertise in Databricks, PySpark, and scalable data platforms while delivering enterprise-scale data pipelines and analytics

Qualifications

• 2+ years of experience in Big Data development and database design
• Strong hands-on experience with SQL
• Strong Python development skills
• Hands-on experience with PySpark
• Experience developing and maintaining data pipelines in Databricks
• Experience with Delta Lake
• Experience with Medallion Architecture (Bronze, Silver, Gold layers)
• Strong analytical and problem-solving skills
• Intermediate or higher English level
• Experience with AWS services, including S3

Responsibilities

• Develop and maintain data pipelines for processing large volumes of data in batch and near real-time environments
• Work with Databricks, PySpark, and SQL to transform, validate, and optimize data
• Support implementation of Data Lakehouse solutions following engineering standards and best practices
• Build, test, and automate ETL processes and data workflows
• Improve data quality, organization, and reliability across platforms
• Collaborate with engineers, analysts, and stakeholders to deliver scalable solutions
• Troubleshoot, optimize, and monitor data pipelines
• Stay up to date with modern data engineering technologies
• Ensure deliverables meet quality standards and project requirements

Skills

SQL

Python

PySpark

Big Data

English

Tools

Databricks

Delta Lake

Medallion Architecture

AWS S3

Job description

Sigma Software is seeking a Middle Data Engineer to build scalable data solutions for a leading AdTech and analytics company. You will work with Data Lakehouse architectures, Databricks, PySpark, Delta Lake, and cloud-native tech to process large marketing and advertising data in batch and near real-time environments.

Join a team of experienced data engineers to deepen expertise in Databricks, PySpark, and scalable data platforms while delivering enterprise-scale data pipelines and analytics