Senior Data Engineer: AWS/Databricks, PySpark & CI/CD

Objectways; United States; Vor Ort; USD 130.000 - 210.000; Vollzeit

Zusammenfassung

Objectways is seeking an experienced Senior Data Engineer to design, build, and maintain modern data platforms supporting analytics, reporting, and business operations. Strong experience with AWS data pipelines, Databricks, PySpark, and infrastructure as code required.

Responsibilities include designing scalable pipelines with AWS Glue, optimizing PySpark workflows, and managing Databricks data solutions. ITAR compliance and U.S. Person status are required for eligibility.

Qualifikationen

• 8+ years of experience with AWS and Databricks.
• U.S. Person required due to ITAR compliance.
• Hands-on Databricks experience.
• Experience building AWS data pipelines and automation with Glue.
• Proficiency in PySpark for data processing and transformation.
• Experience with Terraform and CI/CD for IaC and deployments.

Aufgaben

• Design, develop, and maintain scalable data pipelines and automation using AWS Glue.
• Build and optimize data processing and transformation workflows using PySpark.
• Develop and manage data solutions on Databricks.
• Perform data discovery and source-data profiling to understand new and existing data sources.
• Assess data quality and implement checks for accuracy and reliability.
• Support data modeling and translate business needs into reusable data structures.
• Provision and manage infrastructure as code using Terraform.
• Build and maintain CI/CD pipelines for deploying data solutions.
• Collaborate with business stakeholders, analysts, and engineering teams to meet requirements.

Kenntnisse

Data pipeline design

PySpark

Data processing

Data modeling

Tools

AWS

Databricks

Terraform

CI/CD

AWS Glue

Delta Lake

Jobbeschreibung

Objectways is seeking an experienced Senior Data Engineer to design, build, and maintain modern data platforms supporting analytics, reporting, and business operations. Strong experience with AWS data pipelines, Databricks, PySpark, and infrastructure as code required.

Responsibilities include designing scalable pipelines with AWS Glue, optimizing PySpark workflows, and managing Databricks data solutions. ITAR compliance and U.S. Person status are required for eligibility.