Software Engineer III - Python, Databricks and AWS

hackajob; Jersey City (NJ); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health care coverage

On-site health and wellness centers

Retirement savings plan

Backup childcare

Tuition reimbursement

Mental health support

Financial coaching

Job summary

hackajob is seeking a data engineer to build and maintain scalable data solutions on Databricks and AWS in Jersey City. You will design robust ingestion pipelines, enforce data governance, and optimize Spark workloads for performance and cost.

The role focuses on data engineering within a modern Lakehouse architecture, leveraging Delta Lake, Unity Catalog, and CI/CD practices to deliver reliable analytics platforms.

Qualifications

• 3+ years of SDLC experience with a strong focus on data engineering and the Databricks Lakehouse on AWS.
• Proficiency in Spark, Delta Lake, and AWS fundamentals, along with experience using AI-assisted coding tools, is required.

Responsibilities

• Build and maintain scalable data collection, storage, and analytics solutions using Databricks and AWS.
• Implement resilient data ingestion pipelines and ensure data governance.
• Optimize Spark workloads for performance and cost.

Skills

Python

Data Engineering

3+ years SDLC

AI-assisted development

Structured Streaming

Performance Tuning

Unit Testing

Data Governance

SQL

CI/CD

Unity Catalog

Tools

Databricks

AWS

Spark

Delta Lake

Terraform

CI/CD

Unity Catalog

Job description

The role involves building and maintaining scalable data collection, storage, and analytics solutions using Databricks and AWS. Key duties include implementing resilient ingestion pipelines, ensuring data governance, and optimizing Spark workloads for performance and cost.

Requirements

Candidates need 3+ years of SDLC experience with a strong focus on data engineering and the Databricks Lakehouse on AWS. Proficiency in Spark, Delta Lake, and AWS fundamentals, along with experience using AI-assisted coding tools, is required.

Key Skills

• Python
• Databricks
• AWS
• Spark
• Delta Lake
• Data Engineering
• Terraform
• CI/CD
• Structured Streaming
• Unity Catalog
• SQL
• AI-assisted development
• Data Governance
• Infrastructure as Code
• Unit Testing
• Performance Tuning

Benefits

• Health care coverage
• On-site health and wellness centers
• Retirement savings plan
• Backup childcare
• Tuition reimbursement
• Mental health support
• Financial coaching