Senior AWS Databricks Data Engineer - Hybrid Contract

Tech Mirrors; New York (NY); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Tech Mirrors is seeking an AWS Databricks Data Engineer in NYC, NY – Hybrid. The successful candidate will design, implement, and manage ETL pipelines, ensuring performance and reliability.

Strong expertise in Databricks and cloud-based solutions is essential for optimizing data environments and collaborating with stakeholders. Candidates with a background in data governance and experience in developing near real-time solutions are preferred.

Qualifications

• Strong expertise in designing Databricks-based Lakehouse architectures.
• Experience with large-scale data pipelines and cloud-based solutions.
• Ability to optimize workload performance and implement governance solutions.

Responsibilities

• Develop scalable ETL/ELT pipelines using Databricks on AWS.
• Collaborate with teams to prepare data for dashboard and analytics.
• Monitor pipelines to ensure reliability and adhere to SLAs.
• Implement data governance and access control using Unity Catalog.

Skills

Databricks

SQL

Python

PySpark

Cloud-based ETL

Tools

GitLab

AWS

Job description

Tech Mirrors is seeking an AWS Databricks Data Engineer in NYC, NY – Hybrid. The successful candidate will design, implement, and manage ETL pipelines, ensuring performance and reliability.

Strong expertise in Databricks and cloud-based solutions is essential for optimizing data environments and collaborating with stakeholders. Candidates with a background in data governance and experience in developing near real-time solutions are preferred.