Lead Data Engineer

KDR Talent Solutions USA; United States; Remote; USD 198,000 - 242,000; Full time

Benefits offered by this job

Competitive compensation

Full benefits package

Flexible remote or hybrid options

Cutting-edge tools

Job summary

A premier recruitment agency is seeking a Lead Data Engineer for a remote role focused on delivering complex data solutions for enterprise clients in the financial services sector. The ideal candidate will have over 8 years of experience in data engineering, strong expertise in Databricks and AWS, and a proficiency in Python and SQL. This opportunity offers competitive compensation and the chance to work on high-impact projects within a collaborative team.

Qualifications

• 8+ years of experience in data engineering.
• Deep expertise with Databricks (Spark, Delta Lake, MLflow).
• Strong experience with cloud platforms, ideally AWS.

Responsibilities

• Design and deploy data pipelines using Databricks and AWS.
• Collaborate with stakeholders to define technical requirements.
• Optimize data systems for performance and security.

Skills

Data Engineering

Databricks

AWS

Python

SQL

CI/CD

Data Modeling

Tools

Databricks

AWS

Terraform

Job description

Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities

Job Title: Lead Data Engineer

Location: Remote

Employment Type: Full-time

Compensation:

• Up to $220k + benefits

About the Role

We’re hiring experienced Lead Data Engineers to support large-scale data transformation projects for enterprise clients in the financial services sector. You’ll be embedded within a high-performing consulting team delivering mission-critical data platforms using Databricks and AWS.

This is a hands-on engineering role focused on architecture, implementation, and optimization of robust data solutions at scale.

Key Responsibilities

• Design, build, and deploy data pipelines and platforms using Databricks and cloud infrastructure (preferably AWS)
• Lead or contribute to end-to-end implementation of data solutions in enterprise environments
• Collaborate with architects, analysts, and client stakeholders to define technical requirements
• Optimize data systems for performance, scalability, and security
• Ensure data governance, quality, and compliance in all solutions

Required Skills & Experience

• 8+ years of experience in data engineering
• Deep expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog)
• Strong experience with cloud platforms, ideally AWS (S3, Glue, Lambda, etc.)
• Proven track record of delivering complex data solutions in financial services or other regulated industries
• Proficient in Python and SQL
• Experience with CI/CD for data pipelines and infrastructure-as-code tools (e.g., Terraform)
• Strong understanding of data modeling, lakehouse architectures, and data security best practices

Nice to Have

• Experience with Azure or GCP in addition to AWS
• Knowledge of DevOps practices in data engineering
• Familiarity with regulatory frameworks (e.g., GDPR, SOC2, PCI-DSS)

Why Join?

• Work on high-impact, high-visibility projects with enterprise financial clients
• Competitive compensation and full benefits package
• Flexible remote or hybrid working options
• Opportunity to work with cutting-edge tools and an experienced, collaborative team

Interested? Apply now or reach out directly to learn more.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• IT Services and IT Consulting