Data Engineer II

DriveWealth; New York (NY); Hybrid; USD 145,000 - 165,000; Full time

Job summary

DriveWealth is seeking a Data Engineer located in New York, NY to design and maintain critical data pipelines. You will work cross-functionally with various teams to deliver reliable data solutions, contributing significantly to our data platform's evolution.

The ideal candidate will have 2–3 years of experience, strong skills in Python and SQL, and familiarity with cloud platforms. This role offers a hybrid work schedule, requiring in-office work 2–3 days a week.

Qualifications

• 2–3 years of professional experience in data engineering or related fields.
• Track record of building and contributing to data pipelines.
• Curiosity and accountability with a focus on improving data quality.

Responsibilities

• Design and maintain robust data pipelines for analytics and compliance.
• Translate business needs into data solutions in collaboration with teams.
• Monitor challenges, anticipating scaling, performance, and quality needs.

Skills

Proficiency in Python

Proficiency in SQL

Familiarity with Spark (PySpark and SparkSQL)

Familiarity with Airflow and DBT

Familiarity with AWS

Experience with infrastructure as code (Terraform)

Working knowledge of shell scripting

Experience with CI/CD pipelines

Experience with Git-based workflows

Strong analytical skills

Education

BS in Computer Science or equivalent

Tools

Databricks

Job description

About the Team

We are looking for a Data Engineer who thrives on solving data problems, and enjoys working cross‑functionally with product, engineering and analytics teams to deliver trusted, high‑impact data solutions. The ideal candidate is excited to take ownership of well‑defined data challenges and support the evolution of our data platform.

What You’ll Do

• Design, build, and maintain robust data pipelines (batch, streaming, and replication) that support analytics, reporting, and compliance use‑cases.
• Translate business needs into data solutions in collaboration with product managers, engineering teams, and business stakeholders.
• Proactively monitor and address challenges and opportunities, anticipating scaling, performance, and quality needs before they become blockers.
• Adhere to and promote best practices, including documentation, code reviews, and standards for data modelling, orchestration, and tooling.
• Actively participate in code reviews and knowledge sharing, raising the bar for data engineering craft and helping grow team capabilities.
• Support the contribution to self‑service data products, enabling data consumers with curated datasets, semantic layers, and tools that accelerate insight generation.

What You’ll Need

• 2–3 years of professional experience in data engineering or related fields, with a track record of building and contributing to data pipelines and platforms.
• Technical Skills:
  • Proficiency in Python and SQL
  • Familiarity with Spark (PySpark and SparkSQL) and distributed data processing
  • Familiarity with orchestration and transformation tools (e.g., Airflow, DBT)
  • Familiarity with Databricks and cloud platforms (AWS preferred)
  • Familiarity with infrastructure as code (e.g., Terraform or equivalent)
  • Working knowledge of shell scripting and command‑line tooling (e.g., Databricks CLI)
  • Proven ability to work independently and cross‑functionally with product, engineering, and business teams
  • Experience working in teams with CI/CD pipelines, Git‑based workflows, and Agile methodologies
  • Curiosity, accountability, and a drive to improve data quality, scalability, and usability across the company
  • BS in Computer Science or equivalent

Special Knowledge (Nice to Have, But Not Required)

• Fintech or capital market experience
• Familiarity with regulatory and compliance‑driven reporting (e.g., FINRA, GDPR)
• Experience supporting or mentoring junior team members

Location

• New York, NY – Hybrid (expected to work in‑office 2–3 days per week)
• Applicants must be authorized to work for any employer in the U.S. and cannot be accommodated for remote work outside the listed location.

Pay Range

$145,000 USD – $165,000 USD

Equal Employment Opportunity

We are an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We encourage candidates from all backgrounds to apply.