Databricks Data Engineer — Pipelines & Client-Facing Hybrid

Infinitive; McLean (VA); Hybrid; USD 75,000 - 120,000; Full time

Job summary

Infinitive in McLean, VA is seeking a Consultant, Data Engineer to build and maintain Databricks pipelines for client projects. You will work with senior engineers, architects and analysts, writing production Python, PySpark and SQL code that moves data from source systems into Delta Lake tables used by client teams.

This role targets engineers with 1–3 years of experience who want client-facing work and exposure to new data platforms.

Qualifications

• 1 to 3 years of professional data/software engineering experience.
• Bachelor’s degree in CS, IS, Engineering, Math or related field.
• Hands-on Databricks experience in production projects.
• Proficiency in Python for data processing.

Responsibilities

• Build and maintain batch and incremental ETL pipelines in Databricks using Python, PySpark and Spark SQL.
• Ingest data from databases, APIs, files and cloud storage into Delta Lake tables.
• Implement bronze, silver and gold layers following medallion patterns.
• Write and tune SQL for transformations, data validation and reporting tables.
• Add data quality checks, handle schema changes and troubleshoot failed jobs.
• Schedule and monitor workloads with Databricks Workflows and Unity Catalog permissions.
• Tune Spark jobs for performance and cost, including partitioning and cluster config.
• Use Git for version control, participate in code reviews and CI/CD pipelines.
• Document pipelines and mappings for client teams.
• Join client meetings to clarify requirements and report status.

Skills

Python

Databricks

SQL

PySpark

Spark SQL

Cloud platforms

Education

Bachelor's degree in CS/IS/Engineering/Math

Tools

Delta Lake

dbt

Airflow

Terraform

Job description

Infinitive in McLean, VA is seeking a Consultant, Data Engineer to build and maintain Databricks pipelines for client projects. You will work with senior engineers, architects and analysts, writing production Python, PySpark and SQL code that moves data from source systems into Delta Lake tables used by client teams.

This role targets engineers with 1–3 years of experience who want client-facing work and exposure to new data platforms.