Senior Data Engineer — Databricks, DevOps & Data Modeling

Infinitive Inc; McLean (VA); On-site; USD 90,000 - 154,000; Full time

Job summary

Infinitive Inc in the Washington DC metro area seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines using Databricks and modern DevOps practices.

You will implement CI/CD with Jenkins and Terraform, develop data models (3NF, Dimensional, Data Vault), optimize performance, ensure data quality, and collaborate with data scientists and software engineers to deliver high-quality data solutions. Mentorship and training duties are included.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field; Master’s preferred.
• Proven experience as a Data Engineer, preferably in a cloud-based environment.
• Strong proficiency in Databricks for data processing and analytics.
• Hands-on experience with Jenkins and Terraform for infrastructure automation.
• In-depth knowledge of data modeling concepts including 3NF, Dimensional, and Data Vault.
• Proficiency in SQL and programming languages such as Python or Scala.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes using Databricks and other relevant technologies.
• Implement CI/CD pipelines using Jenkins and Terraform to automate deployment, monitoring, and scaling of data infrastructure.
• Develop and implement data models (3NF, Dimensional, Data Vault) for business requirements.
• Identify and address performance bottlenecks in data pipelines and queries; optimize processing and storage.
• Implement data quality checks and monitoring to ensure data accuracy and consistency.
• Collaborate with data scientists, analysts, and engineers to translate data requirements into solutions.
• Document data pipelines, infrastructure configurations, and data models; enforce best practices.
• Provide training and mentorship to junior team members.

Skills

Databricks

SQL

Python

Scala

Cloud platforms

CI/CD

Collaboration

Documentation

Mentorship

Education

Bachelor's degree in CS/Engineering

Master's degree preferred

Tools

Jenkins

Terraform

Databricks

Job description

Infinitive Inc in the Washington DC metro area seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines using Databricks and modern DevOps practices.

You will implement CI/CD with Jenkins and Terraform, develop data models (3NF, Dimensional, Data Vault), optimize performance, ensure data quality, and collaborate with data scientists and software engineers to deliver high-quality data solutions. Mentorship and training duties are included.