Lead Data Engineer

Oddball; United States; Remote; USD 110,000 - 145,000; Full time

Benefits offered by this job

Fully remote

401(k) plan

Flexible PTO

Paid Holidays

Job summary

Oddball is seeking a Lead Data Engineer to drive the technical approach for migrating legacy data warehouse data and pipelines to an Azure Databricks lakehouse. This role sits on our federal-focused VA team and requires strong leadership in a fully remote environment.

You'll design reusable migration pipelines with Azure Data Factory and Databricks, define reconciliation rules, mentor engineers, and partner with product, QA, and platform teams to ensure data quality and performance.

Qualifications

• Lead data engineering efforts on large migration or modernization programs.
• Deep experience with Databricks or Spark and Azure Data Factory.
• Strong SQL and Python skills.
• Experience moving legacy ETL and data warehouse workloads to the cloud.

Responsibilities

• Set the technical approach for migrating data and pipelines onto the lakehouse.
• Guide migration teams on patterns, reconciliation, and quality gates.
• Design reusable migration pipelines using Azure Data Factory and Azure Databricks.
• Define how source and target data are reconciled to confirm accuracy.
• Resolve the hardest pipeline and performance problems.
• Mentor data engineers and review their work.
• Partner with product, QA, and platform teams.

Skills

Leadership

SQL

Python

Remote collaboration

Agile

Education

Bachelor's Degree

Tools

Azure Data Factory

Azure Databricks

Spark

Delta Lake

Job description

Oddball believes that the best products are built when companies understand and value the things they are working on. We value learning and growth and the ability to make a big impact at a small company. We believe that we can make big changes happen and improve the daily lives of millions of people by bringing quality software to the federal space.

This position is contingent upon contract award.

We’re looking for a Lead Data Engineer to join our VA team, setting the technical approach for moving legacy data warehouse data and pipelines onto an Azure and Databricks lakehouse.

What you’ll be doing:

• Set the technical approach for migrating data and pipelines onto the lakehouse
• Guide migration teams on patterns, reconciliation, and quality gates
• Design reusable migration pipelines using Azure Data Factory and Azure Databricks
• Define how source and target data are reconciled to confirm accuracy
• Resolve the hardest pipeline and performance problems
• Mentor data engineers and review their work
• Partner with product, QA, and platform teams

What you’ll bring:

• Data engineering leadership on large migration or modernization programs
• Deep experience with Databricks or Spark and Azure Data Factory
• Strong SQL and Python skills
• Experience moving legacy ETL and data warehouse workloads to the cloud
• Understanding of lakehouse and medallion architecture, including Delta
• Experience in federal or regulated data environments is a plus
• Thrives in a remote, collaborative Agile environment and genuinely enjoys leading and mentoring engineers
• Communicates clearly and openly, whether setting technical direction or aligning with the customer
• Perform other related duties as assigned

Requirements:

• Applicants must be authorized to work in the United States. In alignment with federal contract requirements, certain roles may also require U.S. citizenship and the ability to obtain and maintain a federal background investigation and/or a security clearance.

Education:

• Bachelor's Degree
• Fully remote
• Company Match 401(k) plan
• Flexible PTO, Paid Holidays

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities:

Oddball is an Equal Opportunity Employer and does not discriminate against applicants based on race, religion, color, disability, medical condition, legally protected genetic information, national origin, gender, sexual orientation, marital status, gender identity or expression, sex (including pregnancy, childbirth or related medical conditions), age, veteran status or other legally protected characteristics. Any applicant with a mental or physical disability who requires an accommodation during the application process should contact an Oddball HR representative to request such an accommodation by emailing [e-mail]

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

At Oddball, we may use AI-assisted tools as part of our recruitment process to help review applications, verify applicant information, and identify potentially fraudulent submissions. These tools support our recruiting team in maintaining a fair and secure hiring process. AI-generated findings are reviewed by our recruiting team and are not used as the sole basis for hiring decisions.

Compensation:

At Oddball, it’s important each employee is compensated competitively and fairly. In alignment with state legal requirements. A range for the included position is listed below. Be advised, actual offer details are determined by job category, job location, and candidate skill level.

United States Wage Range: $110,000 – $145,000

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Oddball’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.