Lead Data Engineer

ZipRecruiter; Arlington (TX); Remote; USD 90,000 - 150,000; Full time

Job summary

Join a forward-thinking company as a Lead Data Engineer, where you'll spearhead innovative financial management data initiatives for the Army data community. This role offers the opportunity to work with diverse systems, leading the development of impactful data products while collaborating closely with a dedicated team. If you thrive on innovation, enjoy building data pipelines, and are eager to contribute to meaningful projects, this position is ideal for you. With a focus on defense health and financial data, your expertise will help shape the future of data management in a dynamic environment.

Benefits

Comprehensive health, dental, and vision coverage

Flexible Spending Account (FSA)

401k with employer match

Life insurance and disability coverage

Flexible PTO and federal holidays

Home office allowance

Training and certification reimbursements

Paid cloud developer accounts

Referral bonuses and social events

Qualifications

• 8+ years of relevant experience in data engineering.
• Proficiency in Python and experience with Spark / PySpark.

Responsibilities

• Lead data initiatives and manage teams in financial data projects.
• Build and manage data pipelines and oversee data ingestion.

Skills

Python

Spark / PySpark

Data Pipeline Management

Databricks

PowerBI

API Data Consumption

Jira

Confluence

Education

Bachelor's Degree

Tools

Databricks

PowerBI

Jira

Confluence

AWS

GitLab

Job description

Job Description

540 is seeking a Lead Data Engineer to lead various financial management data initiatives related to Advana and the Army data community called ARES.

The project involves working with multiple systems and data sources across DoD and Army to build and manage data products by aggregating data in innovative ways. The goal is to create, lead, and expand a data community focused on defense health and financial data. You will serve as the primary technical contact for all projects within this portfolio and collaborate directly with the core Advana team to guide the platform's overall vision.

Location & Requirements

• Location: Remote within the continental US, with East Coast working hours and some flexibility. Occasional travel (up to once per month) may be required.
• Citizenship & Clearance: Must be a US citizen with an active DoD Secret clearance.
• Education: Bachelor's Degree.
• Internal Thrive Level: Senior Software Engineer.

Why Join 540?

540 is an innovative company trusted by the government to #GetShitDone. We break barriers to innovation and build impactful technology. We seek big thinkers who thrive on innovation, are self-starters, and eager to learn new technologies.

Required Skills & Experience

• 8+ years of relevant experience
• Proficiency in Python
• Experience with Spark / PySpark
• Building and managing data pipelines
• Experience with data analytics tools like Databricks
• Dashboard development skills with PowerBI or similar tools
• Comfort working via terminal/command line
• API data consumption experience
• Proficiency with Jira and Confluence
• Responsibilities include managing teams, data requirements, assisting with data ingestions, overseeing data initiatives, developing datasets, and reviewing pipeline code.

Nice to Have Skills & Experience

• AWS cloud experience
• Managing large data pipelines with over a billion records
• Building and managing Qlik dashboards
• Experience with Advana and GitLab
• Experience with DoD and financial systems

Benefits & Perks

• Comprehensive health, dental, and vision coverage
• Flexible Spending Account (FSA)
• 401k with employer match
• Life insurance and disability coverage
• Flexible PTO and federal holidays
• Home office allowance
• Training and certification reimbursements
• Paid cloud developer accounts
• Referral bonuses and social events

EEO Statement

540 provides equal employment opportunities to all employees and applicants, prohibiting discrimination and harassment based on protected characteristics. This policy covers all employment terms and conditions.