Senior Data Engineer

Darkwolfsolutions; Herndon (VA); Hybrid; USD 150,000 - 175,000; Full time

Job summary

Darkwolfsolutions is seeking a Senior Data Engineer in Herndon, VA, to support the Defense Health community with hybrid/remote flexibility. The successful candidate will design and build robust data pipelines, utilizing Python, AWS, and SQL, ensuring high performance and quality in operational data.

Applicants must possess a B.S. degree in Computer Science and at least 8 years of professional experience, along with a current Secret security clearance. This full-time role offers a competitive salary ranging from $150,000 to $175,000 depending on experience.

Qualifications

• 8+ years of experience working in an Agile team with DevOps practices.
• Experience in developing data-related services to cloud platforms.
• US Citizenship and an active Secret security clearance.

Responsibilities

• Design and implement OpenAPI compliant data schemas and REST APIs.
• Develop software using modern programming languages and frameworks.
• Build high-throughput data pipelines for large data processing.

Skills

Python (FastAPI)

AWS

SQL (Trino SQL)

Rancher Kubernetes

Apache Spark

DevSecOps best practices

Test Driven Development (TDD)

Education

B.S. in Computer Science or equivalent experience

Tools

DBT

OpenAPI

ORM libraries

Apache Airflow

NIST Risk Management Framework

Job description

Dark Wolf is looking for a Senior Data Engineer to join our team in Herndon, VA supporting the Defense Health community. This position will have hybrid/remote flexibility. The Data Engineer will be responsible for designing, building, and optimizing robust data pipelines and data infrastructure to ensure the reliability, accessibility, and quality of operational medicine data for analytics and mission-critical applications.The ideal candidate will leverage extensive experience with data engineering principles, DevSecOps best practices, and Test Driven Development (TDD) principles to rapidly develop and deliver first-class, customer-centric software solutions. They will utilize leading languages and frameworks, including Python (FastAPI), AWS, SQL (Trino SQL), and Rancher Kubernetes, to develop high-performance data engineering solutions, automate testing, and ensure delivered software meets and exceeds customer needs, all while working collaboratively within a dedicated team.

Key Responsibilities

• Using DevSecOps best practices to rapidly develop and deliver first class solutions for a DoW customer.
• Developing software using leading languages and frameworks including Python (FastAPI), AWS, SQL (Trino SQL), and Rancher Kubernetes.
• Building high-throughput data pipelines that aggregate, standardize, and process large volumes of heterogeneous data with Apache Spark, DBT, and Trino.
• Establishing RESTful API endpoints that rapidly return large volumes of analytical health data.
• Taking ownership of project domains and quickly becoming proficient in novel subjects.
• Leveraging Test Driven Development and User Centered design best practices automate testing and ensure delivered software meets and exceeds customer needs.
• Applying software design best practices to identify and analyze potential solutions, generate design diagrams to convey and capture system design, and participate in technical exchange meetings to discuss with the team and customer stakeholders.
• Embracing a shared responsibility for system security.
• Continuously engaging with project teams to deliver quality products.
• Participating in daily standups, sprint planning/review meetings, discover and framing workshops, and customer demo sessions.

Required Qualifications

• B.S. in Computer Science (or equivalent experience) and at least 8 years of professional experience working as part of an Agile team using DevOps practices and modern programming languages and frameworks to develop and engineer data-related services and applications to cloud platforms
• Experience with modern programming languages and frameworks including Python (FastAPI, Django, Flask), JavaScript (Node.js, Express, Vue, Svelte, React), and Java (Spring Boot)
• Experience developing data focused solutions to include experience designing and implementing OpenAPI compliant data schemas and REST APIs, implementing data persistence and query logic using Object Relational Mapping (ORM) libraries and SQL, and implementing data validation business rules
• Experience developing AWS cloud solutions with a specific focus on data services such as S3, RDS, and EMR
• Experience building scalable, production-grade data solutions that can be used by thousands of data consumers concurrently
• US Citizenship and an active Secret security clearance

Desired Qualifications

• M.S in Computer Science or related
• Experience with AI/ML
• Experience with Kubernetes (Rancher RKE2, AWS EKS) and microservice architectures
• Experience with data engineering and big data technologies such as Apache Airflow, Trino, and AWS EMR
• Experience with NIST Risk Management Framework and security accreditation process and tasks
• Experience with HL7, FHIR, and Mirth Connect
• Experience with dbt and Apache Spark
• Familiarity with Great Expectations, data contracts, and data validation

This position has hybrid schedule flexibility. The salary range is expected to be between $150,000 to $175,000, commensurate on experience.

We are proud to be an EEO/AA employer Minorities/Women/Veterans/Disabled and other protected categories.

We are strictly looking for direct, full-time W2 employees. We do not engage with third-party staffing agencies, C2C, or 1099 independent contractors for this role.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.