Data and Software Engineer

The Josef Group; McLean (VA); On-site; USD 200,000 - 250,000; Full time

Job summary

The Josef Group in McLean, VA is seeking a Data and Software Engineer to join a small team and build complex data flows for a custom application. You will apply advanced Python skills, work with Java, ensure data security, governance and compliance, and develop production data pipelines and ETL workflows at scale on AWS.

Responsibilities include collaborating with stakeholders, designing scalable data architectures, and optimizing pipelines for performance and reliability in a regulated

Qualifications

• Minimum 5 years of data engineering experience.
• Experience building end-to-end data pipelines with Python.
• Strong SQL skills, including analytical workloads.
• Experience with AWS services and cloud deployment.
• Experience with ETL tools and data orchestration.

Responsibilities

• Design data solutions with stakeholders and minimal oversight.
• Identify and fix data quality issues and bottlenecks.
• Migrate large data platforms or modernize data infrastructure.
• Contribute to data engineering documentation and best practices.

Skills

Apache Spark

Python (Pandas/NumPy)

SQL (Trino)

NoSQL (DynamoDB)

Airflow

Docker

Podman

AWS (S3, Lambda, Step Functions)

Apache Iceberg

Geospatial (PostGIS)

OpenLineage

Terraform

Tools

Git

CloudFormation

IaC tooling

Job description

Data and Software Engineer
McLean, VA
$200K to $250K
TS/SCI and FSP

The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. Candidate must have experience:

• Buildingend-to-end data pipelines leveraging Python
• Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
• Containerizingand deploying applications in cloud environments like AWS.
• Workingwith MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads.
• Leveragingindustry standard tools for code control (Git, IaaCcontrol, etc.)
• Workingwith data catalogs, tracking data lineage andhandling a variety of data formats, including Geospatial.
• UsingBash scripting for automation and data processing tasks
• IntegratingAl/ML services and models

Responsibilities

• Workwith stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
• Leveragestrong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
• Leveragea background in large-scale data migration or platform modernization efforts
• Contribute to data engineering documentation, best practices, and design patterns.

Required Skills:

Minimum of 5 years' experience with:

• ApacheSpark & PySpark
• AdvancedPython skills (including Pandas & NumPy)
• Docker, Podman
• AWSS3, Lambda & Step functions
• ApacheIceberg, Airflow, etc.
• SQL(with Trino)
• NoSQL, DynamoDB
• UnityCatalog OSS, Apache Polaris
• ApacheSuperset
• Terraformor CloudFormation
• OpenLineage
• H3, PostGIS