Senior Data Engineer - Cloud Data Platform & Security

J5 Consulting; McLean (VA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

100% employer-paid health coverage

6% 401(k) match

PTO

Tuition reimbursement

Bonuses

Professional development

Job summary

J5 Consulting, a Maryland-based company, is seeking a data engineering professional to join its team in the Washington, DC metropolitan area. The role focuses on building scalable data pipelines, ETL/ELT workflows, and ensuring data security and governance across cloud environments.

You will collaborate with stakeholders in agile teams, own end-to-end data solutions using Spark, PySpark, Python, SQL, and orchestration tools, and contribute to modernization efforts.

Qualifications

• Demonstrated experience with Agile/Scrum development methodologies in a fast-paced, collaborative team environment.
• Demonstrated experience in high-performing, cross-functional teams with multiple concurrent projects.
• Experience gathering requirements from stakeholders and translating them into technical solutions with minimal oversight.
• Strong ownership mentality with focus on code quality, testing, and documentation.
• Ability to context-switch between projects and systems as priorities demand.
• Data Engineering and building production data pipelines/ETL/ELT at scale.
• Experience with Apache Spark and PySpark for distributed data processing.
• Advanced Python data manipulation using Pandas/NumPy and data engineering best practices.
• Understanding of data security, privacy, governance, and compliance principles.
• Experience with workflow orchestration tools like Step Functions and Airflow.
• Containerization with Docker/Podman and deploying data apps in cloud environments.
• Experience with AWS services (S3, Lambda, Step Functions).
• Production experience with PostgreSQL/MySQL including performance tuning and schema design.
• SQL and query optimization for analytics workloads.
• Version control (Git) and CI/CD practices for data pipelines.
• Ability to collaborate with stakeholders to define data requirements and feasible solutions.

Responsibilities

• Architect and build a secure data ecosystem aligned with the Sponsor's data strategy.
• Develop scalable data pipelines and ETL/ELT workflows at scale.
• Collaborate with stakeholders to gather requirements and translate into technical solutions.

Skills

Agile/Scrum

Cross-functional teams

Requirements gathering

Code quality testing docs

Data engineering

ETL/ELT pipelines

Apache Spark

PySpark

Python data manipulation

Data security governance

Workflow orchestration

Docker/Podman

AWS (S3/Lambda/Step Functions)

PostgreSQL/MySQL

SQL optimization

Git/CI-CD

Stakeholder collaboration

Troubleshooting data quality

Tools

Apache Iceberg

Apache Ranger

Trino

Unity Catalog OSS

Apache Superset

Bash scripting

Terraform/CloudFormation

OpenLineage

Java

DynamoDB

Job description

J5 Consulting, a Maryland-based company, is seeking a data engineering professional to join its team in the Washington, DC metropolitan area. The role focuses on building scalable data pipelines, ETL/ELT workflows, and ensuring data security and governance across cloud environments.

You will collaborate with stakeholders in agile teams, own end-to-end data solutions using Spark, PySpark, Python, SQL, and orchestration tools, and contribute to modernization efforts.