Senior Data Engineer - AWS + PySpark Pipelines

River Hawk Consulting LLC; McLean (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

River Hawk Consulting LLC in the Northern Virginia area is seeking an experienced Senior Data Engineer to join our development team. You will design, develop, and optimize data pipelines and workflows using Python and SQL, ensuring data availability and integrity across systems.

You will lead transformations with PySpark, implement secure, cost-efficient AWS data solutions, and promote best practices for GitHub, Linux, Terminal/CLI, and Jira in an Agile, fast-paced environment.

Qualifications

• Design and maintain scalable data pipelines with Python and SQL.
• Lead data transformations using PySpark in distributed processing environments.
• Build reliable AWS data solutions with emphasis on security and cost-efficiency.
• Promote best practices for GitHub, Linux, Terminal/CLI and Agile delivery.

Responsibilities

• Design, develop, maintain, and optimize scalable data pipelines and data processing workflows using Python and SQL.
• Lead the development of data transformations and processing solutions, leveraging PySpark and distributed data processing concepts.
• Design and implement reliable, secure, and cost-effective data solutions using AWS, while troubleshooting complex data and infrastructure issues.
• Establish and promote best practices for GitHub, Linux, Terminal/CLI, and Jira, including code quality, version control, documentation, and Agile delivery.

Skills

Python

SQL

PySpark

Data modeling

Tools

AWS

GitHub

Linux

Jira

Job description

River Hawk Consulting LLC in the Northern Virginia area is seeking an experienced Senior Data Engineer to join our development team. You will design, develop, and optimize data pipelines and workflows using Python and SQL, ensuring data availability and integrity across systems.

You will lead transformations with PySpark, implement secure, cost-efficient AWS data solutions, and promote best practices for GitHub, Linux, Terminal/CLI, and Jira in an Agile, fast-paced environment.