Senior Python Data Engineer - Spark, AWS & Pipelines

Accelyst, LLC; McLean (VA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Onsite in McLean, VA

Job summary

Accelyst, LLC is seeking a Senior Full Stack Developer – Python to design and modernize data-centric applications supporting regulatory reporting initiatives. Strong experience in Python, PySpark, AWS and Data Engineering is required.

You will build scalable data pipelines, support legacy systems, and work in an Agile team with CI/CD in cloud environments. Local to DMV region, onsite in McLean, VA.

Qualifications

• 5+ years of professional software development experience.
• 5+ years of hands-on Python development experience.
• 5+ years of hands-on PySpark / Spark experience.
• 5+ years of Data Engineering experience.
• Strong hands-on experience with AWS, including:
• Amazon S3
• AWS Glue
• Amazon EMR
• AWS Data Lake
• Experience working with legacy applications and modernization initiatives.
• 3+ years of SQL experience, including complex queries.
• 3+ years of Unix/Linux experience.
• Strong understanding of SDLC, Agile methodologies, and software development practices.
• Experience providing technical leadership and mentoring junior developers.
• Strong troubleshooting, analytical, and problem-solving skills.
• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent professional experience.

Responsibilities

• Design and develop scalable data solutions using Python, PySpark, Spark, and AWS.
• Build, enhance, and support batch and real-time data pipelines.
• Develop and maintain cloud-based data processing solutions using AWS S3, Glue, EMR, Data Lake, and Delta Lake.
• Modernize legacy applications while maintaining and supporting existing systems.
• Troubleshoot production issues, defects, performance problems, and application enhancements.
• Analyze existing processes and identify opportunities for automation, optimization, and innovation.
• Collaborate closely with Product Owners, Scrum Masters, business stakeholders, and technical teams.
• Evaluate emerging technologies and develop Proofs of Concept (POCs) to support modernization initiatives.
• Participate in Agile ceremonies, technical discussions, code reviews, and SDLC activities.
• Lead and mentor junior developers while providing technical guidance and best practices.
• Work within CI/CD and Agile development environments.
• Support application deployments, production releases, and ongoing system enhancements.

Skills

Python

PySpark

Apache Spark

Data Engineering

AWS

SQL

Unix/Linux

SDLC

Agile

Mentoring juniors

CI/CD

Cloud modernization

Production support

POCs

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Hadoop/Spark ecosystem

Job description

Accelyst, LLC is seeking a Senior Full Stack Developer – Python to design and modernize data-centric applications supporting regulatory reporting initiatives. Strong experience in Python, PySpark, AWS and Data Engineering is required.

You will build scalable data pipelines, support legacy systems, and work in an Agile team with CI/CD in cloud environments. Local to DMV region, onsite in McLean, VA.