Data Engineer - PySpark & Spark Performance in Agile

Ampcus Inc; McLean (VA); On-site; USD 90,000 - 130,000; Full time

Job summary

Ampcus Inc is looking for a highly motivated Data Engineer to join their team in McLean, VA. The ideal candidate should have robust data engineering skills, particularly in Python and PySpark, with a proven ability to design, develop, and optimize applications. Responsibilities include working in an agile environment on performance tuning and large dataset management. The company values diversity and is an Equal Opportunity Employer.

Qualifications

• Experience in designing, developing, troubleshooting, and debugging PySpark applications.
• Proven track record in processing and handling large datasets.
• Skills to optimize Spark code for scalability, performance, and maintainability.

Responsibilities

• Design, develop, and fine-tune data engineering applications.
• Thrive in an agile environment and contribute to team efforts.

Skills

Data Engineering with strong Python expertise

Performance tuning Spark applications

GitHub for efficient code management

Job description

Ampcus Inc is looking for a highly motivated Data Engineer to join their team in McLean, VA. The ideal candidate should have robust data engineering skills, particularly in Python and PySpark, with a proven ability to design, develop, and optimize applications. Responsibilities include working in an agile environment on performance tuning and large dataset management. The company values diversity and is an Equal Opportunity Employer.