Senior Data Engineer - AWS, PySpark & Databricks

Ampcus, Inc; McLean (VA); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology consulting firm is looking for a highly skilled Sr. Data Engineer to join their team in McLean, VA. The position demands extensive experience in data engineering, focusing on AWS services, Python programming, and big data technologies. Responsibilities include managing data infrastructure, developing automation scripts, and ensuring data integration. Applicants should possess strong problem-solving and communication skills. Competitive compensation and professional growth opportunities are offered.

Qualifications

• Proven experience in data engineering, with a focus on cloud services and big data technologies.
• Proficiency in using AWS services for data management.
• Strong troubleshooting skills to solve complex technical issues.

Responsibilities

• Utilize AWS services to manage cloud-based data infrastructure.
• Develop scripts and applications using Python to automate tasks.
• Manage data processing workflows using PySpark and Databricks.
• Design and maintain SQL databases for data integrity.
• Integrate data from various sources for analytics.
• Perform regular system upgrades and troubleshooting.
• Collaborate with stakeholders to deliver data solutions.
• Ability to travel to support organizational objectives.

Skills

AWS Management

Python Programming

Big Data Processing

Database Management

Data Integration

Problem-Solving

Communication

Tools

AWS EMR

AWS DynamoDB

AWS S3

AWS Lambda

Python

PySpark

Databricks

SQL

Job description

A technology consulting firm is looking for a highly skilled Sr. Data Engineer to join their team in McLean, VA. The position demands extensive experience in data engineering, focusing on AWS services, Python programming, and big data technologies. Responsibilities include managing data infrastructure, developing automation scripts, and ensuring data integration. Applicants should possess strong problem-solving and communication skills. Competitive compensation and professional growth opportunities are offered.