Senior Data Engineer

Beacon Hill; United States; Remote; USD 125,000 - 130,000; Full time

Job summary

A leading technology staffing company is seeking a Senior Data Engineer to optimize scalable data pipeline architectures within an Agile team. Responsibilities include designing data solutions, mentoring junior engineers, and collaborating across various teams to ensure reliable data delivery systems. This remote role requires strong experience in Python, AWS, and data automation practices, along with a Bachelor’s degree in Computer Science or related fields.

Benefits

Medical benefits

Dental benefits

Vision benefits

Qualifications

• 5+ years of experience in Python and building data pipelines.
• 3+ years working with AWS cloud data services.
• 2+ years of CI/CD pipeline development.

Responsibilities

• Design and maintain large, complex data sets meeting business requirements.
• Build and optimize data pipelines using AWS services.
• Create analytics tools that generate actionable business insights.

Skills

Python

PySpark

Terraform

CI/CD

DevOps

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

AWS

Terraform

Job description

Get AI-powered advice on this job and more exclusive features.

Beacon Hill provided pay range

This range is provided by Beacon Hill. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$125,000.00/yr - $130,000.00/yr

Location: REMOTE

Pay Rate: $125,000/year + Bonus

Overview:

We are seeking a Senior Data Engineer to join our Agile team. This role is responsible for designing and optimizing scalable data pipeline architectures, enabling data flow across the organization. The ideal candidate will collaborate with cross-functional teams including developers, database architects, analysts, and data scientists to ensure reliable data delivery systems. This position also involves mentoring junior engineers and contributing to the development of data-driven tools and analytics platforms.

Key Responsibilities

• Design, assemble, and maintain large, complex data sets that meet functional and non-functional business requirements.
• Build and optimize data pipelines using AWS services (Python, PySpark, EC2, S3, Glue, Lambda, and Delta Lake).
• Develop IaC using Terraform and contribute to CI/CD pipelines for automated deployment.
• Implement cloud-based data solutions and microservices architectures.
• Create analytics tools and dashboards that generate actionable business insights.
• Write and maintain clean, efficient, testable, and well-documented code.
• Collaborate on design and code reviews.

Production Support

• Perform regular system maintenance and upgrades.
• Troubleshoot production issues, including those involving third-party applications.
• Anticipate data and infrastructure challenges, proposing and implementing solutions.
• Collaborate with stakeholders to understand data needs and translate them.
• Participate in Agile ceremonies and cross-functional meetings.
• Mentor junior team members.

Requirements

• Strong experience with Python and PySpark for data processing and automation.
• Proficient in Terraform and Git-based version control workflows.
• Hands-on experience building & maintaining CI/CD pipelines.
• Familiarity with message queuing, stream processing, and distributed data architectures.
• Strong understanding of DevOps and infrastructure automation practices.
• Ability to perform root cause analysis on data issues and identify improvement opportunities.

Education & Experience

• Bachelor's degree in Computer Science, Information Systems, or a related field (preferred).
• 5+ years of experience in Python and building data pipelines.
• 3+ years working with AWS cloud data services and IaC.
• 2+ years of CI/CD pipeline development.
  

Beacon Hill is an equal opportunity employer and individuals with disabilities and/or protected veterans are encouraged to apply.

California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.

Company Profile:

Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.

Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.bhsg.com.

Benefits Information:

Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.

We look forward to working with you.

Beacon Hill. Employing the Future

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Media

Referrals increase your chances of interviewing at Beacon Hill by 2x

Get notified about new Senior Data Engineer jobs in United States.

New York, NY $153,000 - $210,000 5 months ago

Houston, TX $150,000 - $250,000 1 week ago

Senior Data Analyst, Growth and Lifecycle Marketing

Rockford, MN $100,000 - $175,000 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.