Senior Data Engineer - Spark, AWS ETL Architect

Beacon Hill; Greenwood Village (CO); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Leave programs

Job summary

Beacon Hill in Greenwood Village, Colorado, seeks a Sr Data Engineer to build and maintain data pipelines supporting enterprise networks.

You will design scalable ETL processes with Spark, leverage AWS services (S3, Redshift, EMR), and ensure data quality and availability for analytics and reporting.

Strong communication across teams and leadership in data engineering practices are required to translate complex findings for stakeholders with varied technical backgrounds.

Qualifications

• Ability to read, write, speak, and understand English
• Strong communication and collaboration skills
• Expertise in data engineering languages such as Scala (preferred) or Java, with proficiency in Python
• Experience with BigData tools, particularly Spark, and familiarity with Hadoop ecosystems
• Proficiency in building and managing ETL pipelines
• Experience with cloud platforms like AWS, including services such as S3, Lambda, Redshift, and EMR
• Strong understanding of relational databases and SQL, and familiarity with NoSQL databases
• Knowledge of data architecture, data warehousing, and data marts
• Experience in implementing monitoring solutions and deployment pipelines for data applications
• Ability to work with distributed systems and manage data storage solutions
• Demonstrated ability and desire to continually expand skill set, and learn from and teach others
• Education: Bachelor’s degree related field

Responsibilities

• Design, develop, and maintain scalable ETL pipelines to ensure data quality and availability
• Implement monitoring and alerting solutions to ensure data pipeline reliability and performance
• Develop and manage deployment pipelines to facilitate continuous integration and delivery of data engineering solutions
• Manage and optimize data storage solutions, including distributed file systems, relational databases, flat files, and external sources via API
• Implement data integration solutions to support analytics and reporting needs
• Collaborate across teams to ensure data solutions align with production architectures and business requirements
• Provide technical leadership and guidance on data engineering best practices and methodologies
• Document and communicate data engineering processes and standards to BI, data, and analytics professionals
• Continuously evaluate and improve data engineering tools and approaches to enhance performance and efficiency
• Perform other duties as required

Skills

Scala

Java

Python

Spark

Hadoop

SQL

NoSQL

ETL pipelines

Education

Bachelor's degree in CS / Math / Stats / Physics

Tools

Spark

Hadoop

AWS

S3

Redshift

EMR

Job description

Beacon Hill in Greenwood Village, Colorado, seeks a Sr Data Engineer to build and maintain data pipelines supporting enterprise networks.

You will design scalable ETL processes with Spark, leverage AWS services (S3, Redshift, EMR), and ensure data quality and availability for analytics and reporting.

Strong communication across teams and leadership in data engineering practices are required to translate complex findings for stakeholders with varied technical backgrounds.