Senior Data Engineer - Cloud Pipelines, ML-Ready Data

The Weather Company; Atlanta (GA); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Flexible Time Off program

Hybrid work model

Variety of medical insurance options

Competitive 401K match

Progressive family plan benefits

Collaborative work environment

Job summary

A leading technology firm is seeking a Senior Data Engineer to design and operate data-intensive platforms in the cloud. You will be responsible for developing reliable data pipelines, utilizing AWS services, and mentoring junior engineers. Ideal candidates have extensive experience in programming languages such as Python, Scala, and Java, and a track record of working with big data technologies. This role offers a hybrid work model with comprehensive benefits from day one.

Qualifications

• 5+ years in Computer Science with successful project track record.
• 5+ years demonstrated experience in AWS solutions deployment.
• Solid experience with big data technologies.

Responsibilities

• Design and implement sophisticated software systems.
• Develop reliable data pipelines and processing systems.
• Mentor junior engineers and lead small projects.

Skills

Python

Scala

Java

SQL

AWS Services (S3, EMR, etc.)

Cassandra

Spark

Hadoop

Data Integrations

Git Version Control

Education

Bachelor's or Master's in a related field

Job description

A leading technology firm is seeking a Senior Data Engineer to design and operate data-intensive platforms in the cloud. You will be responsible for developing reliable data pipelines, utilizing AWS services, and mentoring junior engineers. Ideal candidates have extensive experience in programming languages such as Python, Scala, and Java, and a track record of working with big data technologies. This role offers a hybrid work model with comprehensive benefits from day one.