Senior Data Engineer

The Weather Company; Atlanta (GA); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Flexible Time Off program

Hybrid work model

Variety of medical insurance options

Competitive 401K match

Progressive family plan benefits

Collaborative work environment

Job summary

A leading technology firm is seeking a Senior Data Engineer to design and operate data-intensive platforms in the cloud. You will be responsible for developing reliable data pipelines, utilizing AWS services, and mentoring junior engineers. Ideal candidates have extensive experience in programming languages such as Python, Scala, and Java, and a track record of working with big data technologies. This role offers a hybrid work model with comprehensive benefits from day one.

Qualifications

• 5+ years in Computer Science with successful project track record.
• 5+ years demonstrated experience in AWS solutions deployment.
• Solid experience with big data technologies.

Responsibilities

• Design and implement sophisticated software systems.
• Develop reliable data pipelines and processing systems.
• Mentor junior engineers and lead small projects.

Skills

Python

Scala

Java

SQL

AWS Services (S3, EMR, etc.)

Cassandra

Spark

Hadoop

Data Integrations

Git Version Control

Education

Bachelor's or Master's in a related field

Job description

Overview

The Weather Company is the world’s leading weather provider, helping people and businesses make more informed decisions and take action in the face of weather. Together with advanced technology and AI, The Weather Company’s high-volume weather data, insights, advertising, and media solutions across the open web help people, businesses, and brands around the world prepare for and harness the power of weather in a scalable, privacy-forward way. The world’s most accurate forecaster globally, the company reaches hundreds of enterprise clients and more than 360 million monthly active users via its digital properties from The Weather Channel (weather.com) and Weather Underground (wunderground.com).

Job Brief

We’re seeking a Senior Data Engineer to design, build, and operate large-scale, data-intensive platforms in the cloud. In this role, you’ll be responsible for developing reliable data pipelines, scalable data processing systems, and high-availability architectures that support analytics, machine learning, and data science use cases.

You’ll work with modern big data technologies and AWS services, contribute hands-on code, lead smaller data initiatives, and mentor junior engineers. This is an ideal role for someone who thrives in complex data environments, values strong engineering fundamentals, and enjoys turning raw data into dependable, production-ready systems.

The Impact You\'ll Make

• Designs and implements sophisticated software systems using either object-oriented or functional programming techniques implemented in Python, Scala or Java languages.
• Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash
• Maintain an advanced level of proficiency with Computer Science/Software Engineering knowledge.
• Work well independently and as part of a team, mentoring junior engineers in routine, less-complex tasks, and leading small projects
• Other duties as assigned.

What You\'ve Accomplished

• Bachelor\'s or Master\'s in a related field, or commensurate experience
• 5+ years in Computer Science, with a proven track record of successful projects.
• 5+ years of experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis, and MSK.
• 5+ years of experience with one or more of the following programming languages: Python, Scala, or Java
• 5+ years of experience with SQL.
• 5+ years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc.
• Advanced proficiency in building data integrations using both API and file-based protocols.
• Advanced proficiency with test-driven development and unit testing.
• Experience with Git Version Control or similar
• Experience with CI/CD pipeline patterns and best practices
• Proficiency with alerting and monitoring tools like Grafana
• Demonstrated ability to learn new technologies and languages.
• Able to put together process documentation concisely and clearly.
• Excellent written and verbal communication skills.
• Able to work closely and effectively with peer developers and work on several active projects simultaneously, including leading small projects.
• Solid experience implementing high-availability, scalable cloud solutions
• Strong understanding of data structures and algorithms
• Solid knowledge of functional programming languages and techniques, and object-oriented programming languages and techniques
• Solid knowledge of concurrency and concurrent programming techniques and distributed computing techniques
• Knowledge and understanding of operating with data in large scale, including Machine Learning and Data Science concepts

TWCo Benefits/Perks

• Flexible Time Off program
• Hybrid work model
• Variety of medical insurance options, including a $0 cost premium employee coverage
• Benefits effective day 1 of employment include a competitive 401K match with no vesting requirement, national health, dental, and vision plans
• Progressive family plan benefits
• An opportunity to work for a global and industry-leading technology company
• Impactful work in a collaborative environment