Senior Data Engineer - Real-Time Cloud Pipelines

TechDigital Group; United States; Remote; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer with extensive experience in developing scalable data solutions. This role involves building and maintaining critical data pipelines, collaborating with cross-functional teams, and mentoring junior engineers. The ideal candidate should have a strong background in AWS and big data technologies, along with a passion for innovation and continuous learning. Join a dynamic team that values collaboration and technical excellence, and contribute to impactful projects that shape the future of data analytics. If you're ready to take on challenges in a fast-paced environment, this opportunity is for you.

Qualifications

• 7+ years of experience in data solutions and 3+ years coding in Python or Scala.
• Experience with AWS, real-time data streaming tools, and MPP databases.

Responsibilities

• Build and maintain scalable Data Pipelines for complex data sets.
• Collaborate with team members to develop real-time and batch data solutions.
• Mentor junior engineers and create documentation for processes.

Skills

Python

Scala

Data Pipeline Development

AWS Cloud Platform

Kafka

Kinesis

MPP Databases

Serverless ETL

Big Data Technologies

Agile Methodologies

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Glue

Matillion

Snowflake

Redshift

Hadoop

Spark

Cassandra

MongoDB

Job description

An established industry player is seeking a skilled Data Engineer with extensive experience in developing scalable data solutions. This role involves building and maintaining critical data pipelines, collaborating with cross-functional teams, and mentoring junior engineers. The ideal candidate should have a strong background in AWS and big data technologies, along with a passion for innovation and continuous learning. Join a dynamic team that values collaboration and technical excellence, and contribute to impactful projects that shape the future of data analytics. If you're ready to take on challenges in a fast-paced environment, this opportunity is for you.