Senior Data Engineer: AWS/Python/Scala for ML & Real-Time

Yoh; Plano (TX); Hybrid; USD 73,000 - 110,000; Full time

Benefits offered by this job

Medical Benefits

Dental & Vision Benefits

HSA

Life Insurance

Disability Insurance

401K

Direct Deposit

Epayroll

Referral Bonus

Training opportunities

Job summary

Yoh is seeking a Senior Data Engineer to design and implement scalable data engineering and ML solutions in a hybrid, multi-location setting including McLean, NYC, Wilmington, Boston, Plano, Chicago, and Richmond. The role emphasizes Python/Scala development, AWS services, and real-time data pipelines.

Key responsibilities include building data pipelines with EMR/Glue, implementing streaming architectures with Kafka, and creating REST APIs to support data workflows, while ensuring performance,

Qualifications

• Senior-level experience in data engineering, big data, or machine learning engineering.
• Strong hands-on experience with Python and/or Scala.
• Experience developing solutions in AWS environments.
• Practical experience with AWS EMR and AWS Glue.
• Experience building and consuming REST APIs.
• Experience with Kafka and streaming data architectures.
• Strong SQL development and data manipulation skills.
• Experience working with distributed data processing and large-scale data platforms.
• Strong communication and collaboration skills.

Responsibilities

• Design, develop, test, and support scalable data engineering solutions.
• Build and maintain data pipelines using AWS services, including EMR and Glue.
• Develop distributed data processing applications using Python and Scala.
• Implement real-time and event-driven data solutions using Kafka and streaming technologies.
• Create and integrate REST APIs to support data and application workflows.
• Write complex SQL queries for data transformation, analysis, validation, and troubleshooting.
• Collaborate with data scientists, software engineers, architects, and business stakeholders.
• Ensure solutions meet standards for performance, reliability, scalability, security, and data quality.
• Troubleshoot production issues and support ongoing enhancements to data platforms.
• Contribute to technical documentation, code reviews, testing, and Agile delivery practices.
• Apply machine learning or artificial intelligence capabilities where appropriate.

Skills

Python

Scala

AWS data services

distributed processing

streaming technologies

SQL

REST APIs

Kafka

Tools

AWS EMR

AWS Glue

Kafka

Spark/PySpark

Job description

Yoh is seeking a Senior Data Engineer to design and implement scalable data engineering and ML solutions in a hybrid, multi-location setting including McLean, NYC, Wilmington, Boston, Plano, Chicago, and Richmond. The role emphasizes Python/Scala development, AWS services, and real-time data pipelines.

Key responsibilities include building data pipelines with EMR/Glue, implementing streaming architectures with Kafka, and creating REST APIs to support data workflows, while ensuring performance,