Senior Data Platform Engineer: Spark, Python & AWS

Yoh Services LLC

Bethesda (MD)

Remote

USD 70,000 - 101,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical benefits

401K retirement plan

Referral programs

Job summary

Yoh Services LLC in Maryland is seeking a Senior Associate L2 – Full Stack Data Platform Support Engineer to maintain enterprise data platforms and cloud-native applications on AWS. You will ensure availability, stability, and performance of batch and real-time processing while proactively monitoring production environments and driving incident resolution.

Collaboration with SRE, Infra, Development, and Business teams is essential.

Qualifications

12+ years of IT experience with 5+ years in Data Engineer
Strong hands-on experience with Spark, Hadoop, Scala/Python
Experience with AWS, EMR, and data platform support
Experience in production support and incident management
Knowledge of CI/CD and cloud security best practices

Responsibilities

Provide L2 production support for enterprise data platforms on AWS
Monitor Big Data apps on EMR (Spark/Hadoop), Kafka, NiFi, EKS, Aurora PostgreSQL, DocumentDB, Couchbase, and S3
Investigate and resolve production incidents within SLAs
Perform RCA and implement permanent fixes with engineering
Monitor batch and streaming pipelines and ensure timely completion
Support workflow orchestration with Oozie and maintain scheduling
Monitor Kafka producers/consumers and lag analysis
Support Kubernetes (EKS) workloads and deployments
Monitor EMR cluster health, auto-scaling, and Spark job execution
Database administration for Aurora PostgreSQL, DocumentDB, Couchbase
Execute deployments and release validations via Jenkins and Harness
Develop dashboards and monitoring using Dynatrace and CloudWatch
Plan capacity and optimize infrastructure to reduce cloud costs