Senior Big Data & AWS Platform Engineer
TechDigital Group
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
TechDigital Group is seeking a Senior Big Data / AWS Administrator to lead hands-on administration of large-scale Hadoop and Kafka environments in a cloud-first setup. The role emphasizes reliability, automation, and scalable data platform operations across AWS, with expertise in Terraform/CloudFormation and CI/CD pipelines.
The ideal candidate brings 10+ years in system administration, deep AWS knowledge, and strong problem-solving skills to ensure high availability and peak performance of
Qualifications
- 10+ years in system administration with 5+ years in big data and cloud environments.
- Proven track record managing large Hadoop clusters and Kafka environments.
- Strong hands-on AWS experience and infrastructure as code expertise.
- Agentic AI experience is a plus.
Responsibilities
- Design, deploy, and manage scalable, secure AWS infrastructure.
- Administer AWS services: EC2, S3, EMR, EKS, IAM, VPC, CloudWatch, Lambda.
- Install, tune, and maintain Hadoop components (HDFS, YARN, Hive, HBase, Spark).
- Install, configure, and manage Apache Kafka clusters and topics.
- Build monitoring, logging, and alerting with Prometheus, Grafana, or Confluent Center.
- Develop CI/CD pipelines for infra and platform deployments.
- Automate tasks with Python/Shell; collaborate with DevOps.
Skills
Education
Tools
Job description
TechDigital Group is seeking a Senior Big Data / AWS Administrator to lead hands-on administration of large-scale Hadoop and Kafka environments in a cloud-first setup. The role emphasizes reliability, automation, and scalable data platform operations across AWS, with expertise in Terraform/CloudFormation and CI/CD pipelines.
The ideal candidate brings 10+ years in system administration, deep AWS knowledge, and strong problem-solving skills to ensure high availability and peak performance of
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
