DataOps Engineer
Signature IT World Inc
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
Signature IT World Inc. is seeking a DataOps Engineer to design and maintain scalable data platforms and ETL pipelines.
The ideal candidate will master Hadoop ecosystem components (HDFS, Hive, Spark, YARN), Kubernetes, and AWS, delivering reliable, high-performance data solutions and working closely with engineering teams.
Responsibilities include building ETL/ELT workflows, deploying containerized apps, monitoring pipelines, and optimizing data infrastructure for reliability and speed.
Qualifications
- Experience with ETL/ELT development and data pipelines.
- Strong knowledge of Hadoop ecosystem components (HDFS, Hive, Spark, YARN).
- Proficiency with Linux, automation, and distributed data systems.
Responsibilities
- Develop and maintain ETL/ELT pipelines.
- Manage and optimize Hadoop ecosystem components.
- Deploy and support containerized applications using Kubernetes.
Skills
Tools
Job description
We are seeking a DataOps Engineer to build, automate, and maintain scalable data platforms and ETL pipelines. The ideal candidate will have strong expertise in Hadoop, Kubernetes, AWS, and ETL development, with a focus on delivering reliable and high-performance data solutions.
Key Responsibilities
- Develop and maintain ETL/ELT pipelines.
- Manage and optimize Hadoop ecosystem components.
- Deploy and support containerized applications using Kubernetes.
- Build and maintain AWS-based data infrastructure.
- Monitor, troubleshoot, and optimize data pipelines.
- Collaborate with engineering teams to ensure data reliability and performance.
Required Skills
- Strong experience with Hadoop ecosystem (HDFS, Hive, Spark, YARN).
- Experience with Kubernetes.
- Strong knowledge of AWS architecture and cloud services.
- Good understanding of Linux, automation, and distributed data systems.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
