We are seeking an experienced remote Senior Data DevOps Engineer to join our team.
You will work on monitoring and managing Hadoop and big data infrastructure for production and UAT environments, ensuring optimal utilization across all teams and use cases. If you are passionate about data and have a strong track record of managing complex infrastructure projects, we invite you to apply for this exciting opportunity.
Responsibilities
- Monitor and manage Hadoop and big data infrastructure for production and UAT environments, ensuring optimal utilization across all teams and use cases
- Set up Hadoop infrastructure across dev, pre-prod, and prod environments, separate from Compliance
- Separate compute clusters from storage clusters, exploring cloud opportunities for storage or compute independently
- Manage customer escalations and serve as the first point of contact for troubleshooting issues
- Enhance troubleshooting tools and improve debugging and monitoring alarms to assist engineers with incident analysis
- Collaborate with cross-functional teams to ensure successful project delivery
Requirements
- Minimum of 3 years of experience in DevOps, focusing on data and infrastructure management
- Expertise in Apache Hadoop and Big Data, with experience setting up and managing Hadoop infrastructure across multiple environments
- Strong knowledge of Security Incident Management, including managing customer escalations and troubleshooting issues
- Experience in separating compute clusters from storage clusters, enabling cloud exploration for storage or compute independently
- Strong analytical and problem-solving skills, with a focus on improving troubleshooting tools and monitoring alarms
- Excellent communication skills and the ability to work collaboratively with cross-functional teams
- Fluent spoken and written English at Upper-Intermediate level or higher
Nice to have
- Experience with cloud platforms such as AWS or Azure
- Knowledge of containerization technologies like Docker or Kubernetes
- Experience with scripting languages such as Python or Bash
- Familiarity with configuration management tools like Ansible or Chef
- Expertise in performance tuning and optimization for big data applications
We offer
- International projects with top brands
- Work with global, diverse teams of highly skilled peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling, and certification courses
- Unlimited access to LinkedIn Learning and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek, and LinkedIn
Additional Details
- Seniority level: Mid-Senior level
- Employment type: Full-time
- Job functions: Engineering, IT, Business Development
- Industries: Software Development, IT Services & Consulting, Banking