Remote Hadoop Big Data Engineer – Infrastructure Lead

American Express; City of Albany (NY); Remote; USD 28,000 - 41,000; Full time

Job summary

American Express in the USA is seeking an experienced Hadoop/BigData engineer to design, code and deliver software across our data platforms. You will work with a fast-paced team to ensure scalable, reliable data services that support customer experiences.

The role emphasizes hands-on administration of Hadoop clusters, Linux environments, and related tools. You will contribute to operational strategies, build proof of concepts, and help keep our BigData infrastructure highly available.

Qualifications

• A bachelor’s or master’s degree in computer science, computer engineering or relevant experience is required
• 5+ years of Core Hadoop administration experience
• 5+ years of Linux experience
• HPE MapR DB administration experience preferred
• Experience in VMWARE builds, REST service development, MySQL query development is a plus. Ability to learn new technologies and use them effectively
• Bash scripting and experience with Linux performance monitoring tools required
• Experience in troubleshooting, performance monitoring, cluster monitoring and cluster configuration
• Willingness to learn new technologies and use them to their best potential

Responsibilities

• Design, code and deliver software for BigData platforms
• Maintain world-class availability across multiple BigData platforms
• Engineer Hadoop clusters and participate in operational strategies
• Create infrastructure/products to improve and upgrade equipment and tools production
• Collaborate with Lead Infrastructure Engineering team to implement innovative solutions

Skills

Core Hadoop administration

Linux experience

Bash scripting

VMware builds

MySQL query development

REST service development

Performance monitoring

Troubleshooting

Cluster configuration

Willingness to learn new technologies

Education

Bachelor’s or Master’s degree in computer science, computer engineering or related field

Tools

HPE MapR DB

VMware

MySQL

Job description

American Express in the USA is seeking an experienced Hadoop/BigData engineer to design, code and deliver software across our data platforms. You will work with a fast-paced team to ensure scalable, reliable data services that support customer experiences.

The role emphasizes hands-on administration of Hadoop clusters, Linux environments, and related tools. You will contribute to operational strategies, build proof of concepts, and help keep our BigData infrastructure highly available.