Hadoop Solutions Engineer – Lead

Jobtailor

Town of Florida (NY)

On-site

USD 120,000 - 180,000

Full time

7 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Jobtailor is seeking an experienced engineering leader to define and drive the end-to-end technology strategy across Hadoop-based stacks in a fast-moving environment. You will guide multiple teams, optimize performance, and ensure enterprise-compliant solutions while collaborating with product stakeholders to align technical goals with business strategy.

The role emphasizes hands-on Hadoop/Big Data mastery, cloud and container tooling, and strong DevOps capabilities.

Qualifications

Experience with Hadoop, Kafka, Spark, Impala, Hive, HBase, and related Big Data technologies.
Strong knowledge of Hadoop architecture, HDFS, Hadoop clusters, and Hadoop administration.
Intimate knowledge of fully integrated AD/Kerberos authentication.
Experience setting up optimum cluster configurations.
Debugging knowledge of YARN.
Hands‑on experience analyzing Hadoop log files, compression, encoding, and file formats.
Expert‑level knowledge of Cloudera Hadoop components, including HDFS, Sentry, HBase, Kafka, Impala, Solr, Hue, Spark, Hive, YARN, Zookeeper, and Postgres.
Strong technical knowledge of Unix/Linux, Sybase/SQL/Oracle databases, Java, Python, Perl, Shell scripting, and infrastructure.
Experience with monitoring and alerting and job scheduling systems.
Comfort with frequent, incremental code testing and deployment.
Strong grasp of automation and DevOps tools, including Ansible, Jenkins, SVN, and Bitbucket.
Experience working on Big Data technologies.
Cloudera Admin or Development certification desired.
Certification in Cloud, Docker-Container, or OpenShift technologies desired.
Ability to collaborate with clients, development teams, vendors, and other partners at high technical levels.
40 hours per week; first shift in the United States of America.

Responsibilities

Define and lead the engineering approach across end-to-end technology stacks.
Lead teams to deliver design solutions.
Identify and improve performance and capacity issues in development environments.
Ensure system design solutions comply with enterprise standards.
Demonstrate technical expertise within relevant domains and decompose objectives into work units.
Advance efficient solution delivery practices and promote strong design, engineering, and organizational practices.
Support NextGen Platforms built around Hadoop, Spark, Kafka, Impala, HBase, Docker-Container, Ansible, and related technologies.
Manage Hadoop and Data Science platform operations focused on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container cluster management and administration.
Work with product management, product owners, and stakeholders to align execution with product strategy and contribute to technology strategy.
Mentor and guide Solution Engineer resources and junior engineers on performance evaluation and validation methods and tools.
Participate in Communities of Practice and contribute to large or highly complex architectural designs.
Collaborate with Development and Infrastructure teams to provide required performance capabilities across technology stacks.
Support complex, major, or highly visible tasks across multiple projects.
Manage platform operations across environments, including upgrades, bug fixes, deployments, metrics and monitoring, disaster recovery, incident/problem/capacity management.
Liaise between client partners and vendors with project managers to provide technical solutions addressing user needs.
Participate in the full application life cycle and agile development process.

Skills

Collaboration

Mentoring

Communication

Education

Cloudera Admin Certification

Cloud Certification

Docker-Container Certification

OpenShift Certification

Tools

Docker-Container

Ansible

Jupyter Notebook

OpenShift

SVN

Bitbucket

Monitoring Systems

Job Scheduling Systems

Job description

Define and lead the engineering approach across end-to-end technology stacks
Lead teams to deliver design solutions
Identify and improve performance and capacity issues in development environments
Ensure system design solutions comply with enterprise standards
Demonstrate technical expertise within relevant domains and decompose objectives into work units
Advance efficient solution delivery practices and promote strong design, engineering, and organizational practices
Support NextGen Platforms built around Hadoop, Spark, Kafka, Impala, HBase, Docker-Container, Ansible, and related technologies
Manage Hadoop and Data Science platform operations focused on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container cluster management and administration
Work with product management, product owners, and stakeholders to align execution with product strategy and contribute to technology strategy
Mentor and guide Solution Engineer resources and junior engineers on performance evaluation and validation methods and tools
Participate in Communities of Practice and contribute to large or highly complex architectural designs
Collaborate with Development and Infrastructure teams to provide required performance capabilities across technology stacks
Support complex, major, or highly visible tasks across multiple projects
Manage platform operations across environments, including upgrades, bug fixes, deployments, metrics and monitoring, disaster recovery, incident/problem/capacity management
Liaise between client partners and vendors with project managers to provide technical solutions addressing user needs
Participate in the full application life cycle and agile development process

Requirements

Experience with Hadoop, Kafka, Spark, Impala, Hive, HBase, and related Big Data technologies
Strong knowledge of Hadoop architecture, HDFS, Hadoop clusters, and Hadoop administration
Intimate knowledge of fully integrated AD/Kerberos authentication
Experience setting up optimum cluster configurations
Debugging knowledge of YARN
Hands‑on experience analyzing Hadoop log files, compression, encoding, and file formats
Expert‑level knowledge of Cloudera Hadoop components, including HDFS, Sentry, HBase, Kafka, Impala, Solr, Hue, Spark, Hive, YARN, Zookeeper, and Postgres
Strong technical knowledge of Unix/Linux, Sybase/SQL/Oracle databases, Java, Python, Perl, Shell scripting, and infrastructure
Experience with monitoring and alerting and job scheduling systems
Comfort with frequent, incremental code testing and deployment
Strong grasp of automation and DevOps tools, including Ansible, Jenkins, SVN, and Bitbucket
Experience working on Big Data technologies
Cloudera Admin or Development certification desired
Certification in Cloud, Docker-Container, or OpenShift technologies desired
Ability to collaborate with clients, development teams, vendors, and other partners at high technical levels
40 hours per week; first shift in the United States of America

Core Competencies

Demonstrates expertise in leading engineering approaches across technology stacks, with a strong focus on Hadoop and Big Data technologies. Capable of managing platform operations, mentoring teams, and ensuring compliance with enterprise standards while promoting efficient solution delivery practices.

Highest-signal resume keywords