Data Engineering Tech Lead – Hadoop

Ethereum Technologies LLC; Cleveland (OH); On-site; USD 120,000 - 160,000; Full time

Job summary

Ethereum Technologies LLC seeks a senior data engineer lead to own end-to-end design, implementation, and optimization of data pipelines supporting onboarding, transactions, and decisioning workflows.

Team leadership and mentorship of data engineers, hands-on work with Hadoop ecosystem, Spark, Airflow, and cloud platforms to deliver scalable, secure data platforms that meet regulatory requirements.

Qualifications

• 8-10 years of experience in data engineering with 2-3 years in a leadership role.
• Deep expertise in Hadoop ecosystem components (HDFS, Hive, MapReduce, HBase, Pig).
• Hands-on with data serialization formats (Avro, Parquet).
• Proven ability to design and maintain ETL/ELT pipelines (Spark, Flink, Airflow, NiFi).
• Strong data modeling, warehousing, and data lake architectures.
• Experience with SQL and both relational and NoSQL stores.
• Cloud data platforms experience with AWS.
• Knowledge of data security, compliance, and governance.

Responsibilities

• Lead end-to-end design, implementation, and optimization of data pipelines for onboarding, transactions, and decisioning.
• Architect data ingestion, transformation, and storage frameworks using Hadoop, Avro, Parquet, and distributed processing.
• Collaborate with product, analytics, and tech teams to deliver scalable data solutions.
• Provide technical leadership and mentorship to a team of data engineers.
• Design robust data frameworks to support new product launches.
• Develop best practices for data governance, security, and regulatory compliance.
• Drive optimization for efficiency, scalability, and maintainability of pipelines.
• Work with analytics and risk teams to enable predictive insights and strategic decisions.
• Evaluate new data technologies to future-proof the platform.

Skills

Data engineering

Technical leadership

Hadoop ecosystem

ETL pipelines

SQL

NoSQL

Spark

Flink

Airflow

NiFi

Parquet

Avro

Data modeling

Data warehousing

AWS

Data security

Regulatory compliance

Communication

Leadership

Tools

Spark

Flink

Airflow

NiFi

Hadoop

AWS

Job description

• Lead and oversee the end-to-end design, implementation, and optimization ofdata pipelinessupporting key customer onboarding, transaction, and decisioning workflows.
• Architect and implementdata ingestion, transformation, and storageframeworks leveragingHadoop,Avro, and distributed data processing technologies.
• Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
• Providetechnical leadership and mentorshipto a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
• Design and implement robust data frameworks to support next-generation customer and business product launches.
• Develop best practices fordata governance,security, andcompliancealigned with enterprise and regulatory requirements.
• Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
• Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
• Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.

Must-Have Skills

• 8-10 years of experience indata engineering, with at least2-3 years in a technical leadership role.
• Strong expertise in theHadoop ecosystem(HDFS, Hive, MapReduce, HBase, Pig, etc.).
• Experience working withAvro,Parquet, or other serialization formats.
• Proven ability to design and maintainETL / ELT pipelinesusing tools such asSpark,Flink,Airflow, orNiFi.
• Strong understanding ofdata modeling,data warehousing, anddata lakearchitectures.
• Hands-on experience withSQLand bothrelationalandNoSQLdata stores.
• Cloud data platform experience withAWS.
• Deep understanding ofdata security,compliance, andgovernance frameworks.
• Excellent problem-solving, communication, and leadership skills.

ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract