Data Engineer

TechDigital Group; Irving (TX); On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking a seasoned Data Engineering Team Lead to provide technical guidance and enhance team productivity. This role involves defining best practices, ensuring compliance, and leading discussions on technical feasibility. The ideal candidate will have extensive experience with big data technologies and a strong background in data analytics, making significant contributions to project success. Join a dynamic team where your expertise in data mining, machine learning, and programming will drive innovation and efficiency. If you are passionate about leading teams and advancing data capabilities, this opportunity is perfect for you.

Qualifications

• 9+ years of experience in Data Engineering and Data Analytics required.
• Lead experience is highly preferred for this TEAM LEAD position.

Responsibilities

• Provide technical guidance and implement best practices for the team.
• Ensure process compliance and participate in technical discussions.

Skills

Data Engineering

Data Analytics

Big Data Technologies

Spark

Kafka

GCP

AWS

Python

R

Machine Learning

Tools

Jenkins

Java

Spring Boot

Oozie

Airflow

Composer

H2O

TensorFlow

Elasticsearch

Splunk

Job description

Job #: 5024
Pay Rate: Not Specified
Job type: contractor
Location: Irving, TX

Key Responsibilities

• Provide technical guidance or solutions; define, advocate, and implement best practices and coding standards for the team.
• Ensure process compliance in the assigned module, and participate in technical discussions or reviews as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
• Develop and guide the team members in enhancing their technical capabilities and increasing productivity.
• Prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.

Required Skills and Experience

• 9+ years of experience in Data Engineering and Data Analytics.
• Expert in Big Data Technologies including Spark, Kafka, Kudu, Impala, HBase, and Spark Scala programming.
• Experience with GCP, AWS, and data pipelines.
• Familiarity with scheduling tools such as Oozie, Airflow, and Composer.
• Basic knowledge of CI/CD processes using Jenkins, Java, and Spring Boot.
• Lead experience is highly preferred for this TEAM LEAD position.
• Strong programming skills in Python and R, with expertise in algorithms and data models.
• Experience in reporting and dashboarding tools like H2O, TensorFlow, and Prediction.io.
• Knowledge of distributed data platforms like HDFS and data cleaning, wrangling, visualization, and reporting.
• Deep understanding of data mining, machine learning, natural language processing, or information retrieval.
• Experience processing large amounts of structured and unstructured data, integrating data from multiple sources.
• Familiarity with Elasticsearch, Splunk, Cassandra, and cluster compute technologies like Spark, Akka, NoSQL DB.
• Exposure to Hortonworks toolset, Zookeeper, and distributed data.