Senior Data Engineer: Pipelines, Cloud & Data Lakes

hackajob; Plano (TX); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Health care coverage

On-site wellness centers

Retirement plan

Backup childcare

Tuition reimbursement

Mental health support

Financial coaching

Job summary

hackajob is seeking a Data Engineer to identify, analyze, and interpret trends in complex data sets, and to design and implement data pipelines while maintaining data warehouses and data lakes. The role emphasizes data quality and consistency and requires collaboration across teams in a fast-paced environment.

Proficiency with AWS, Apache Spark, Kafka, Python, SQL, and orchestration tooling is essential, with experience following Agile SDLC practices. The position is on-site in Plano, TX.

Qualifications

• Master's degree in a relevant field
• At least 3 years of experience in data engineering or related roles
• Proficiency in technologies and methodologies related to data processing and cloud environments

Responsibilities

• Identify, analyze, and interpret trends in complex data sets
• Design and implement data pipelines
• Maintain data warehouses and data lakes
• Ensure data quality and consistency

Skills

Data Engineering

Automation

Orchestration

ETL

Data Pipeline

AWS

Apache Spark

Kafka

Python

SQL

Java

Unix Shell Scripting

Kubernetes

ReactJS

JIRA

Agile SDLC

Education

Master's degree in a relevant field

Tools

JIRA

Kubernetes

Job description

hackajob is seeking a Data Engineer to identify, analyze, and interpret trends in complex data sets, and to design and implement data pipelines while maintaining data warehouses and data lakes. The role emphasizes data quality and consistency and requires collaboration across teams in a fast-paced environment.

Proficiency with AWS, Apache Spark, Kafka, Python, SQL, and orchestration tooling is essential, with experience following Agile SDLC practices. The position is on-site in Plano, TX.