Senior Data Engineer - Cloud Lakehouse & Scalable Pipelines

Enterprise Engineering Inc. (EEI); St. Louis (MO); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Enterprise Engineering Inc. (EEI) in St. Louis is seeking an experienced Data Engineer to design, build, and optimize data pipelines across on-prem and cloud environments.

The role emphasizes scalable, secure solutions using Spark, Java/Scala, and Hadoop ecosystems. This 12-month hybrid position involves collaboration with architects, analysts, and product owners, mentoring juniors, and leading end-to-end development from requirements through production support.

Qualifications

• 8+ years delivering enterprise data solutions.
• Experience migrating workloads to cloud.
• Strong SQL and data modeling skills.
• Proficient in Spark, Hadoop ecosystem.
• Experience with Agile delivery.

Responsibilities

• Design, test, and deploy scalable data pipelines using Spark, Java/Scala.
• Build batch and real-time processing for petabyte-scale workloads.
• Develop reusable components and enterprise-quality frameworks.
• Migrate ETL workloads from on-prem to cloud-native.
• Implement data lineage, cataloguing, governance and observability.
• Lead end-to-end development incl. requirement analysis, deployment, and support.
• Mentor junior engineers and conduct code reviews.
• Collaborate with architects, product owners, and stakeholders.
• Triage production incidents and perform RCA.
• Adhere to engineering, security, QA standards.

Skills

Spark

Java/Scala

Hadoop

Airflow/NiFi

AWS

SQL/NoSQL

Data pipelines

Tools

S3

EMR

Glue

Cloud Storage

Databricks

Job description

Enterprise Engineering Inc. (EEI) in St. Louis is seeking an experienced Data Engineer to design, build, and optimize data pipelines across on-prem and cloud environments.

The role emphasizes scalable, secure solutions using Spark, Java/Scala, and Hadoop ecosystems. This 12-month hybrid position involves collaboration with architects, analysts, and product owners, mentoring juniors, and leading end-to-end development from requirements through production support.