Lead AWS Data Engineer: Databricks & Spark Architect

VY Systems; St. Louis (MO); Híbrido; USD 140.000 - 190.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid work schedule

Competitive compensation

Descripción de la vacante

VY Systems seeks a Lead AWS Data Engineer with Databricks in St. Louis, MO (Hybrid). You will architect and optimize scalable data pipelines, data warehousing, and analytics platforms for the utility sector. Bring expert AWS, Databricks, Spark, and Delta Lake skills to lead complex ETL/ELT projects.

You will mentor engineers, drive governance, and collaborate with business analysts and software teams to deliver high-impact solutions in a hybrid work setup.

Formación

• Bachelor's degree in CS, IT, or related field.
• 7+ years of software or data engineering experience.
• Strong AWS data services experience (S3, Glue, EMR, Redshift).
• Deep Databricks, Spark, PySpark, Delta Lake expertise.
• Proven ETL/ELT pipeline design and governance experience.

Responsabilidades

• Architect and build scalable ETL/ELT pipelines on AWS for utility domain analytics.
• Lead Databricks-based data processing and analytics development.
• Design data models and schemas (star/snowflake) for data warehousing.
• Mentor junior engineers and conduct code reviews.

Conocimientos

Leadership

Mentoring

Problem solving

Cross-functional communication

Stakeholder management

Educación

Bachelor's degree in Computer Science or related field

Herramientas

AWS Cloud

Databricks

Apache Spark

Delta Lake

PySpark

SQL

ETL/ELT

Terraform

CI/CD (GitHub Actions/GitLab)

Airflow

Descripción del empleo

VY Systems seeks a Lead AWS Data Engineer with Databricks in St. Louis, MO (Hybrid). You will architect and optimize scalable data pipelines, data warehousing, and analytics platforms for the utility sector. Bring expert AWS, Databricks, Spark, and Delta Lake skills to lead complex ETL/ELT projects.

You will mentor engineers, drive governance, and collaborate with business analysts and software teams to deliver high-impact solutions in a hybrid work setup.