Senior Data Platform Lead — AWS, Airflow, Data Governance

Value Innovation Labs Inc.; Dallas (TX); Vor Ort; USD 150.000 - 210.000; Vollzeit

Zusammenfassung

Value Innovation Labs Inc. in Dallas is seeking an experienced Data Engineering Leader to architect and scale our data platforms. You will design data pipelines, lead cross-functional teams, and drive real-time processing with technologies like Airflow, Kafka, and AWS Lambda.

You will optimize cost, performance, and governance across data warehouses, data lakes, and MDM programs, mentoring engineers and collaborating with senior leadership to turn data into strategic insights.

Qualifikationen

• 7-10 years of experience in data engineering with leadership and project management experience.
• Experience leading cross-functional teams and managing multiple projects simultaneously.
• Strong expertise in cloud data platforms (AWS) and big data ecosystems, with focus on cost, performance, and scalability.
• Proficient in advanced data modeling, including enterprise data warehouses, data lakes, and data marts.
• In-depth knowledge of data governance practices, including cataloging, lineage, and data quality management.
• Experience with Master Data Management (MDM) and metadata management.
• Advanced skills in programming and scripting languages (Python, Java, Scala) for developing and automating data workflows.
• Experience with real-time data processing and event-driven architectures using Apache Kafka, Spark Streaming, and AWS Lambda.
• Exceptional ability to influence and engage senior leaders with data-driven insights.
• Leads with a collaborative spirit, driving team success through shared goals.
• Sets the standard for integrity and fosters a culture of trust.
• Demonstrates resilience and guides the team through challenges.
• Acts as a change agent leading transformative initiatives that drive business success.
• Leads and coordinates efforts across departments to align with organizational goals.
• Provides visionary leadership, developing future leaders.

Aufgaben

• Lead data engineering programs and projects across the organization.
• Architect and optimize data pipelines and cloud data platforms.
• Drive data governance, cataloging, lineage, and quality initiatives.
• Collaborate with senior leaders and cross-functional teams to translate data into strategy.
• Mentor and develop engineers and data scientists for future leadership roles.
• Ensure cost, performance, and scalability optimization across data systems.

Kenntnisse

Data pipeline orchestration

Airflow

NiFi

Glue

AWS

Kafka

Spark Streaming

AWS Lambda

Python

Java

Scala

Data modeling

Data warehouses

Data lakes

Data governance

MDM

Metadata management

Leadership

Project management

Cross-functional leadership

Ausbildung

Bachelor's degree in CS/IT or related field

Master's degree in CS/IT or related field

Tools

SQL

Python

Java

Scala

Jobbeschreibung

Value Innovation Labs Inc. in Dallas is seeking an experienced Data Engineering Leader to architect and scale our data platforms. You will design data pipelines, lead cross-functional teams, and drive real-time processing with technologies like Airflow, Kafka, and AWS Lambda.

You will optimize cost, performance, and governance across data warehouses, data lakes, and MDM programs, mentoring engineers and collaborating with senior leadership to turn data into strategic insights.