Senior Data Engineer: Lead Data Pipelines & Architecture

TXU Energy; Irving (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Vistra Corporate Services Company in Irving, Texas seeks a Lead Data Engineer to architect and implement large-scale data solutions, pipelines, and data warehouses. You will collaborate with data scientists and analysts to ensure data is processed, stored, and made available for insights.

You will lead junior engineers, optimize performance, ensure data security, and drive governance while evaluating new technologies for strategic adoption.

Qualifications

• 7-9 years of experience in data engineering, data warehousing, and ETL processes.
• Proficient in programming languages such as Python, Java, or SQL.
• Experience with database technologies such as MySQL, PostgreSQL, or MongoDB.
• Experience with data visualization tools such as Tableau or Power BI.
• Experience with big data technologies such as Hadoop, Spark, or Kafka.

Responsibilities

• Lead the design and implementation of complex data pipelines, ETL processes, and data warehousing solutions.
• Build and manage databases and data models.
• Develop and implement data integration and data transformation processes.
• Collaborate with data scientists and data analysts to understand data requirements and provide data in the required format.
• Ensure data accuracy, completeness, and integrity.
• Optimize system performance and recommend improvements to optimize performance.
• Implement and maintain data security measures.
• Ensure compliance with data privacy and data governance policies.
• Lead and mentor junior data engineers and provide technical guidance and support.
• Evaluate new data technologies and make recommendations for implementation.
• Manage projects and ensure timely delivery of data solutions.

Skills

Python

Java

SQL

Education

Bachelor's degree or higher

Tools

MySQL

PostgreSQL

MongoDB

Tableau

Power BI

Hadoop

Spark

Kafka

Job description

Vistra Corporate Services Company in Irving, Texas seeks a Lead Data Engineer to architect and implement large-scale data solutions, pipelines, and data warehouses. You will collaborate with data scientists and analysts to ensure data is processed, stored, and made available for insights.

You will lead junior engineers, optimize performance, ensure data security, and drive governance while evaluating new technologies for strategic adoption.