Lead Data Engineer for AI & Big Data (Remote)

Genpact Ltd.; United States; Remote; USD 150.000 - 190.000; Vollzeit

Zusammenfassung

Genpact Ltd. is seeking a Lead Data Engineer to steer a team of data engineers in building scalable Big Data architectures and reliable ETL pipelines.

You will ensure data quality, governance, and security while collaborating with stakeholders to translate business needs into robust data solutions. The role requires strong expertise in Spark, Airflow, SQL, Snowflake, and cloud data platforms, with a focus on performance, scalability, and mentorship.

Qualifikationen

• Bachelor's degree in Computer Science, Data Science or Statistics.
• Master's degree in Data Science is preferred.
• Experience with data engineering/data lake architectures beneficial.

Aufgaben

• Lead a team of data engineers in developing and implementing Big Data solutions;
• Design and build scalable data pipelines and ETL processes;
• Ensure data quality, integrity, and security across all data systems;
• Collaborate with stakeholders to understand and address business requirements;
• Provide technical guidance and mentorship to junior team members;
• Stay current with industry trends and technologies related to Big Data and data engineering;
• Perform data analysis and troubleshooting to optimize system performance and efficiency;
• Develop and maintain documentation for data processes, systems, and infrastructure.

Kenntnisse

Apache Airflow

Apache Kafka

Apache Spark

API Integration

AWS Data Pipeline

CI/CD

Databricks Platform

Data Engineering

Data ETL

Data Integration

Data Modeling

Data Quality

Git

Performance Tuning

Secure Coding Practices

Snowflake (Platform)

SQL

System Performance Monitoring

Terraform (Software)

Ausbildung

Bachelors - Computer Science

Bachelors - Data Science

Bachelors - Statistics

Masters - Data Science

Tools

Databricks

Databricks Platform

Microsoft Azure

Oracle DB

Jobbeschreibung

Genpact Ltd. is seeking a Lead Data Engineer to steer a team of data engineers in building scalable Big Data architectures and reliable ETL pipelines.

You will ensure data quality, governance, and security while collaborating with stakeholders to translate business needs into robust data solutions. The role requires strong expertise in Spark, Airflow, SQL, Snowflake, and cloud data platforms, with a focus on performance, scalability, and mentorship.