Data Engineer

Aptiv; Chennai; Presencial; INR 900.000 - 1.500.000; Jornada completa

Descripción de la vacante

Aptiv is seeking a data engineer in Chennai, India to design and maintain scalable ETL pipelines and data models for analytics. You will work with PostgreSQL, MySQL, MongoDB, and Google Cloud SQL, leveraging GCP services like Cloud Storage, Dataproc, Dataflow, and BigQuery to enable data-driven decision making.

In this role, you will operate in an Agile environment (Scrum/Kanban), participate in sprint planning, and ensure smooth production deployments of data engineering solutions.

Formación

• Design, develop and maintain scalable ETL pipelines for data processing and reporting.
• Implement data modeling techniques to optimize storage and retrieval for analytics.
• Leverage data analytics to extract insights for data-driven decisions.
• Develop automated AutoML solutions to streamline model development.
• Manage relational and non-relational databases ensuring data integrity and security.

Responsabilidades

• Design, develop and maintain scalable ETL pipelines to process raw data for analysis and reporting.
• Implement data modeling to optimize storage and query performance.
• Utilize analytics to derive insights from large datasets for business decisions.
• Develop and deploy AutoML solutions to streamline modeling workflows.
• Administer PostgreSQL, MySQL, MongoDB, and Google Cloud SQL databases.
• Tune databases to improve query performance and system efficiency.
• Deploy data processing on GCP using Cloud Storage, Dataproc, Dataflow and BigQuery.
• Coordinate release of data engineering solutions into production in agile sprints.

Conocimientos

ETL pipelines

Data modeling

SQL databases

Google Cloud Platform (GCP)

BigQuery

AutoML

Agile/Scrum

Herramientas

PostgreSQL

MySQL

MongoDB

Google Cloud SQL

Google Cloud Storage

Dataproc

Dataflow

BigQuery

Descripción del empleo

Major Accountabilities:

Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process and transform raw data into usable formats for analysis and reporting.

Implement data modeling techniques to optimize data storage and retrieval, ensuring efficient data access and query performance.

Utilize data analytics tools and techniques to extract insights and patterns from large datasets, enabling data-driven decision-making within the organization.

Develop and implement automated machine learning (AutoML) solutions to streamline the process of model development and deployment.

Manage and administer relational and non-relational databases, including PostgreSQL, MySQL, MongoDB, and Google Cloud SQL, ensuring data integrity, security, and availability.

Perform database tuning and optimization to improve query performance and overall system efficiency.

Utilize cloud computing platforms such as Google Cloud Platform (GCP) to deploy and manage data processing and analytics workflows.

Leverage GCP services including Google Cloud Storage, Google Cloud Dataproc, Google Cloud Dataflow, and Google BigQuery for scalable data processing and analysis.

Coordinate and oversee the release of data engineering solutions and pipelines into production environments, ensuring smooth deployment and minimal disruption to operations.

Work in an agile development environment, following agile methodologies such as Scrum or Kanban to iteratively deliver data engineering solutions.

Participate in sprint planning, backlog grooming, and daily stand-up meetings to prioritize tasks and track progress towards project goals.

Privacy Notice - Active Candidates: https://www.aptiv.com/privacy-notice-active-candidates

Aptiv is an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, gender identity, sexual orientation, disability status, protected veteran status or any other characteristic protected by law.