Data Engineer - MX Auto

Chubb; San Pedro Garza García; Presencial; MXN 600,000 - 800,000; Jornada completa

Descripción de la vacante

A global insurance company is seeking an experienced Data Engineer to join their dynamic team in San Pedro Garza García, Nuevo León. The role requires expertise in ETL processes, data modeling, and proficiency in SQL and Python. You will collaborate with Data Scientists and Software Engineers to enhance data infrastructure and provide impactful data solutions. A strong background in Databricks and cloud technologies is essential. We offer a competitive salary and growth opportunities.

Formación

• Proven work experience as a Data Engineer or similar role.
• Strong knowledge of ETL processes and data warehousing concepts.
• Hands-on experience with Databricks for data engineering.

Responsabilidades

• Develop and maintain ETL processes for data tasks.
• Design and optimize data models for business needs.
• Collaborate with cross-functional teams for data solutions.

Conocimientos

ETL processes

Data modeling

SQL

Python

Azure Data Factory

Databricks

Data analysis

Problem-solving

Communication

Educación

Bachelor’s or Master’s degree in Computer Science or related field

Herramientas

PostgreSQL

MySQL

Hadoop

Spark

Descripción del empleo

Job Description:

We are seeking an experienced Data Engineer with expertise in ETLs (Extract, Transform, Load), Data Modeling, and Databricks to join our dynamic team. The ideal candidate must possess excellent knowledge and skills in SQL and Python, as they will play a crucial role in managing, optimizing, and enhancing our data infrastructure.

Responsibilities:

• Develop and maintain robust, efficient, and scalable ETL processes for data extraction, transformation, and loading tasks.

• Design, implement, and optimize data models to meet business requirements and ensure data integrity and accuracy.

• Collaborate with cross-functional teams, including Data Scientists, Software Engineers, and Business Analysts, to understand data needs and provide data-related solutions.

• Perform data analysis to identify and resolve data quality issues, inconsistencies, and performance bottlenecks.

• Build and maintain the data pipeline architecture to enable data ingestion from various sources into the data warehouse or data lake.

• Work closely with stakeholders to understand business objectives, identify data-related opportunities, and provide actionable insights.

• Develop and maintain documentation related to data processes, data models, and system architecture.

• Collaborate with the Data Governance team to ensure compliance with data privacy regulations and implement appropriate security measures.

Skills and Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.

• Proven work experience as a Data Engineer or in a similar role.

• Strong knowledge and experience with ETL processes, data modeling, and data warehousing concepts.

• Proficient in SQL, with the ability to write complex queries and optimize their performance.

• Expertise in Python programming language and its associated data libraries (e.g., Pandas, NumPy) for data manipulation and analysis.

• In-depth understanding of relational database systems (e.g., PostgreSQL, MySQL) and experience in query optimization techniques.

• Familiarity with cloud platform Azure and experience with its data services (e.g., Azure Data Factory).

• Experience with big data technologies (e.g., Hadoop, Spark) and distributed computing frameworks.

• Hands-on experience with Databricks for data engineering, including building and managing data pipelines, and optimizing data processing workflows.

• Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve data-related issues.

• Excellent communication skills and the ability to effectively collaborate with cross-functional teams.

• Knowledge of data governance and data security principles.

• Attention to detail and ability to adhere to project timelines and deadlines.