Data Engineer

Chubb; San Pedro Garza García; Presencial; USD 60,000 - 90,000; Jornada completa

Descripción de la vacante

A leading company in the insurance industry is seeking a Data Engineer. The role involves designing and implementing data pipelines using Python and Databricks while collaborating with data scientists to meet various business data needs. Ideal candidates will have proven experience in data manipulation and cloud platforms.

Formación

• Proven experience in Python and data manipulation.
• Mid-level knowledge of Databricks and cloud platforms required.
• Experience with SQL and understanding of data warehousing concepts.

Responsabilidades

• Design, develop, and implement ETL processes using Python and Databricks.
• Collaborate with data scientists to meet business data needs.
• Optimize workflows for performance and troubleshoot issues.

Conocimientos

Python programming

Data manipulation

Databricks

SQL

Collaboration

Problem-solving

Cloud platforms

Agile methodologies

Herramientas

IICS

AWS

Azure

GCP

Descripción del empleo

Key Responsibilities:

• Design, develop, and implement data pipelines and ETL processes using Python and Databricks and/or IICS(Informatica).
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business needs.
• Optimize existing data workflows for performance and scalability.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution.
• Document data processes, workflows, and technical specifications.
• Stay updated with the latest industry trends and technologies related to data engineering and cloud services.

Qualifications

Qualifications:

• Proven experience in Python programming and data manipulation.
• Mid-level knowledge of Databricks and its ecosystem (Spark, Delta Lake, etc.).
• Experience with IICS or similar cloud-based data integration tools.
• Familiarity with SQL and database management systems (e.g., PostgreSQL, MySQL, etc.).
• Understanding of data warehousing concepts and best practices.
• Mid-level problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• Experience with cloud platforms (e.g., AWS, Azure, GCP).
• Familiarity with Agile development methodologies