Senior Data Engineer – Mexico/India (Remote)

Digitalt3; México; Teletrabalho; MXN 1 695 000 - 2 825 000; Tempo integral

Resumo da oferta

Digitalt3 is seeking an experienced Data Engineering Lead for 100% remote work across Mexico, India or Sri Lanka. You will drive architectural design, accelerate ingestion pipelines, and mentor a 5+ member team to deliver scalable, secure data solutions on AWS/Azure.

You will work with Databricks, Cloudera and Snowflake, ensuring data quality, governance and metadata management while collaborating with data scientists and BI teams to enable advanced analytics and reporting.

Qualificações

• Experience analyzing data platform modernization and automation opportunities.
• Led a team of 5+ engineers, handling design reviews and mentoring.
• Hands-on AWS/Azure experience with Databricks, Cloudera, Snowflake.
• Strong SQL and relational data modelling expertise.
• Experience with NoSQL databases.
• Proficient in building data pipelines with Python, Scala, and PySpark.
• Knowledge of data lake/warehouse concepts and modern architectures.
• Experience implementing data quality management.
• Familiar with metadata management and data governance.
• Understanding data security and privacy within data platforms.
• Experience with Git and version control.
• CI/CD processes for data engineering components.
• Strong analytical, problem-solving, and collaboration skills.
• Excellent communication and teamwork.

Responsabilidades

• Lead technical design for data engineering components and accelerators.
• Design scalable, secure data solutions on AWS/Azure with architectures in mind.
• Evaluate and select suitable cloud-native and open-source tools for data components.
• Lead and mentor a team of data engineers through delivery.
• Create data mapping specifications and detailed technical designs.
• Ensure code quality, standards, and continuous improvement.
• Optimize performance, cost and scalability of data solutions.
• Ensure data quality and integrity for downstream systems.
• Plan and manage data engineering projects with timely delivery.
• Identify risks and handle customer escalations.
• Collaborate with stakeholders to align with business requirements.
• Maintain architecture diagrams and data integration documentation.
• Work with BI and data science teams to enable analytics and ML.

Conhecimentos

Data platform modernization

Team leadership

AWS

Azure

SQL

NoSQL

Python

Scala

PySpark

Data lake concepts

Data warehouse concepts

Data quality

Metadata management

Data governance

Git

CI/CD for data

Analytical thinking

Communication

Ferramentas

Databricks

Cloudera

Snowflake

Descrição da oferta de emprego

Location: 100% Remote – Mexico, India or Sri Lanka

Experience: 8+ years of hands‑on experience in delivering data engineering solutions

Required Skills & Qualifications

• Experience in analyzing, identifying automation opportunities in a Data Platform modernization project – including accelerating ingestion frameworks, transformation stage, data quality and metadata.
• Experience leading a team of 5+ team members, responsible for technical solution, design review, code reviews and mentoring
• Strong hands‑on experience in AWS/Azure, with experience in data engineering related services and technologies likeDatabricks / Cloudera / Snowflake (Prior deep experience with Cloudera is an added advantage)
• Expertise in database concepts, SQL and relational modelling
• Good understanding and experience working with NoSQL databases
• Strong hands‑on experience in implementing data pipelines using Python, Scala and PySpark
• Good understanding of data lake and data warehouse concepts, modern data architecture patterns and industry trends in data engineering space
• Good understanding and experience implementing data quality management solutions
• Good understanding of metadata management for data engineering solutions and data platforms
• Good understanding of data governance concepts – including data stewardship, data security and data privacy management
• Experience with version control tools like Git for managing version control for source code
• Experience with DevOps processes, including experience implementing CI/CD pipelines for data engineering solution components
• Strong analytical and problem-solving skills
• Excellent communication and collaboration skills

Responsibilities:

• Lead technical design efforts for data engineering solution components, automation and accelerators
• Design and implement scalable, secure and resilient data engineering solutions on AWS/Azure, with a good understanding of data architecture patterns
• Evaluate and select appropriate technology stack for data engineering solution components – cloud native services, open-source tools, data storage, data processing frameworks etc
• Lead, mentor and manage a team of dynamic data engineers for development, testing and implementation of data pipelines ensuing quality, performance and on‑time delivery
• Responsible for detailed technical design and data mapping specification
• Ensure adherence to industry best practices, coding standards and guidelines driving continuous improvement in code quality and delivery excellence
• Optimize data solutions for performance, cost‑efficiency and scalability
• Ensure data quality and integrity for downstream systems and applications
• Plan, prioritize and manage data engineering projects, ensuring timely delivery with quality
• Identify and mitigate risks, troubleshoot issues, handle customer escalations
• Ensure alignment with business requirements and priorities, working closely with stakeholders – both internal and customer
• Maintain comprehensive technical documentation, including architecture diagrams, high level / low level data integration design, data mapping specifications, database design etc
• Working closely with peers, BI engineers and data scientists to enable advanced analytics, machine learning models and reporting solutions