Data Engineer - Python, Pandas & NumPy (ETL/Production)

HCLTech; España; Presencial; EUR 45.000 - 75.000; Jornada completa

Descripción de la vacante

HCLTech in Spain is seeking a Data Engineer to strengthen our brand and deliver enterprise-grade data solutions. You will develop Python-based data processing pipelines, leverage Pandas and NumPy, and collaborate with cross-functional teams in a fast-paced, production-oriented environment.

The role focuses on data ingestion, cleansing, transformation, validation, and deployment through CI/CD pipelines and DevOps practices.

Formación

• Experience building enterprise-grade Python solutions using Pandas and NumPy.
• Proven data engineering background in ingestion, preprocessing, cleansing, transformation, validation, and enrichment.
• Design and implement scalable ETL/ELT pipelines.
• Develop reusable frameworks for large-scale data processing.
• Optimize pipelines for performance, reliability, and efficiency.
• Apply software engineering best practices: clean code, modular design, testing, code reviews.
• Experience with large, complex production datasets.
• Ability to deploy analytics prototypes to production-ready solutions.
• Strong DevOps knowledge and SDLC.
• Define and maintain CI/CD pipelines for automated build/test/deploy/release.
• Create and manage Python deployment artifacts, packages, libraries.
• Implement monitoring, logging, alerting, and observability for production.
• Support and troubleshoot production applications.
• Familiar with cloud platforms (Azure and others).
• Strong stakeholder management and collaboration with multidisciplinary teams.
• Focus on scalability, robustness, security, and operational excellence.
• Proven end-to-end ownership from development to deployment and support.

Responsabilidades

• Develop enterprise-grade Python solutions with Pandas and NumPy.
• Build and maintain scalable ETL/ELT pipelines.
• Create reusable frameworks for large-scale data processing.
• Optimize data pipelines for performance and reliability.
• Apply DevOps practices across the lifecycle.
• Implement CI/CD pipelines for automated deployment.
• Monitor and troubleshoot production data services.
• Collaborate with multidisciplinary teams and stakeholders.

Conocimientos

Python

Pandas

NumPy

Data engineering

ETL/ELT pipelines

CI/CD

DevOps

Production systems

Data ingestion

Data transformation

Monitoring & observability

Cloud platforms (Azure)

Herramientas

Azure

Descripción del empleo

HCLTech in Spain is seeking a Data Engineer to strengthen our brand and deliver enterprise-grade data solutions. You will develop Python-based data processing pipelines, leverage Pandas and NumPy, and collaborate with cross-functional teams in a fast-paced, production-oriented environment.

The role focuses on data ingestion, cleansing, transformation, validation, and deployment through CI/CD pipelines and DevOps practices.