Senior Data Engineer

Intellectsoft; Elche; Presencial; EUR 35.000 - 55.000; Jornada completa

Descripción de la vacante

A leading technology company based in Elche is seeking a talented Data Engineer. In this role, you will design and build scalable data pipelines leveraging PySpark and big data technologies to enhance insights and data usability across industries. Join a dynamic team that promotes innovation and offers generous benefits, including significant absence days and professional development opportunities.

Servicios

35 absence days per year

Udemy courses of your choice

English courses with native-speaker

Excellence Centers meetups

Online / offline team-buildings

Formación

• 5+ years of professional experience, including 2+ in data engineering.
• Proficiency in Python and experience with ETL pipelines.
• Knowledge of big data technologies such as Apache Spark.

Responsabilidades

• Design and build scalable data pipelines using PySpark.
• Collaborate with data science team to enhance model accuracy.
• Troubleshoot existing ETL pipelines and optimize workflows.

Conocimientos

Data Engineering

Apache Spark

SQL

Python

ETL

Data Modeling

Workflow Orchestration

Educación

Bachelor’s or master’s degree in Computer Science

Herramientas

Apache Airflow

AWS

GCP

Azure

Descripción del empleo

Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive growth and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, Qualcomm, and London Stock Exchange.Together, our team delivers solutions that make a difference. Learn more at

The product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions.

Requirements

• 5+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL.
• Proficiency in Python for data processing and automation.
• Knowledge of PySpark, distributed computing, analytical databases and other big data technologies.
• Expertise in designing and managing ETL pipelines and distributed data processing frameworks.
• Strong knowledge of database systems, data modeling, and analytical databases.
• Hands-on experience with workflow orchestration tools such as Apache Airflow.
• Familiarity with cloud platforms like AWS, GCP, or Azure.
• Solid understanding of software development lifecycles, including coding standards, version control, and testing.

Nice to have skills

• Bachelor’s or master’s degree in Computer Science or a related field.
• Familiarity with the data science and machine learning development process.
• Understanding of Machine Learning pipelines or frameworks.

Responsibilities

• Design and build highly reliable and scalable data pipelines using PySpark and big data technologies.
• Collaborate with the data science team to develop new features that enhance model accuracy and performance.
• Create standardized data models to improve consistency across various deployments.
• Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows.
• Conduct POCs to evaluate new technologies and integrate additional data sources.
• Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines.
• Document development updates and maintain clear technical documentation.
• 35 absence days per year for work-life balance
• Udemy courses of your choice
• English courses with native-speaker
• Excellence Сenters meetups
• Online / offline team-buildings

J-18808-Ljbffr