Ynj159 Lead Data Engineer

Referrals Only; Madrid; A distancia; EUR 40.000 - 70.000; Jornada completa

Descripción de la vacante

A global technology consultancy is seeking a Data Engineer to develop modern data architecture and implement end-to-end data solutions. The role involves working directly with clients to understand their data needs, designing scalable systems, and ensuring effective collaboration among teams. Experience with Kafka, Spark, and cloud environments is preferred. This position allows for full-time remote work within Spain.

Servicios

Full-time remote policy

Career development tools and programs

Supportive office presence in Barcelona and Madrid

Formación

• Comfortable coding and leading solution implementation.
• Proven expertise in Data Engineering.
• Excited about data infrastructure and distributed systems.

Responsabilidades

• Spend time with clients on technical reviews.
• Create complex data processing pipelines.
• Design scalable model implementations.

Conocimientos

Data modeling

Kafka

Spark

Hadoop

AWS EMR

Azure HDInsights

Distributed systems

Herramientas

MapR

Cloudera

Hortonworks

Descripción del empleo

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them understand the potential that data brings to solve their most pressing problems. On other projects, you might act as the architect, leading the design of technical solutions, or oversee a program to build a new product. It could also involve software delivery where you're coding and leading the team to implement solutions.Job responsibilitiesSpend time with clients on technical and organizational reviews to understand data potentials.Partner with teammates to create complex data processing pipelines.Collaborate with Data Scientists to design scalable model implementations.Write clean, iterative code based on TDD principles.Use continuous delivery practices to deploy and support data pipelines.Advise clients on distributed storage and computing technologies.Develop and operate data architecture to meet business objectives.Create data models and discuss tradeoffs of different approaches.Lead technical solution design or oversee new product development.Incorporate data quality into daily work and delivery processes.Ensure effective collaboration and open communication between teams.Job qualifications Technical skillsComfortable coding and leading solution implementation.Proven expertise and innovation in Data Engineering.Deep understanding of data modeling and tools like Kafka, Spark, Hadoop.Experience with MapR, Cloudera, Hortonworks, or cloud Hadoop distributions.Familiarity with cloud environments such as AWS EMR, Azure HDInsights, Qubole.Excited about data infrastructure, pipelines, and distributed systems.Professional skillsAdvocate for data engineering in the tech community, mentoring others.Resilient, flexible, and problem-solver in ambiguous situations.Interested in coaching and sharing knowledge.Influence others and promote technical excellence.Additional informationThoughtworks supports your career development with various tools and programs. The company offers a full-time remote policy for Spain, with offices in Barcelona and Madrid available for support. As the COVID-19 situation evolves, offices will reopen fully. Contact your recruiter for any concerns.About ThoughtworksThoughtworks is a global technology consultancy focused on strategy, design, and engineering to drive digital innovation. With over 25 years of impact, we help clients solve complex business problems through technology, fostering collaborative and inclusive teams.J-18808-Ljbffr

J-18808-Ljbffr