Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them understand the potential that data brings to solve their most pressing problems. On projects, they lead the design of technical solutions or oversee program inception to build new products. Alongside hands-on coding, they guide the team in implementing solutions.
Job responsibilities
- Lead and manage data engineering projects from inception to completion, including goal-setting, scope definition, and ensuring on-time delivery with cross-team collaboration.
- Collaborate with stakeholders to understand strategic objectives and identify opportunities to leverage data and improve data quality.
- Design, develop, and operate modern data architecture approaches to meet business objectives and deliver end-to-end data solutions.
- Create, design, and develop intricate data processing pipelines to address challenging client problems.
- Collaborate with data scientists to design scalable implementations of their models.
- Write clean, iterative code based on TDD and leverage continuous delivery practices to deploy, support, and operate data pipelines.
- Advise clients on using distributed storage and computing technologies from available options.
- Develop data models by selecting appropriate modeling techniques and implementing them using suitable technology stacks.
- Ensure data governance, security, and privacy to support business and compliance needs.
- Incorporate data quality strategies into daily work routines.
Job qualifications
Technical Skills
- Experience in leading system design and implementation of technical solutions.
- Experience with Big Data architecture, building and operating data pipelines, and maintaining data storage within distributed systems.
- Deep understanding of data modeling and familiarity with modern data engineering tools and platforms.
- Proficiency in writing clean, high-quality code in preferred programming languages.
- Experience deploying large-scale data pipelines and data-centric applications using distributed storage and processing platforms in production.
- Knowledge of data visualization techniques and ability to communicate insights effectively.
- Experience applying data security and privacy strategies to solve business problems.
- Familiarity with various database types (SQL, NoSQL, data lakes, schemas, etc.).
Professional Skills
- Stakeholder management skills to liaise effectively between clients and project teams, ensuring buy-in and trust.
- Resilience and adaptability in ambiguous situations and challenges.
- Willingness to manage risks and conflicts skillfully.
- Ability to coach, mentor, motivate, and influence team members towards professional growth and accountability.
- Advocate for technical excellence and openness to change.
- Proven leadership with a track record of fostering team development and building strong partnerships.
Other things to know
Learning & Development
Thoughtworks offers a flexible career path supported by interactive tools, development programs, and a culture of mutual growth. We value helping each other excel and empower employees in their career journeys.
About Thoughtworks
Thoughtworks is a global technology consultancy integrating strategy, design, and engineering to drive digital innovation. For over 30 years, our autonomous teams have built solutions that go beyond the obvious. Our diverse team includes computer science graduates, seasoned technologists, self-taught developers, and career changers, all learning and challenging each other. Our cultivation culture has earned numerous awards worldwide. Join us and thrive, as our curiosity, innovation, passion, and dedication overcome the ordinary.