Lead Data Engineer - Python, SQL - Team Lead - Vice President

Aumni; Greater London; On-site; GBP 60,000 - 80,000; Full time

Job summary

TwinThread is seeking a Lead Data Engineer to play a crucial role in an agile team focused on delivering innovative technology solutions. You will lead a squad of data engineers, enhancing data lifecycle processes, and ensuring robust, scalable solutions leveraging AWS, SQL, and modern software architecture.

Ideal candidates will possess formal software engineering training, at least three years of experience, and a strong desire to coach others. Join TwinThread to contribute to critical data architectures and pipelines while fostering a collaborative team environment!

Qualifications

• 3 years of applied experience in software engineering concepts.
• Advanced knowledge of SQL, including joins and aggregations.
• Significant experience with statistical data analysis.

Responsibilities

• Lead a Squad of Data Engineers to meet business deliveries.
• Structure software for ease of understanding and evolution.
• Own and deliver end-to-end, scalable solutions.

Skills

AWS

Databricks

Python

SQL

NoSQL databases

Statistical data analysis

CI/CD platforms

GitHub

Education

Formal training or certification on software engineering

Tools

Circle CI

Jenkins

Aurora Postgres

MongoDB

Job description

Be an integral part of an agile team that's constantly pushing the envelope to innovate, build, enhance and deliver top-notch technology products.

As a Lead Data Engineer at JPMorgan Chase within the GIB and a part of the Capital Markets Team you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.

Job responsibilities

• Lead a Squad of Data Engineers to meet business deliveries working with Product and Design leads.
• Lead Agile ceremonies including standups, retros and technical refinements.
• Self-starter able to take the initiative and shape their own path and a pragmatic and iterative approach to achieving our long-term goals.
• Accelerate team velocity to improve time to market for business solutions.
• Provide frequent updates to senior stakeholders on progress of business deliveries.
• Use domain modelling techniques to allow us to build best in class business products.
• Structure software so that it is easy to understand, test and evolve.
• Promptly investigate and fix issues and ensure they do not resurface in the future.
• Own and deliver end-to-end, scalable, and secure solutions in the form of cloud-native microservice architecture applications, leveraging modern technologies and the best industry practices.
• Investigate and fix issues promptly and ensure they do not resurface in the future.
• Make sure our releases happen with zero downtime for our end-users.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3 years applied experience.
• Good working knowledge of AWS, Databricks, and Python.
• Experience across the data lifecycle.
• Advanced at SQL, including joins and aggregations.
• Working understanding of NoSQL databases.
• Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns for analysis.
• Knowledge of modern software architecture patterns.
• Experience with a modern CI/CD platforms such Circle Ci/Jenkins.
• Experience with modern version control platform such as GitHub/Bitbucket.
• A desire to teach others and share knowledge. A team player mindset where you want you to coach other team members on coding practices, design principles, and implementation patterns.
• Adjusts quickly to changing priorities and conditions. Copes effectively with complexity and change. Learns technologies and patterns quickly. Comfortable in uncharted waters.

Preferred qualifications, capabilities, and skills

• Familiarity with the Standardized data layer practises (Medallion architecture).
• Exposure to Aurora Postgres and MongoDB.
• Skills in designing efficient data models including normalization, denormalization, and schema design and an understanding around relational and star schemas.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs.

Visit our FAQs for more information about requesting an accommodation.

Maintain critical data pipelines and architectures across multiple technical areas as an integral part of an agile team.