Data Engineering Lead - Open-Source Pipelines, Kubernetes
LA International Computer Consultants Ltd
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Job summary
LA International Computer Consultants Ltd seeks a Data Engineering Lead in London for a 4 days onsite role. You’ll design, build and deliver data products, develop data pipelines, and work with open‑source tech to meet operational needs.
The role emphasizes data cataloguing, CI/CD, containerisation with Kubernetes, and Azure Stack Hub. Security clearance candidates are welcome and may require formal clearance before appointment.
Qualifications
- Proficiency in Python and open‑source data engineering technologies.
- Experience building and maintaining data pipelines and data products.
- Ability to design scalable data solutions using Linux/Unix environments.
- Knowledge of CI/CD practices and containerisation (Kubernetes).
- Exposure to cloud/data tooling such as Azure Stack Hub, OpenSearch, Kafka.
Responsibilities
- Design, build and deliver new data products to meet operational needs.
- Develop, maintain and improve data pipelines.
- Utilise open-source technologies to craft practical data solutions.
- Build solutions from ground up within tight delivery timelines.
- Contribute to data cataloguing and asset organisation.
- Adapt designs as operational priorities shift.
Skills
Tools
Job description
LA International Computer Consultants Ltd seeks a Data Engineering Lead in London for a 4 days onsite role. You’ll design, build and deliver data products, develop data pipelines, and work with open‑source tech to meet operational needs.
The role emphasizes data cataloguing, CI/CD, containerisation with Kubernetes, and Azure Stack Hub. Security clearance candidates are welcome and may require formal clearance before appointment.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
