Python jobs in United Kingdom
Data Engineer - Brook Green Supply
CFP Energy (UK) Ltd
Discover more opportunities than anywhere else. Find more jobs nowBackend Django Developer — EdTech Crowdfunding
Djangojobs
Senior Cash Equities CRB Trader — VP/ED
JPMorgan Chase & Co.
Connect with headhunters to apply for similar jobsGlobal Equities - Cash Equities CRB Trader - Vice President or Executive Director
JPMorgan Chase & Co.
Bioinformatics Scientist: 3D Genomics for Drug Discovery
Enhanced Genomics
Forensic Analytics Director — Lead Investigations & Insights
Teneo
Doctoral (PhD) position in “Life-cycle sustainability assessment of alternative feeds in Europe[...]
University of Reading
Senior Quantitative Risk Manager – Model Risk & Validation
Intercontinental Exchange (ICE)
Senior Manager, Risk Management
Intercontinental Exchange (ICE)
Crypto Quant Trader - Arbitrage & Market Making Expert
GOLDDEN VALLEY CAPITAL MANAGEMENT PTE. LTD.
Crypto Quant Trader (Arbitrage & Market Making)
GOLDDEN VALLEY CAPITAL MANAGEMENT PTE. LTD.
Data Engineer
Job summary
A leading energy supply company in Greater London is seeking a Data Engineer to join their growing data engineering team. You will be responsible for designing and maintaining robust data ingestion pipelines using open-source technologies. The ideal candidate should possess strong SQL and Python skills, a passion for problem-solving, and experience in agile environments. This role offers the opportunity to contribute significantly to the company's data-driven initiatives within a collaborative and innovative team.
Qualifications
- Proven track record of building and maintaining data ingestion pipelines.
- Experience with complex SQL query optimization.
- Knowledge of distributed computing and big data technologies.
Responsibilities
- Design, develop, and maintain data ingestion pipelines.
- Build and optimise ETL/ELT processes.
- Collaborate with stakeholders to understand data requirements.
Skills
Education
Tools
Brook Green Supply is an independent B2B energy supply company. You will be joining a highly experienced team at the forefront of the UK energy market, providing a fantastic opportunity for a driven and commercially minded individual to make a meaningful contribution to the growth and evolution of our trading desk.
We are seeking a Data Engineer to join our growing data engineering team. This role is perfect for someone passionate about building robust, scalable data infrastructure using open-source technologies. You'll work in an environment that values innovation, technical excellence, and collaborative problem-solving.
- Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools
- Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements
- Develop data models and schemas that support analytics, business intelligence and product needs
- Monitor, troubleshoot, and optimise data pipeline performance and reliability
- Collaborate with stakeholders, analysts and product team to understand data requirements
- Implement data quality checks and validation processes to ensure data integrity
- Participate in architecture decisions and contribute to technical roadmap planning
- Strong analytical mindset with attention to detail
- Excellent problem-solving and debugging skills
- Ability to work independently and manage priorities
- Strong communication skills and ability to explain technical concepts to non-technical stakeholders
- Experience working in agile development environments
- Passion for continuous learning and staying current with emerging technologies
- Great SQL skills with experience in complex query optimization
- Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark)
- Hands-on experience building and maintaining data ingestion pipelines
- Proven track record of optimising queries, code, and system performance
- Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow)
- Knowledge of distributed computing concepts and big data technologies
- Experience with version control systems (Git) and CI/CD practices
- Experience with relational databases (PostgreSQL, MySQL or similar)
- Experience with containerization technologies (Docker, Kubernetes)
- Experience with data orchestration tools (Apache Airflow or Dagster)
- Understanding of data warehousing concepts and dimensional modelling
- Understanding of cloud platforms using infrastructure-as-code (IaC) approaches
- Knowledge of streaming data processing and real-time analytics
- Experience with data quality and monitoring tools
- Bachelor's degree in Computer Science, Engineering, Mathematics, or related field
- 2-5 years of experience in data engineering or related roles
- Experience working in the Energy industry
The CFP Energy Group is committed to ensuring equal opportunities, fairness of treatment, dignity and respect, and the elimination of all forms of discrimination in the workplace for all employees/contractors and job applicants.
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.