Senior Data Platform Engineer (Python & Databricks)
Codelitt-
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team.
The ideal candidate has substantial Databricks experience and can own well-defined areas while expanding platform knowledge. You will help ensure scalability, reliability, and developer productivity.
Qualifications
- Five or more years of professional software-engineering experience.
- Strong professional experience developing production applications with Python.
- Hands-on experience building production workloads with Databricks.
- Experience designing and maintaining data pipelines.
- Strong understanding of data modeling and data-processing concepts.
- Experience designing or consuming APIs in distributed systems.
- Experience working with relational databases and SQL.
- Strong automated-testing and software-quality practices.
- Experience working with version control, code review, and CI/CD workflows.
- Ability to understand and contribute to an established, complex codebase.
- Strong written and verbal English communication skills.
- Ability to attend the Edinburgh office regularly, typically one to two days per week.
Responsibilities
- Build and maintain components of a large-scale financial data platform.
- Develop reliable data pipelines for ingesting, transforming, and delivering financial data.
- Design data models that support enterprise reporting, analytics, and downstream integrations.
- Improve the performance, reliability, maintainability, and observability of existing data workflows.
- Troubleshoot complex issues across data-processing and application layers.
- Design, build, and maintain production-grade Python applications and services.
- Develop well-structured APIs for accessing and managing data-platform capabilities.
- Write clean, tested, maintainable, and well-documented code.
- Participate in architectural and technical-design discussions.
- Review code and help maintain a high engineering standard across the team.
- Build and operate Databricks workloads, focusing on scalability and reliability.
- Collaborate with hybrid Edinburgh-based engineers and own assigned initiatives.
Skills
Tools
Job description
At Codelitt, we are more than a product-development company. We are creators, innovators, and problem solvers.
We partner with companies around the world to design and build meaningful digital products, modernize complex systems, and solve challenging technical problems. Our globally distributed team values technical excellence, ownership, proactive communication, and collaboration.
We are looking for a Senior Data Platform Engineer to join a high-impact engagement with one of our partners, a global leader in wealth-management technology. This is a hybrid position to work in our office in Edinburgh. Here you'll find our office location. We expect the engineer working in this position to go to the office between 1 to 2 times per week.
You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion, transformation, modeling, and delivery of complex financial data.
This is primarily a backend and data-platform position. You will work across Python services, APIs, data pipelines, and data models while collaborating closely with an established engineering team in Edinburgh.
The ideal candidate has substantial hands-on Databricks experience and can become productive in a complex data environment. You should be comfortable taking ownership of well-defined areas of work while gradually building a broader understanding of the platform. We process our payment in US dollars, however you can receive it in your local currency.
- Build and maintain components of a large-scale financial data platform.
- Develop reliable data pipelines for ingesting, transforming, and delivering financial data.
- Design data models that support enterprise reporting, analytics, and downstream integrations.
- Improve the performance, reliability, maintainability, and observability of existing data workflows.
- Troubleshoot complex issues across data-processing and application layers.
- Design, build, and maintain production-grade applications and services using Python.
- Develop well-structured APIs for accessing and managing data-platform capabilities.
- Write clean, testable, maintainable, and well-documented code.
- Participate in architectural and technical-design discussions.
- Review code and help maintain a high engineering standard across the team.
- Build and operate production workloads using Databricks.
- Help improve the organization and execution of Databricks-based data workflows.
- Work with large datasets and complex transformation requirements.
- Apply Databricks best practices to improve scalability, reliability, and developer productivity.
- Work directly with engineers and technical leaders from both Codelitt and our partner.
- Collaborate with a hybrid engineering team based in Edinburgh.
- Break complex requirements into clear and manageable technical tasks.
- Communicate progress, risks, dependencies, and blockers proactively.
- Take ownership of assigned initiatives from technical discovery through delivery.
- Contribute to documentation and internal knowledge sharing.
- Five or more years of professional software-engineering experience.
- Strong professional experience developing production applications with Python.
- Hands-on experience building production workloads with Databricks.
- Experience designing and maintaining data pipelines.
- Strong understanding of data modeling and data-processing concepts.
- Experience designing or consuming APIs in distributed systems.
- Experience working with relational databases and SQL.
- Strong automated-testing and software-quality practices.
- Experience working with version control, code review, and CI/CD workflows.
- Ability to understand and contribute to an established, complex codebase.
- Strong written and verbal English communication skills.
- Ability to work independently while collaborating closely with a broader engineering team.
- Ability to attend the Edinburgh office regularly, typically one to two days per week.
- Experience building data platforms for financial-services or other data-intensive industries.
- Experience with cloud-based data architectures.
- Familiarity with infrastructure-as-code tools such as Terraform.
- Experience improving the observability and operational reliability of data pipelines.
- Familiarity with modern data governance, access-control, and data-quality practices.
- Experience working in an enterprise environment with strict security and compliance requirements.
- Front-end experience with React or another modern JavaScript framework.
Front-end development and infrastructure work may occasionally be required, but they are not the primary focus of this position. Deep Kubernetes expertise is not required.
You have used Databricks in a real production environment and understand how to build, maintain, and troubleshoot data workloads on the platform.
You can design and implement reliable Python services and APIs, not simply scripts or notebooks.
You understand how data moves through a platform and can reason about ingestion, transformation, modeling, quality, performance, and downstream consumption.
You communicate before a problem becomes a surprise. When blocked, you raise the issue, explain its impact, and help identify a path forward.
You can navigate a mature platform with significant internal context. You know how to ask effective questions, document what you learn, and gradually expand your ownership.
You enjoy working with other engineers, sharing knowledge, reviewing designs, and contributing to a healthy engineering culture.
- Generous paid-time-off policy.
- Paid sick leave.
- Paid parental leave.
- Opportunities to work on challenging products with experienced international teams.
- A collaborative environment that values technical quality and personal ownership.
- Regular team-building activities throughout the year.
Codelitt is a close-knit global team that moves quickly, communicates openly, and enjoys solving difficult problems together.
If you are an experienced Python engineer with strong Databricks knowledge and an interest in building enterprise data platforms, we would love to hear from you.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
