Senior Data Engineer (Python/AWS)

Instil; Belfast City District; Hybrid; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Annual performance bonus

Flexible working arrangements

Pension scheme

Private healthcare

Life assurance

Employee Assistance Programme

35 days holiday

Job summary

Instil is seeking a Senior Data Engineer to design, build and optimize modern data platforms that empower analytics, AI and data-driven decision making. You will work hands-on on data pipelines, apply strong SQL, Python and Spark skills, and collaborate with cross‑functional teams to deliver production-grade solutions in the cloud.

The role offers flexible hybrid working with base in Northern Ireland, and the opportunity to contribute to data modelling, governance, and scalable data

Qualifications

• 5+ years of experience in Data Engineering or related software engineering role.
• Experience building and maintaining production-grade data pipelines and platforms.
• Strong understanding of data modelling, transformation, cleansing, and preparation.
• Strong SQL skills and commercial experience with Python and/or Spark.
• Experience delivering ETL/ELT solutions in cloud environments.
• Experience with modern data platforms such as Databricks, Snowflake, or Microsoft Fabric.
• Familiarity with cloud data services (AWS, Azure, or GCP).
• Experience with JSON and Parquet data formats.
• Strong problem-solving, communication, and stakeholder collaboration skills.

Responsibilities

• Design, build and improve data pipelines that enable analytics, AI and data-driven decision making.
• Hands-on work with Databricks, Snowflake, Fabric or similar technologies.
• Collaborate with stakeholders to understand data needs and ensure data quality and governance.

Job description

Senior Data Engineer

We're looking for a Senior Data Engineer with strong commercial experience building and supporting modern data platforms. You'll work hands‑on designing, building, and improving data pipelines that enable analytics, AI, and data‑driven decision making.

Essential Skills

• 5+ years' experience in Data Engineering or a related software engineering role.
• Experience building and maintaining production‑grade data pipelines and platforms.
• Strong understanding of data modelling, transformation, cleansing, and preparation.
• Strong SQL skills and commercial experience with Python and/or Spark.
• Experience designing and delivering ETL/ELT solutions in cloud environments.
• Experience with modern data platforms such as Databricks, Snowflake, or Microsoft Fabric.
• Familiarity with cloud data services (AWS, Azure, or GCP).
• Experience working with structured and semi-structured data (e.g. JSON, Parquet).
• Strong problem‑solving, communication, and stakeholder collaboration skills.

Desirable Skills

• Experience with data engineering tools such as AWS Glue, Azure Data Factory, Apache Beam, or dbt.
• Exposure to data governance and cataloguing tools such as Purview, Collibra, or Unity Catalog.
• Experience with CI/CD, orchestration, and data quality practices.
• Knowledge of analytics, reporting, or AI/ML use cases.
• Experience working in agile, delivery‑focused teams.

Typical Experience

• Building scalable data pipelines and data platforms.
• Data modelling, transformation, and preparation.
• Working with Databricks, Snowflake, Fabric, or similar technologies.
• Implementing ETL/ELT processes and data integration solutions.
• Applying data governance, lineage, and security best practices.
• Developing solutions using Python, Spark, and SQL.

Please note:

We offer flexible hybrid working, but candidates should be based in Northern Ireland and able to attend our Belfast office when required.

Why Join Instil?

At Instil, we believe great work starts with happy, motivated people. That’s why we’ve built a benefits package that supports your wellbeing, growth, and life outside of work, because when you thrive, so do we.

• Recognition That Matters: A discretionary annual performance bonus that rewards your impact and contribution to our success.
• Flexibility Built In: Flexible working arrangements and summer hours, because life isn’t 9 to 5, and balance matters.
• Financial Security: A highly competitive pension scheme with generous employer contributions, private healthcare, and life assurance for peace of mind.
• Health & Wellbeing: Employee Assistance Programme, mental health support, cycle‑to‑work scheme, and regular social events to keep our culture vibrant.
• Time to Recharge: 35 days holiday, enhanced maternity pay, and family‑first policies so you can focus on what matters most.
• Learning Never Stops: From courses to certifications, we’ll invest in your development so you can keep growing and shaping what’s next.
• Community & Culture: Opportunities to volunteer, give back, and be part of initiatives that make Instil a truly inclusive and connected workplace.

Company Description

Instil has been delivering world‑class software engineering and technology solutions for over 20 years, trusted by global brands to solve complex challenges and drive innovation. From modernising legacy systems to building cutting‑edge applications, we help our clients navigate an ever‑changing digital landscape with confidence and agility.

We’re proud to be an award‑winning employer, reflecting how our people are at the heart of everything we do:

• Recognised as a Great Place to Work® for three consecutive years, and in 2024 ranked in the Top 20 Best Workplaces in the UK for medium‑sized companies.
• Winner of Company of the Year at the Digital DNA Awards 2022, celebrating excellence in Northern Ireland’s tech sector.

Driven by a love for technology and a commitment to excellence, we bring together people who want to make a difference. We’ll support your journey, because your success is part of ours.