Data Engineer (Remote)

Remotestar; Cambourne; Remote; GBP 45,000 - 70,000; Full time

Job summary

A leading company is seeking a Data Engineer to manage a comprehensive soil carbon dataset and develop data systems. You'll be involved in the complete project lifecycle, collaborating with various teams to enhance the platform and provide reliable data for business operations.

Qualifications

• 5-7 years as Data Engineer or similar role.
• Experience with AWS services, especially Glue, S3, RDS.
• Proficient in relational databases.

Responsibilities

• Design, develop, and maintain scalable data pipelines for soil carbon and agricultural data.
• Create and optimize database schemas and queries.
• Implement data quality controls and validation processes.

Skills

SQL

Data pipeline building

Data transformations

Database optimization

Python programming

Data quality control

Communication

Education

BS/B. Tech in Computer Science

Tools

AWS

MySQL

Snowflake/Redshift/Tableau/Looker

Job description

About the role:

As a Data Engineer, you will be instrumental in managing our extensive soil carbon dataset and creating robust data systems. You are expected to be involved in the full project lifecycle, from planning and design, through development, and onto maintenance including pipelines and dashboards. You’ll interact with Product Managers, Project Managers, Business Development and Operations teams to understand business demands and translate them into technical solutions. Your goal is to provide an organisation wide source of truth for various downstream activities while also work towards improving and modernising our
current platform.

Key responsibilities:

• Design, develop, and maintain scalable data pipelines to process soil carbon
  and agricultural data
• Create and optimise database schemas and queries
• Implement data quality controls and validation processes
• Adapt existing data flows and schemas to new products and services under
  development

Required qualifications:

• BS/B. Tech in Computer Science or equivalent practical experience, with 5-7
  years as Data Engineer or similar role.
• Strong SQL skills and experience optimizing complex queries
• Proficiency with relational databases, preferably MySQL
• Experience building data pipelines, transformations, and dashboards
• Ability to troubleshoot and fix performance and data issues across the
  database
• Experience with AWS services (especially Glue, S3, RDS)
• Exposure to big data eco-system – Snowflake/Redshift/Tableau/Looker
• Python programming skills
• Excellent written and verbal communication skills in English

An ideal candidate would also have:

• High degree of attention to detail to uncover data discrepancies and fix them
• Familiarity with geospatial data
• Experience with scientific or environmental datasets
• Some understanding of agritech or environmental sustainability sectors