Data Engineer (Remote)

RemoteStar; Cambridge; Remote; GBP 45,000 - 60,000; Full time

Job summary

A leading company specializing in environmental data is seeking a Data Engineer to manage soil carbon datasets and develop robust data systems. The role involves interaction with cross-functional teams to ensure data accuracy and efficiency in processing agricultural information. The ideal candidate has strong SQL and AWS skills, with experience in building data pipelines and dashboards.

Qualifications

• 5-7 years of experience as a Data Engineer or similar role.
• Strong SQL skills and experience optimizing complex queries.
• Proficiency with relational databases, preferably MySQL.
• Experience with AWS services, especially Glue, S3, RDS.

Responsibilities

• Design, develop, and maintain scalable data pipelines for soil carbon and agricultural data.
• Implement data quality controls and validation processes.
• Adapt existing data flows and schemas to new products and services.

Skills

SQL

AWS

Python

Data Pipeline Development

Database Optimization

Education

BS/B.Tech in Computer Science

Tools

MySQL

Snowflake

Tableau

Looker

Job description

About the role:

As a Data Engineer, you will be instrumental in managing our extensive soil carbon dataset and creating robust data systems. You are expected to be involved in the full project lifecycle, from planning and design, through development, and onto maintenance including pipelines and dashboards. You'll interact with Product Managers, Project Managers, Business Development and Operations teams to understand business demands and translate them into technical solutions. Your goal is to provide an organisation wide source of truth for various downstream activities while also work towards improving and modernising our
current platform.

Key responsibilities:

• Design, develop, and maintain scalable data pipelines to process soil carbon
  and agricultural data
• Create and optimise database schemas and queries
• Implement data quality controls and validation processes
• Adapt existing data flows and schemas to new products and services under
  development

Required qualifications:

• BS/B. Tech in Computer Science or equivalent practical experience, with 5-7
  years as Data Engineer or similar role.
• Strong SQL skills and experience optimizing complex queries
• Proficiency with relational databases, preferably MySQL
• Experience building data pipelines, transformations, and dashboards
• Ability to troubleshoot and fix performance and data issues across the
  database
• Experience with AWS services (especially Glue, S3, RDS)
• Exposure to big data eco-system - Snowflake/Redshift/Tableau/Looker
• Python programming skills
• Excellent written and verbal communication skills in English

An ideal candidate would also have:

• High degree of attention to detail to uncover data discrepancies and fix them
• Familiarity with geospatial data
• Experience with scientific or environmental datasets
• Some understanding of agritech or environmental sustainability sectors