Data Engineer (Remote)

Remotestar; Snowflake (AZ); Remote; USD 90,000 - 130,000; Full time

Job summary

A leading company is looking for a Data Engineer to manage extensive soil carbon datasets and develop robust data systems. You will handle the full project lifecycle, engaging with various teams to deliver technical solutions that serve as an organization-wide source of truth. Ideal candidates will have substantial experience in data engineering, strong SQL skills, and proficiency in AWS and relational databases.

Qualifications

• 5-7 years experience as a Data Engineer or similar role.
• Proficiency with relational databases and experience with AWS services.
• Ability to troubleshoot data issues.

Responsibilities

• Design and maintain scalable data pipelines for soil carbon data.
• Create and optimize database schemas and queries.
• Implement data quality controls and validation processes.

Skills

SQL

Data pipeline management

Data quality control

Python programming

Communication skills

Education

BS/B. Tech in Computer Science

Tools

MySQL

AWS

Tableau

Looker

Job description

About the role:

As a Data Engineer, you will be instrumental in managing our extensive soil carbon dataset and creating robust data systems. You are expected to be involved in the full project lifecycle, from planning and design, through development, and onto maintenance including pipelines and dashboards. You’ll interact with Product Managers, Project Managers, Business Development and Operations teams to understand business demands and translate them into technical solutions. Your goal is to provide an organisation wide source of truth for various downstream activities while also work towards improving and modernising our
current platform.

Key responsibilities:

• Design, develop, and maintain scalable data pipelines to process soil carbon
  and agricultural data
• Create and optimise database schemas and queries
• Implement data quality controls and validation processes
• Adapt existing data flows and schemas to new products and services under
  development

Required qualifications:

• BS/B. Tech in Computer Science or equivalent practical experience, with 5-7
  years as Data Engineer or similar role.
• Strong SQL skills and experience optimizing complex queries
• Proficiency with relational databases, preferably MySQL
• Experience building data pipelines, transformations, and dashboards
• Ability to troubleshoot and fix performance and data issues across the
  database
• Experience with AWS services (especially Glue, S3, RDS)
• Exposure to big data eco-system – Snowflake/Redshift/Tableau/Looker
• Python programming skills
• Excellent written and verbal communication skills in English

An ideal candidate would also have:

• High degree of attention to detail to uncover data discrepancies and fix them
• Familiarity with geospatial data
• Experience with scientific or environmental datasets
• Some understanding of agritech or environmental sustainability sectors