Remote Lead Data Engineer – Contract

Tech Cratic; Austin (TX); Remote; USD 120,000 - 150,000; Full time

Job summary

A leading technology company is seeking a Remote Lead Data Engineer to develop and maintain data pipelines that ensure efficient online education. This role involves collaboration with a remote team to automate business needs, requiring experience in AWS services and strong Python skills.

Qualifications

• Three years experience with AWS including Lambda, S3, RDS.
• Proficient in Python and using SQL to automate data interactions.
• Experience in a collaborative agile remote team.

Responsibilities

• Develop modular data integrations and maintain robust data pipelines.
• Drive data integrations through CI/CD processes.
• Communicate and demo integration solutions to stakeholders.

Skills

AWS cloud services

Python

SQL

APIs

DevOps practices

Communication

Tools

Microsoft Office Suite

Job description

Privacy Overview

Always Active

Duration

11 months

Description

Duration

11 months

Description

cookielawinfo-checkbox-others

Duration

11 months

Description

cookielawinfo-checkbox-necessary

Duration

11 months

Description

Duration

11 months

Description

viewed_cookie_policy

Duration

11 months

Description

Job title: Remote Lead Data Engineer – Contract

Company: Simplex

Job description: This is a 100% Remote position based anywhere in the US and will pay a rate of approximately $60/hr on W2. The project will be an initial 3-month duration with the possibility of extension.The Lead Data Engineer role develops and maintains robust and scalable integrations and data pipelines that connect our core systems and drive critical automation for online K 12 learning and school management. This Lead Data Engineer will be part of a collaborative remote team working closely with other engineers, analysts, architects, and business stakeholders to develop reliable and modular data flows and integrations on an agile cycle that automates core business needs at scale and empowers online education for students across the United States.Key Responsibilities:

• Develop modular data integrations following an event-based architecture, partnering with data analysts and architects to understand and meet development requirements for each use case
• Partner with other engineers and technical leads for collaboration, support, and alignment throughout design/development and to solve development blockers if they arise
• Develop robust unit testing on developed code and drive integration, end-to-end, and performance testing to ensure each data integration is reliable, scalable, and meets business needs before deployment
• Drive developed integrations through a CI/CD process to validate, test, and deploy reliable solutions for production use
• Communicate and demo developed data integration solutions and progress with stakeholders in bi-weekly sprint reviews to drive transparency and collaboration between teams
• Maintain deployed data integrations, monitoring for any issues and resolving them as they arise.

Skills Required:

• Three (3) years of relevant professional experience working with, building, and/or managing AWS cloud services including AWS Lambda , Step Functions , DMS , Kinesis , S3 , RDS , Glue , EC2 , CloudWatch , CloudFormation , or equivalent Azure/GCP services
• Proficiency in Python development.
• Proficiency in using SQL and APIs to automate interactions with various data stores and systems
• Familiarity with pub/sub-event-based architecture and ETL data pipeline patterns
• Demonstrated experience with software development best practices, including developing robust unit, integration, functional, and performance test
• Demonstrated experience following enterprise-grade DevOps practices, including release management, CI/CD pipelines
• Demonstrated success in working with a highly collaborative and agile remote development team
• Excellent verbal and written communication skills
• Proficiency in the Microsoft Office Suite (Excel, Word, PowerPoint, SharePoint)
• Ability to clear required background check

Preferred Qualifications:

• Experience working in industries with rigorous technical environments such as insurance, retail, CPG, high-tech.
• Experience developing pub/sub-event-based architectures, data streaming, data integration, and batch data pipelines
• Experience working with various data storage types including relational databases, object storage, graph databases, data warehouses
• Experience with Snowflake or equivalent data warehousing and services
• AWS or Azure cloud certifications
• Experience in education and/or educational technology industries

Explore career opportunities and trends in the tech industry with Tech Careers. From job tips to industry insights, stay informed about how to advance your tech career. Read the latest articles here at Techcratic.