Data Engineer Manager

10X Recruiting Partners; Raleigh (NC); On-site; USD 120,000 - 170,000; Full time

Job summary

10X Business Consulting is seeking a Data Engineer Manager to lead design and development of scalable data solutions in the cloud. This fully remote role requires strong expertise in Python and data architecture.

You will collaborate across business units and engineering to build a long-term data platform strategy, develop high-performance pipelines, and ensure data quality and reliability.

Qualifications

• Master’s degree in Computer Science, Computer Engineering, or related discipline.
• 5+ years of expertise in Python.
• Advanced knowledge of RDBMS Systems, SQL and query optimization techniques.

Responsibilities

• Design and develop scalable data solutions on cloud.
• Deliver projects and customer success by meeting deadlines.
• Perform data analysis to troubleshoot data issues.
• Design data integrations and data quality framework.
• Collaborate with business units and engineering on long-term data platform architecture.
• Develop high performance data pipelines to support complex data integration.
• Write well designed, testable, and efficient code.
• Document customer requirements as needed.
• Create solution documentation.

Skills

Python

Data structures

SQL

RDBMS

Education

Master’s degree in Computer Science/Engineering

Tools

Airflow

Spark

Azure

AWS

GCP

Job description

10X Business Consulting

1OX Recruiting Partners has a refreshing approach to recruiting. Our purpose and passion is to Connect Relationships and Elevate Careers and Lives. We are a group of experienced professionals from a wide variety of backgrounds specializing in different industries and geographies which gives us a unique ability to be successful in nearly any niche of recruiting.

Company

10X Business Consulting

1OX Recruiting Partners has a refreshing approach to recruiting. Our purpose and passion is to Connect Relationships and Elevate Careers and Lives. We are a group of experienced professionals from a wide variety of backgrounds specializing in different industries and geographies which gives us a unique ability to be successful in nearly any niche of recruiting.

http://10xbc.com/

Job Details

Data Engineer Manager – Job Description

• Fully Remote
• Must be a US Citizen or a Green Card Holder

The Work you’ll do as a Data Engineer Manager

• Design and develop scalable solutions to store and retrieve high volume of data on cloud.
• Deliver project and customer success by meeting deadlines, managing expectations and by delivering good quality solutions.
• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Design data integrations and data quality framework.
• Work closely with all business units and engineering team to develop strategy for long term data platform architecture.
• Develop high performance data pipelines to support complex data integration
• Develop automation programs, shell scripts and other utilities.
• Write well designed, testable, and efficient code.
• Support process flow analysis and ETL process redesign
• Document customer requirements as needed.
• Create solution documentation.

Here’s What You Need

• Master’s degree in Computer Science, Computer Engineering, or related discipline
• 5+ years of expertise in Python
• Experience in working with Data Structure
• Advanced knowledge of RDBMS Systems, SQL and query optimization techniques

Bonus Points If You Have

• Experience with data orchestration tools like Airflow.
• Experience with big data technology Apache Spark
• Should have experience/exposure to technical design and architecture for any big data projects.
• Experience working with one or more of the major cloud platforms - Azure/AWS/GCP
• Hands on experience on Big Data tools and design and develop data pipeline on any Cloud Platform.
• Experience of developing data pipelines using tools such as Spark, Python, AWS Glue, Azure Data Factory
• Hands‑on experience in Dataflow, Apache Beam, Spark, Hadoop, Kafka, BigQuery, Data Catalog, Airflow etc.
• Familiarity with event‑driven programming
• Strong unit test and debugging
• Proficient understanding of GitHub, JIRA
• Dynamic and demonstrates a very positive attitude
• Excellent Analytical and Communication Skills
• Must be familiar with Agile development methodology

Travel

For now, all "Company" business travel, international and domestic, is currently restricted to client-essential sales/delivery activity only.