Data Engineer Lead

Quantum Technologies. LLC

Lansing (MI)

On-site

USD 85,000 - 116,000

Full time

12 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Lansing, MI seeks a Data Engineer Lead to architect and deliver data/ML solutions in an agile DevOps environment. You will lead data modeling, Lakehouse architectures, and end-to-end data products, collaborating with data scientists and business stakeholders.

Responsibilities include designing data pipelines, optimizing storage and orchestration, ensuring data quality and security, mentoring engineers, and guiding adoption of best practices across the enterprise.

Qualifications

  • Hands-on experience hydrating an enterprise Data Lake on a CSP (AWS/Azure/Google) from relational, semi-structured and unstructured sources via ETL pipelines.
  • Transforming datasets in a Data Lake to deliver Data Products with traceability to Critical Data Elements.
  • Enforcing Data Sharing Policies so users see only authorized data versions at subscription time.

Responsibilities

  • Oversee data modeling, Lakehouse, and ML product delivery in an agile DevOps framework.
  • Lead the design, development, and maintenance of data pipelines for analytics and operational systems.
  • Architect and optimize data infrastructure, storage, orchestration, and ETL/ELT processes.
  • Ensure data quality, reliability, and security with standards, monitoring, and governance practices.
  • Mentor data engineering staff and review designs and code.
  • Collaborate with data scientists, analysts, product teams, and stakeholders to meet organizational goals.

Skills

Data Lakes
ETL Pipelines
Data Governance

Education

BS in CS / Data Science

Tools

Spark
Kafka
Kubernetes
SageMaker
DBT
Juniper Notebooks
Docker
SQL
Power BI
Tableau

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Data Engineer Lead
Location: Lansing, MI
Duration: 18 Months + Extension
Bill Rate: $73/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description:
  • Data Engineering Lead excels in data modeling, Lakehouse and Medallion Architecture concepts, and data/ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including Spark, Kafka, Kubernetes, SageMaker, DBT, Juniper Notebooks, Docker, SQL, and visualization tools such as Power BI/Tableau with the following track record:
Required Skills:
  • Hand-on experience is required in hydrating the enterprise Data Lake on a Cloud Service Provider (AWS, Azure, or Google) from relational, semi-structured and unstructured data sources by building Extract and Load Data Pipelines.
  • Hands-on experience is required in Transforming the datasets in a Data Lake on a Cloud Service Provider to deliver Data Products with traceability of their attributes / features to the Critical Data Elements in the systems of record.
  • Experience is required in enforcing Data Sharing Policies to Data Products to ensure that User get to see only the version of the Data Product the User is entitled to get access to at the time of subscription.
Preferred Skills:
  • Proficiency desirable in DevOps tools including Github/Jenkins/Terraform/YAML/DAGs/Docker/Databricks/SageMaker etc. for building Data/ML pipelines to extract/store data from multiple sources to parquet destinations.
  • Experience desirable in promoting Data Engineering Standards and Best Practices among the community of developers to influence the enterprise towards building scalable and supportable Data/ML Products delivery and their usage by the community of data, analytics, and ML product users.
  • Experience desirable in implementing Data Governance and Data Security tools available on a CSP to automate the enforcement of Data Sharing Policies at the point of subscription of a Data Product by a subscriber.
Roles and Responsibilities:
  • Data Engineering Lead excels in data modeling, Lakehouse, and ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including DataBricks, Sagemaker, Spark, Kafka, Kubernetes, SQL, NoSQL DBs, Graph DBs, and visualization tools such as Power BI/Tableau.
  • The Data Engineer Lead serves as the primary State of Michigan technology lead engaging with the UoM proof of concept team to support best practice adoption within the state hosting environment and provides training to DAV data engineers. This role’s responsibilities include:
  • Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems.
  • Architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes.
  • Ensure data quality, reliability, and security by establishing standards, monitoring systems, and implementing validation and governance practices.
  • Lead and mentor data engineering staff, providing technical guidance, reviewing designs/code, and supporting professional growth.
  • Collaborate with cross functional partners, such as data scientists, analysts, product teams, and business stakeholders, to ensure data solutions meet organizational needs and strategic goals.
Other Desired Skills:
  • Must have a BS in Computer Science / Data Science / Information Systems with an overall 4+ years of experience in designing and implementing data, analytics, and AI solutions for large enterprises by building data pipelines using the available data platform tools of any Cloud Service Provider (CSP) such as AWS/Microsoft/Google.
  • Experience in modeling and leveraging Relational data services with demonstrated proficiency in Python/Pysparks/SQL programming and tuning SQL queries to extract data from multiple sources ( relational DB, flat files, CSV, HTML, JSON, etc) sources into Lakehouse Medallion architecture in parquet formats
  • Demonstrated experience and expertise in programming/scripting languages including Python, R, Spark, etc.
  • Experience in designing and delivering Star-schema based operational data store is required to enable visualization of program activities and outcomes in a visualization tool such as Power BI.
Key Programming Languages:

SQL, Python, R, Spark, Terraform Scripting, DAGs Scripting, YAML scripting, Docker
Other Technologies, Concepts and Frameworks: Juniper Notebooks, NOSQL DB, Graph DB, Parquet DB, Lakehouse and Medallion Architecture concepts, Kafka, Kubernetes, Glue, Databricks, Power BI, Tableau, Redshift Spectrum, Sagemaker, DBT, Datahub, SageMaker, Machine Learning, GitHub, DevOps

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer Lead
Data Engineer Lead

Robotic Technologies Automation • Lansing (MI)

On-site
USD 83,000 - 124,000
Data Engineer Lead
Data Engineer Lead

Ethereum Technologies • Lansing (MI)

On-site
USD 83,000 - 118,000
Data Engineer Lead
Data Engineer Lead

Robotics Technologies LLC • Lansing (MI)

On-site
USD 83,000 - 118,000
Data Engineer Lead
Data Engineer Lead

Valiant Technologies LLC • Lansing (MI)

On-site
USD 85,000 - 116,000
Lead Data Engineer
Lead Data Engineer

MasterApp Labs • Lansing (MI)

Hybrid
USD 83,000 - 165,000
401(k) matching
Dental insurance
Health insurance
+1
Lead Data Engineer/Architect
Lead Data Engineer/Architect

I O DATASPHERE • Lansing (MI)

On-site
USD 90,000 - 130,000
MI-Lead Data Engineer/Architect
MI-Lead Data Engineer/Architect

AiQualTest LLC • Town of Lansing (NY)

On-site
USD 120,000 - 180,000
Data Engineer Lead / Data Warehouse Architect
Data Engineer Lead / Data Warehouse Architect

Govan Systems inc • Lansing (MI)

Hybrid
USD 120,000 - 180,000
Lead Data Engineer/Architect - DHHS
Lead Data Engineer/Architect - DHHS

IO Datasphere, Inc. • Lansing (MI)

On-site
USD 90,000 - 140,000
Data Warehouse Architect 3- (Hybrid)
Data Warehouse Architect 3- (Hybrid)

GSK Solutions Inc. • Lansing (MI)

Hybrid
USD 110,000 - 117,000