Data Warehouse Architect

Zenfreed, LLC

Lansing (MI)

Hybrid

USD 120,000 - 180,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Zenfreed, LLC in Lansing, MI is hiring a Data Engineering Lead to drive data modeling, Lakehouse ecosystems, and ML product delivery in an agile DevOps environment. You will lead distributed data architectures, work with DataBricks, SageMaker, Spark, Kafka, Kubernetes, SQL/NoSQL, and BI tools, while mentoring a team of engineers.

The role engages with the State of Michigan proof of concept team, supports best practice adoption in a hybrid on-site setting, and requires strong collaboration with

Qualifications

  • Bachelor's degree in CS/DS/IS.
  • 4+ years in data engineering with cloud data lakes and pipelines.
  • Experience with data governance and security.
  • Strong Python/SQL/ETL/ELT skills.

Responsibilities

  • Oversee design, development, and maintenance of data pipelines.
  • Architect and optimize data infrastructure, storage, and ETL/ELT processes.
  • Ensure data quality, reliability, and governance.
  • Lead and mentor data engineering staff and review designs.
  • Collaborate with data scientists, analysts, product teams, and stakeholders.

Skills

DevOps tooling
Data pipelines
Python
SQL
Spark / Databricks
SageMaker

Education

Bachelor's degree in CS/DS/IS

Tools

GitHub
Jenkins
Terraform
Kubernetes
Databricks
SageMaker
Power BI/Tableau

Job description

  • Minimum Education Requirement Bachelor's Degree
  • City Lansing
  • Country United States
Job Description

Data Engineering Lead excels in data modeling, Lakehouse, and ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including DataBricks, Sagemaker, Spark, Kafka, Kubernetes, SQL, NoSQL DBs, Graph DBs, and visualization tools such as Power BI/Tableau.

The Data Engineer Lead serves as the primary State of Michigan technology lead engaging with the UoM proof of concept team to support best practice adoption within the state hosting environment and provides training to DAV data engineers.

Job Duties
  • Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems.
  • architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes.
  • Ensure data quality, reliability, and security by establishing standards, monitoring systems, and implementing validation and governance practices.
  • Lead and mentor data engineering staff, providing technical guidance, reviewing designs/code, and supporting professional growth.
  • Collaborate with cross functional partners, such as data scientists, analysts, product teams, and business stakeholders, to ensure data solutions meet organizational needs and strategic goals
Requirements

4 years:

  • Hands-on experience is require in hydrting the enterprise Data Lake on a Cloud Service Provider (AWS, Azure, or Google) from relational, semi- structured and unstructured data sources by building Extract and Load Data Pipelines.
  • Hands-on experience is required in Transforming the datasets in a Data Lake on a Cloud Service Provider to deliver Data Products with traceability of their attributes / features to the Critical Data Elements in the systems of record.

2 years:

  • Experience is required in enforcing Data Sharing Policies to Data Products to ensure that User get to see only the version of the Data Product the User is entitled to get access to at the time of subscription.
Desired Skills
  • Proficiency desirable in DevOps tools including Github/Jenkins/Terraform/YAML/DAGs/Docker/Databricks/SageMaker etc. for building
  • Data/ML pipelines to extract/store data from multiple sources to parquet destinations.
  • Experience desirable in promoting Data Engineering Standards and Best Practices among the community of developers to influence the enterprise towards building scalable and supportable Data/ML Products delivery and their usage by the community of data, analytics, and ML product users.
  • Experience desirable in implementing Data Governance and Data Security tools available on a CSP to automate the enforcement of Data Sharing Policies at the point of subscription of a Data Product by a subscriber.
Other Desired Skills:

4 years:

  • Ex erience in modeling and leveraging Relational data services with demonstrated proficiency in Python/Pysparks/SQL programming and tuning SQL queries to extract data from multiple sources ( relational DB, flat files, CSV, HTML, JSON, etc) sources into Lakehouse Medallion architecture in parquet formats
  • Experience in designing and implementing data, analytics, and AI solutions for large enterprises by building data pipelines using the available data platform tools of any Cloud Service Provider (CSP) such as AWS/Microsoft/Google.

Must have a BS in Computer Science / Data Science / Information Systems

Experience in designing and delivering Star-schema based operational data store is required to enable visualization of program activities and outcomes in a visualization tool such as Power BI.

Key Programming Languages: SQL, Python, R, Spark, Terraform Scripting, DAGs Scripting, YAML scripting, Docker Other Technologies, Concepts and Frameworks: Juniper Notebooks, NOSQL DB, Graph DB, Parquet DB, Lakehouse and Medallion Architecture concepts, Kafka, Kubernetes, Glue, Databricks, Power BI, Tableau, Redshift Spectrum, Sagemaker, DBT, Datahub, SageMaker, Machine Learning, GitHub, DevOps

  • Bachelor's Degree
Location
  • Local candidates vs non-local: Open to candidates local to the Lansing Michigan area and those willing to relocate. Candidates that relocate must relocate before day one and be ready to be on-site from day one at their own expense (non-negotiable)
  • Positionis a hybrid schedule withWednesday and Thursday are REQUIRED in-office days. This is NON-NEGOTIABLE and there is NO remote only option.
  • Working hoursMonday-Friday, approximately 8:00 a.m. to5:00 p.m.
AdditionalRequirements
  • Must be authorized towork in the United States; We are unable to offersponsorships at this time
  • Must undergo a background checkand drug screening for employment.
EmploymentTerms
  • This is a W2 position
  • HYBRID schedule - Wednesday and Thursday are REQUIRED in-office days. This is NON-NEGOTIABLE and there is NO remote only option.

AtZenfreed, we are more than an IT company. We bridge thegap between people wanting to do the work they were meant to doand organizations needing the right talent.

We are dedicated to building a diverse,inclusive and authentic workplace, so if you’re excitedabout this role but your past experience doesn’t alignperfectly with every qualification in the job description,we encourage you to apply anyway. You may be just the rightcandidate for this or other roles.

We understand a comprehensive benefits package is crucial toemployment satisfaction. We offer medical, dental and vision coverageoptions for all employees.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Software Architect
Expert Software Architect

Tcognition, Inc. • City of Albany (NY)

On-site
USD 120,000 - 172,000
Lead Data Engineer
Lead Data Engineer

MasterApp Labs • Lansing (MI)

Hybrid
USD 83,000 - 165,000
401(k) matching
Dental insurance
Health insurance
+1
Data Warehouse Architect 3- (Hybrid)
Data Warehouse Architect 3- (Hybrid)

GSK Solutions Inc. • Lansing (MI)

Hybrid
USD 110,000 - 117,000
Lead Data Engineer/Architect
Lead Data Engineer/Architect

I O DATASPHERE • Lansing (MI)

On-site
USD 90,000 - 130,000
Lead Data Engineer/Architect - DHHS
Lead Data Engineer/Architect - DHHS

IO Datasphere, Inc. • Lansing (MI)

On-site
USD 90,000 - 140,000
Databricks Architect/ Senior Data Engineer
Databricks Architect/ Senior Data Engineer

OZ • Boca Raton (FL)

On-site
USD 120,000 - 160,000
Competitive compensation
Comprehensive benefits package
Remote work options
Data Architect
Data Architect

Empower • Greenwood Village (CO)

On-site
USD 138,000 - 200,000
Health insurance
401(k) matching
Tuition reimbursement
+3
Azure Bachelors Degree Architect
Azure Bachelors Degree Architect

COOLSOFT • Lansing (MI)

Hybrid
USD 85,000 - 110,000
Data Engineer Lead
Data Engineer Lead

VSE AVIATION INC (US) • Phoenix (AZ)

On-site
USD 140,000 - 200,000
Senior Staff Data Engineer
Senior Staff Data Engineer

Ultimate.ai • Austin (TX)

Hybrid
USD 200,000 - 300,000
Hybrid work environment