Data Engineer

BinaryBees Business Solutions LLC

Itasca (IL)

Híbrido

USD 100 000 - 130 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

A technology solutions provider in Illinois is seeking a Data Engineer to design, develop, and maintain scalable data pipelines. This mid-senior level position requires expertise in PySpark and Python, along with 5+ years of relevant experience. The role involves partnerships with data scientists, ensuring data quality, and optimizing performance. Applicants must possess a bachelor’s degree in Computer Science or a related field, along with strong skills in data integration and CI/CD pipelines.

Qualificações

  • 5+ years of experience as a Data Engineer.
  • 3+ years of experience with Delta Lake and change data feeds.
  • Experience with data governance and security best practices.

Responsabilidades

  • Design and develop scalable data pipelines to process large volumes of data.
  • Ensure data quality through validation and automated testing.
  • Monitor and troubleshoot data pipeline issues.

Conhecimentos

Data pipeline development
PySpark
Python
CI/CD pipelines
Data lakehouse architecture
Object-Oriented Programming
Data integration

Formação académica

Bachelor’s degree in Computer Science or related field

Ferramentas

Azure DevOps
Databricks

Descrição da oferta de emprego

Primary Location: Itasca, IL Hybrid in Chicago’s Northwest Suburbs

In-Office/Remote Schedule: 2 Days In-Office, 3 Days WFH

Citizenship: Must be Citizen and Green Card

The Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and integrations that support data analytics and business intelligence across the organization. This role is essential to ensuring high-quality data delivery, optimizing performance, and enabling effective decision-making through reliable data solutions.

What You Bring to the Role (Ideal Experience)
  • Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
  • 5+ years of experience as a Data Engineer.
  • 3+ years of experience with the following:
  • Building and supporting data lakehouse architectures using Delta Lake and change data feeds.
  • Working with PySpark and Python, with strong Object-Oriented Programming (OOP) experience to extend existing frameworks.
  • Designing data warehouse table architecture such as star schema or Kimball method.
  • Writing and maintaining versioned Python wheel packages to manage dependencies and distribute code.
  • Creating and managing CI/CD pipelines, especially using Azure DevOps for Microsoft Fabric-related assets.
  • Experience establishing scalable and maintainable data integrations and pipelines in Databricks environments.
Nice to Have’s
  • Hands‑on experience implementing data solutions using Microsoft Fabric.
  • Experience with machine learning/ML and data science tools.
  • Knowledge of data governance and security best practices.
  • Experience in a larger IT environment with 3,000+ users and multiple domains.
  • Current industry certifications from Microsoft cloud/data platforms or equivalent. One or more of the following is preferred:
  • Microsoft Certified: Fabric Data Engineer Associate
  • Google Professional Data Engineer
  • Certified Data Management Professional (CDMP)
What You’ll Do (Skills Used in this Position)
  • Design and develop scalable data pipelines to collect, process, and store large volumes of structured and unstructured data.
  • Extend and enhance existing OOP‑based frameworks developed in Python and PySpark.
  • Partner with data scientists and analysts to define requirements and design robust data analytics solutions.
  • Ensure data quality and integrity through data cleansing, validation, and automated testing procedures.
  • Develop and maintain technical documentation, including requirements, design specifications, and test plans.
  • Implement and manage data integrations from multiple internal and external sources.
  • Optimize data workflows to improve performance, reliability, and reduce cloud consumption.
  • Monitor, troubleshoot, and resolve data pipeline issues to ensure consistent data delivery.
  • Establish and manage CI/CD pipelines and release processes, particularly using Azure DevOps for Microsoft Fabric.
  • Provide technical leadership and coordination for global development and support teams.
  • Participate in creating a safe and healthy workplace by adhering to organizational safety protocols.
  • Support additional projects and initiatives as assigned by management.
Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Information Technology

Industries

Information Services

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Data Engineer
Senior Data Engineer

Burtch Works • Chicago (IL)

Híbrido
USD 148 000 - 164 000
Data Engineer
Data Engineer

Compunnel Inc. • Norfolk (VA)

Presencial
USD 110 000 - 150 000
Senior Data Engineer
Senior Data Engineer

Planet Group (United States) • Irving (TX)

Híbrido
USD 96 000 - 110 000
Data Engineer
Data Engineer

Northbound Executive Search • Austin (TX)

Presencial
USD 80 000 - 120 000
Data Engineer Lead
Data Engineer Lead

VSE AVIATION INC (US) • Phoenix (AZ)

Presencial
USD 140 000 - 200 000
Data Engineer
Data Engineer

tastylive, Inc. • Chicago (IL)

Híbrido
USD 110 000 - 150 000
Data Engineer (in person)
Data Engineer (in person)

SEP • Westfield (IN)

Presencial
USD 90 000 - 110 000
Flexible work schedules
Opportunities to learn and develop
Community of friendly peers
+1
Data Engineer
Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC • Chicago (IL)

Teletrabalho
USD 84 000 - 120 000
Data Engineer Lead
Data Engineer Lead

VSE AVIATION INC (US) • Florida

Presencial
USD 130 000 - 190 000
Data Engineer
Data Engineer

Virtusa Corporation • EUA

Teletrabalho
USD 120 000 - 160 000