Senior Data Engineer

ZipRecruiter; Lisle (IL); Hybrid; USD 84,000 - 150,000; Full time

Job summary

A leading education provider in Lisle, Illinois is looking for a Senior Data Engineer to design and maintain data engineering solutions supporting innovative initiatives. The role involves optimizing data pipelines and collaborating with various teams. Candidates should have extensive experience in data engineering and expertise in cloud services. This position offers a hybrid working model and a competitive salary range of $84,835 to $149,076 annually.

Benefits

Health, dental, vision insurance

401k with 6% employer match

Flexible Time Off policy

12 Paid Holidays

Qualifications

• Minimum of 2 years experience in Google Cloud Services.
• Over 6 years experience in data engineering solutions.
• Hands-on experience with real-time, unstructured, and synthetic data.

Responsibilities

• Design and optimize scalable data pipelines.
• Collaborate with cross-functional teams for data solutions.
• Implement CI/CD pipelines for data product delivery.

Skills

Data engineering solutions

Real-time data ingestion

Python programming

SQL

Cloud services

Education

Bachelor's Degree in Computer Science or related field

Master's Degree in Computer Science or related field

Tools

Google Cloud Platform (BigQuery, DataFlow)

Apache Kafka

Apache Airflow

Job description

Job DescriptionJob DescriptionCompany Description

Adtalem Global Education is a leader in post-secondary education and leading provider of professional talent to the healthcare industry. Adtalem educates and empowers students with the knowledge and skills to become leaders in their communities and make a lasting impact on public health, well-being and beyond. Through equitable access to education, environments that nurture student success, and a focus on expanding and diversifying the talent pipeline in healthcare, Adtalem is building a brighter future for communities and the world.

Adtalem is the parent organization of American University of the Caribbean School of Medicine, Chamberlain University, Ross University School of Medicine, Ross University School of Veterinary Medicine and Walden University.

We operate on a hybrid schedule with four in-office days per week (Monday–Thursday). This approach enhances creativity, innovation, communication, and relationship-building, fostering a dynamic and collaborative work environment.

VisitAdtalem.comfor more information and follow us onLinkedInandInstagram.

Job Description

Adtalem is a data driven organization. The Data Engineering team builds data solutions that powers strategic and tactical business decisions and supports the Analytics and Artificial Intelligence operations. By implementing the data platform, data pipelines and data governance policies this team provides the basis for decision-making in Adtalem. Adtalem is looking for a Senior Data Engineer who design, build, and maintain robust data engineering solutions that support our company’s innovation initiatives and growth objectives.

• Architect, develop, and optimize scalable data pipelines handling real-time, unstructured, and synthetic datasets
• Collaborate with cross-functional teams, including data scientists, analysts, and product owners, to deliver innovative data solutions that drive business growth.
• Design, develop, deploy and support high performance data pipelines both inbound and outbound.
• Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
• Leverage streaming technologies and cloud platforms to enable real-time data processing and analytics
• Optimize data pipelines for performance, scalability, and reliability.
• Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products.
• Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
• Document the design and support strategy of the data pipelines
• Capture, store and socialize data lineage and operational metadata
• Troubleshoot and resolve data engineering issues as they arise.
• Develop REST APIs to expose data to other teams within the company.
• Stay current with emerging technologies and industry trends related to big data, streaming data, and synthetic data
• Mentor and guide junior data engineers.

Qualifications

• Bachelor's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.
• Master's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.Two (2) plusyears experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows,BQML, Vertex AI.
• Six (6) plusyears experience in data engineering solutions such as data platforms, ingestion, data management, or publication/analytics.
• Hands-on experience working with real-time, unstructured, and synthetic data, and will be instrumental in advancing our data platform capabilities.
• Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.
• Expert knowledge on Python programming and SQL.
• Experience with cloud platforms (AWS, GCP, Azure) and their data services
• Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
• Familiarity with synthetic data and unstructured data processing
• Experience in AI/ML data pipelines and frameworks
• Excellent organizational, prioritization and analytical abilities.
• Have proven experience working in incremental execution through successful launches.
• Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.
• Experience working in agile environment.

Additional Information

In support of the pay transparency laws enacted across the country, the expected salary range for this position is between $84,835.61 and $149,076.17. Actual pay will be adjusted based on job-related factors permitted by law, such as experience and training; geographic location; licensure and certifications; market factors; departmental budgets; and responsibility. Our Talent Acquisition Team will be happy to answer any questions you may have, and we look forward to learning more about your salary requirements. The position qualifies for the below benefits.

Adtalem offers a robust suite of benefits including:

• Health, dental, vision, life and insurance
• 401k Retirement Program + 6% employer match
• Participation in Adtalem’s Flexible Time Off (FTO) Policy
• 12 Paid Holidays
  
  For more information related to our benefits please visit: https://careers.adtalem.com/benefits.
  
  You are also eligible to participate in an annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Equal Opportunity – Minority / / / V / /