Data Engineer

OP RaaS; Naperville (IL); On-site; USD 90,000 - 130,000; Full time

Job summary

OP RaaS in Naperville, IL seeks an Intermediate Data Engineer to design, develop, and maintain modular data pipelines, leveraging AWS big data services to ingest and transform large data sets while collaborating with business partners and developers.

You will focus on high-level design and architecture, perform code reviews, and deliver solutions using Python, Spark, and Java in a Unix/Linux environment, supported by a BS in a relevant field.

Qualifications

• 3+ years of professional work experience in Data Engineering using big data methodologies.
• Experience in Unix/Linux environments.
• Experience with source code management systems like GIT.
• Proficiency with Python, Pandas, Spark and Java.
• Bachelor of Science degree in a related field; Master's degree a plus.

Responsibilities

• Design, develop, and maintain modular code base to solve real-world problems.
• Conduct regular peer code reviews to ensure code quality and compliance with best practices.
• Work in cross-disciplinary teams to understand client needs and ingest rich data sources.
• Research and utilize leading Big Data technologies in AWS.
• Help drive innovations and extendable platforms for clients.

Education

Bachelor degree in Computer Science, Information Technology, Computer Engineering, or related field

Master's degree a plus

Tools

Python

Pandas

Spark

Java

GIT

Unix/Linux

Job description

Summary

As an Intermediate Data Engineer, you are familiar with the data warehousing technical components, infrastructure, and their integration. You’ll analyze large amounts of data, discover and solve real world problems. You love the idea of being able to provide insight as well as presenting those insights. You are responsible for high level design/architecture. You are comfortable fostering relationships with internal business partners and other members of the development team.

Key Responsibilities

• Design, develop, and maintain modular code base to solve “real” world problems.
• Conduct regular peer code reviews to ensure code quality and compliance following best practices in the industry.
• Work in cross-disciplinary teams to understand client needs and ingest rich data sources.
• Research, experiment, and utilize leading Big Data technologies in AWS.
• Help drive the process for pursuing innovations, target solutions, and extendable platforms for clients products.
• Participate in developing and presenting thought leadership and assist in ensuring that clients “data source” technology stack incorporates and is optimized for using specific technologies.

Education and Experience

• 3+ years of professional work experience in Data Engineering using big data methodologies with multiple programming languages and technologies.
• Experience working efficiently under Unix/Linux environment.
• Experience with source code management systems like GIT.
• Experience and demonstrated proficiency with Python, Pandas, Spark and Java
• Bachelor of Science degree from an accredited college/university in Computer Science, Information Technology, Computer Engineering, or related field (i.e. math and physics) required. Master’s degree a plus.

Competencies, Knowledge and Skills

• Qualified individuals possess the clients attributes of being smart, curious, committed to vision, passionate, fun/pleasant, an achiever and having a sense of urgency.
• Ability to manage established relationships internally as well as with clients.
• Ability to communicate complex technical concepts succinctly to non-technical colleagues, understand & manage interdependencies between all facets of a project.
• Ability to interface with internal clients; Must have demonstrated advanced proficiency in complex, mature and sophisticated design & analysis technologies and solutions.
• Skilled ability to rapidly ingest, transform, engineer, and visualize data, both for ad hoc and product-level (e.g., automated) data & analytics solutions.
• Experience with large-scale, AWS big data methods such as EC2, S3, EMR, Kinesis, DynamoDB, Athena, AWS-Glue and Redshift.
• Demonstrated strong knowledge of programming methodologies (Terraform, version control, testing, QA) and agile development methodologies.

Physical Requirements

• Frequently required to sit and stand.
• Required to use hands to handle or feel objects, tools or controls.
• Visual acuity and manual dexterity required to code using software and a laptop computer.

Other Duties

• Duties, responsibilities and activities are not all encompassing and may change at any time with or without notice. To perform this job successfully, an individual must be able to perform each essential job duty satisfactorily. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform essential job functions