Data Engineer

Inizio Partners Corp; New York (NY); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology consulting firm seeks a data engineer with strong skills in Python and experience in cloud-based platforms. The ideal candidate will have a solid understanding of Microservices and REST API design, along with experience in building automated data pipelines in an Agile environment. Preferred qualifications include a Master's degree and prior experience in the healthcare sector. The role is primarily based in New York, NY, with additional preference for candidates in Dallas, Chicago, and Boston.

Qualifications

• 3+ years hands-on coding experience in Python.
• Experience in designing and building Microservices.
• Experience with REST API design and development using Python.
• Experience deploying/scaling apps on containerized environments.
• Experience with real-time and streaming technology.
• Real-world exposure to cloud-based platforms.

Responsibilities

• Build automated big data pipelines.
• Perform data analysis and exploration.
• Work in an agile delivery environment.
• Partner cross-functionally with technical teams.

Skills

Python

Microservices

REST API design and development

Kubernetes

Azure Event Hubs

cloud-based platforms

data analysis

agile delivery

Snowflake

RDBMS

NoSQL Databases

Airflow

data modeling

DevOps best practices

problem-solving skills

Education

Bachelor's degree in computer science or related field

Master's degree preferred

Job description

• Strong in Python with 3+ years hands-on coding experience
• 3+ years experience in designing and building Microservices
• 3+ years experience with REST API design and development using Python
• 3+ years experience with deployment/scaling of apps on containerized environment (i.e., Kubernetes, AKS)
• 3+ years experience with real-time and streaming technology (i.e., Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
• 3+ years experience with cloud-based platforms (i.e., Azure, GPC, AWS)
• Experience building automated big data pipelines
• Experience performing data analysis and data exploration
• Experience working in an agile delivery environment
• Experience with Snowflake
• Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization
• Experience with orchestrating pipelines using tools (i.e., Airflow, Azure Data Factory)
• Experience with data modeling and system architecture design
• Experience partnering cross-functionally with other technical teams (i.e., data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes
• Experience with setting coding standards, performing code reviews, and mentoring junior developers
• Exposure/understanding DevOps best practice and CICD (i.e., Jenkins)
• Ability to understand complex systems and solve challenging analytical problems
• Strong critical thinking, communication, and problem-solving skills and a quick learner

Preferred Qualifications

• Solid understanding of Kafka architecture and building consumers for high volume data streams.
• Experience with bash shell scripts, UNIX utilities & UNIX Commands
• Previous healthcare experience and domain knowledge

Education

• Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent experience
• Preferred: masters degree with coursework focused on advanced algorithms, mathematics in computing, data structures, etc.

Preferred locations

Dallas/Irving, Chicago, Boston/Wellesley, NYC, Hartford CT, Blue Bell PA, Scottsdale AZ, or Woonsocket RI.