Data Engineer

VeeRteq Solutions Inc.; Chicago (IL); Hybrid; USD 120,000 - 180,000; Full time

Job summary

VeeRteq Solutions Inc. is seeking a Senior Data Engineer to design and manage scalable ETL pipelines using PySpark, Python, SQL, and cloud services. The role requires deep experience with Databricks, AWS, and modern DevOps practices.

You will build data pipelines, implement CI/CD, and collaborate across teams. The job offers hybrid work: in Chicago three days per week or remote, with F2F interview.

Qualifications

• Engineering degree BE/ME/BTech/MTech/BSc/MSc.
• Certifications in multiple technologies desirable.
• Strong ETL, Python, SQL, PySpark, AWS and CI/CD experience.
• Experience with Databricks and Terraform is preferred.
• Front-end integration with Angular is a plus.
• Experience with Git, Octopus, and Azure DevOps for CI/CD.
• Familiarity with cloud-based data processing environments.

Responsibilities

• Develop and manage ETL processes using Python, PySpark, and SQL.
• Work with Databricks for data processing.
• Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda.
• Familiarity with Terraform for infrastructure management.
• Work with Angular for front-end integration.
• Collaborate on version control using Git and deployment using Octopus and Azure DevOps.
• Support CI/CD processes using Git, Octopus, and Azure DevOps.
• Work within cloud-based data engineering environments and data processing frameworks.

Skills

ETL

Python

SQL

PySpark

Angular for front-end

AWS services

Terraform

Git/Octopus/Azure DevOps for CI/CD

Education

Engineering Degree BE/ME/BTech/MTech/BSc/MSc

Tools

Databricks

Terraform

Angular

Scala

HL7

Job description

Role: SR Data Engineer

Experience: -

Min 8+ Years

Location: -

Chicago, IL(3 days/Week) OR Remote (F2F Interview Mandatory)

Data Engineer with expertise in ETL development, Python, SQL, and cloud-based data processing, responsible for building and managing scalable data pipelines using Databricks, AWS, and modern DevOps practices.

Responsibilities: -

• Perform Develop and manage ETL processes using Python, PySpark, and SQL.
• Work with Databricks for data processing.
• Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda.
• Familiarity with Terraform for infrastructure management.
• Work with Angular for front-end integration.
• Collaborate on version control using Git and deployment using Octopus and Azure DevOps.
• Support CI/CD processes using Git, Octopus, and Azure DevOps.
• Work within cloud-based data engineering environments and data processing frameworks.

Educational Qualifications: -

• Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
• Technical certification in multiple technologies is desirable.

Skills: -

Mandatory skills

• Strong ETL
• Python
• SQL
• PySpark
• Angular for front-end development
• Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda)
• Terraform knowledge
• Experience with Git, Octopus, and Azure DevOps for CI/CD

Good to Have Skills

• Databricks
• Terraform
• Angular
• Basic knowledge of Scala
• Basic knowledge of HL7

VeeRteq Solutions is an Equal Opportunity Employer