Data Engineer

Cortex Consultants LLC; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Cortex Consultants LLC is hiring a Data Engineer in India (Chennai / Hyderabad / Pune) to design and maintain scalable data pipelines and data models. You will work with Python, SQL, PySpark and Databricks on AWS cloud, delivering robust ETL/ELT solutions and ensuring data quality.

The role requires 6-8 years of experience, hands-on Python and SQL, and experience with data orchestration tools. L1 Virtual | L2 Face-to-Face interview process. Immediate notice period expectations.

Qualifications

• Proven experience as a Data Engineer (6-8 years).
• Strong hands-on experience in Python.
• Proficiency in SQL (complex queries and performance tuning).
• Strong expertise in PySpark and Databricks.
• Hands-on experience in AWS cloud environment (S3, Glue, EMR, Redshift, Lambda).

Responsibilities

• Design and maintain data pipelines and data models.
• Develop and optimize ETL/ELT processes for data warehousing.
• Collaborate with data teams to ensure data quality and availability.
• Leverage Airflow or AWS Step Functions for orchestration and automation.
• Implement CI/CD practices for data engineering workflows.

Skills

Python

SQL

PySpark

Databricks

AWS

Tools

Airflow

AWS Step Functions

Git

Job description

Job Title

Data Engineer

Experience

6 8 Years

Location

Chennai / Hyderabad / Pune

Interview Process

L1 Virtual | L2 Face-to-Face

Notice Period

Immediate

Mandatory Skills

• Python
• SQL (Must Have)
• PySpark
• Databricks (Minimum 2 years of hands-on experience)
• AWS (S3, Glue, EMR, Redshift, Lambda)

Job Requirements

• Proven experience as a Data Engineer (6 8 years).
• Strong hands-on experience in Python.
• Proficiency in SQL (complex queries and performance tuning).
• Strong expertise in PySpark and Databricks.
• Hands-on experience in AWS cloud environment.
• Experience with data pipeline orchestration tools (Airflow or AWS Step Functions).
• Good understanding of Data Modeling, Data Warehousing, and ETL/ELT concepts.
• Experience with Git and CI/CD practices.
• Excellent problem-solving and communication skills.