Data Engineer

Coltigent Technology Services Pvt Ltd; Pune District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Coltigent Technology Services Pvt Ltd is hiring a Data Engineer to design, develop, and maintain reliable, scalable data pipelines and platforms. You will work with SQL and programming languages (Python, Java, or Scala) to build ETL/ELT solutions and ensure data quality and security.

Responsibilities include developing data pipelines on AWS/Azure/GCP, handling large datasets, and integrating data from relational and NoSQL sources while collaborating with cross-functional teams.

Qualifications

• Strong SQL proficiency
• Coding skills in Python, Java, or Scala
• Hands-on ETL/ELT expertise and data movement
• Experience with cloud platforms (AWS/Azure/GCP)
• Familiarity with Snowflake, Databricks, Apache Spark, PySpark, Kafka
• Knowledge of relational and NoSQL databases
• Experience with data warehousing and cloud data services
• Strong analytical and problem-solving skills

Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Develop data solutions using Python, SQL, Java, or Scala.
• Build and optimize data pipelines for efficient data movement and transformation.
• Work with cloud platforms such as AWS, Azure, or GCP.
• Perform data validation, quality checks, transformation, and optimization.
• Work with large datasets and modern Big Data technologies.
• Manage and integrate data from relational and NoSQL databases.
• Collaborate with developers, data analysts, and business teams.
• Ensure data solutions are scalable, reliable, secure, and maintainable.

Skills

SQL proficiency

Programming: Python, Java, or Scala

ETL/ELT pipelines

Cloud platforms: AWS/Azure/GCP

Snowflake/Databricks/Spark/PySpark/Kaf

Relational & NoSQL databases

Data warehousing & cloud data services

Analytical & problem-solving

Job description

We are hiring a Data Engineer for one of our clients. The ideal candidate will be responsible for designing, developing, and maintaining reliable and scalable data pipelines and data platforms.

Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Develop data solutions using Python, SQL, Java, or Scala.
• Build and optimize data pipelines for efficient data movement and transformation.
• Work with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Perform data validation, quality checks, transformation, and optimization.
• Work with large datasets and modern Big Data technologies.
• Manage and integrate data from relational and NoSQL databases.
• Collaborate with developers, data analysts, and business teams.
• Ensure data solutions are scalable, reliable, secure, and maintainable.

Skills

• Strong proficiency in SQL.
• Strong programming skills in Python, Java, or Scala.
• Hands-on experience with ETL/ELT, data pipelines, data transformation, and data movement.
• Experience with AWS, Azure, or GCP.
• Familiarity with Snowflake, Databricks, Apache Spark, PySpark, or Kafka.
• Knowledge of relational databases and NoSQL databases.
• Experience with data warehousing and cloud data services.
• Strong analytical and problem-solving skills.

Experience

2+ years of experience in Data Engineering or software development focused on data movement.

Employment Type : Full-timeIndustry : IT Services & ConsultingRole : Data Engineer