Data Engineer - Data Warehouse, BigData, Python and SQL

Tech ECS Limited; Kolkata District; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

Tech ECS Limited in India is seeking a Data Engineer to design, develop, and manage data solutions, including pipelines and data warehouses. The ideal candidate will handle high-volume data processing, integrate complex data structures, and optimize data storage solutions.

You will ensure data reliability, quality, and compliance while collaborating on analytics and business intelligence projects in a diverse technological environment.

Qualifications

• Bachelor's degree in Computer Science, IT, or a related field.
• 4+ years of experience in database and enterprise data warehouse development.
• Proven track record of developing and managing complex data pipelines and integrating diverse data sources.
• Strong analytical and numerical skills with attention to detail.

Skills

Advanced SQL

PL/SQL

Bulk data processing

Data modeling

Star/Dimensional modeling

ETL development

Data ingestion

Big data platforms

Hadoop

Spark

Hive

Shell scripting

AWS tools

EMR

Lambda

Glue

Step Functions

Data governance

Problem-solving

Performance tuning

Education

Bachelor's degree in Computer Science or related field

Tools

Sqoop

Job description

Job Summary. We are seeking a skilled Data Engineer to join our team and contribute to designing, developing, and managing data solutions, including pipelines and data warehouses. The ideal candidate will handle high-volume data processing, integrate complex data structures, and optimize data storage solutions. You will ensure data reliability, quality, and compliance while collaborating on analytics and business intelligence projects in a diverse technological environment.

Job Summary. We are seeking a skilled Data Engineer to join our team and contribute to designing, developing, and managing data solutions, including pipelines and data warehouses. The ideal candidate will handle high-volume data processing, integrate complex data structures, and optimize data storage solutions. You will ensure data reliability, quality, and compliance while collaborating on analytics and business intelligence projects in a diverse technological environment.

Must-Have Skillsets (Mandatory)

• Expertise in Advanced SQL, PLSQL, and handling bulk data processing.
• Proficiency with databases like Amazon Redshift, Oracle, SQL Server, MySQL, and Postgres.
• Experience in data modeling, including Star/Dimensional modeling.
• Knowledge of Data Warehouse development and ETL processes.
• Experience with structured and semi-structured data ingestion.
• Familiarity with big data platforms and technologies such as Hadoop, Scala, Spark, Hive, Shell Scripting, and AWS tools like EMR, Lambda, Glue, and Step Function.
• Strong problem-solving, debugging, and performance-tuning skills.
• Ability to design and optimize data storage and manage data governance principles.

Good-to-Have Skillsets (Optional)

• Hands-on experience with Hadoop/Big Data environments.
• Experience with streaming data platforms like Kafka or Flume.
• Knowledge of data analytics and business intelligence solutions.
• Proficiency in tools for data integration and orchestration like Sqoop.

Qualifications And Experience

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum of [insert years, e.g., 4+ years] experience in database and enterprise data warehouse development.
• Proven track record of developing and managing complex data pipelines and integrating diverse data sources.
• Strong analytical and numerical skills with attention to detail.

This role is ideal for a dynamic professional eager to innovate in a data-driven environment and contribute to transformative projects.