python data engineer

HCLTech; Hyderabad, Chennai, Bengaluru; Híbrido; INR 900.000 - 1.600.000; Tempo integral

Resumo da vaga

HCL Technologies Limited is seeking Data Engineers to build scalable data pipelines using SQL, Python, and AWS. You will design data models, implement ETL processes, and deploy reliable data infrastructure to generate actionable insights across manufacturing-related datasets.

Candidates should be proficient in SQL and Python, with experience in data warehousing, Airflow orchestration, and big data tools such as Spark, Kafka, and Hadoop.

Qualificações

• Experience in designing and optimizing data models and pipelines.
• Ability to collect, process, and analyze large datasets for insights.
• Strong scripting in Python for automation and data wrangling.
• Familiarity with cloud platforms (AWS) and big data technologies.
• Attention to data quality, governance, and reproducibility.
• Excellent collaboration, communication, and problem-solving skills.

Responsabilidades

• Build scalable, reliable data pipelines and infrastructure.
• Work with SQL, Python/Scala, and cloud tools to ingest and transform data.
• Collaborate with cross-functional teams to align data strategies.
• Create templates, dashboards and visualizations to communicate findings.
• Ensure data integrity through cleaning, preprocessing, and validation.
• Optimize data collection and storage for performance and scalability.

Conhecimentos

SQL

Python

Data analysis

Data visualization

Communication

Problem solving

Ferramentas

AWS

Airflow

Spark

Kafka

Hadoop

Descrição da vaga

Here are the JD -

Data Engineers - SQL/Python/DataEngineer/AWS

DataEngineers who can build scalable, reliabledatapipelines and infrastructure, requiring mastery in SQL, Python/Scala, cloud platforms (AWS), and bigdatatechnologies (Spark, Kafka, Hadoop).

• Key skills include datamodeling, ETL/ELT pipeline construction,datawarehousing and orchestration tools like Airflow. Strong problem-solving, collaboration, anddatagovernance skills are crucial.Collect, process, and analyze largedatasets to extract meaningful insights.
• Design and conduct experiments to test hypotheses and validatedata-driven solutions.
• Collaborate with cross-functional teams to identifydataneeds and align strategies with organizational goals.
• Create templates, dashboards and visualizations to communicate findings effectively to stakeholders.
• Ensuredataintegrity and accuracy through cleaning, preprocessing, and validation techniques.
• Optimizedatacollection and storage processes for efficiency and scalability. Knowledge on Manufacturing process is preferred

Skill Requirements

• 1. Proficient in sql to design and optimize databases, write complex queries, and create stored procedures.
• 2. Strong data analysis skills to extract, clean, and analyze data for business insights and decision-making.
• 3. Experience in python programming for automation, data manipulation, and scripting tasks.
• 4. Knowledge of data visualization tools to present findings in a clear and understandable manner.
• 5. Excellent problem-solving abilities and attention to detail to identify and resolve technical issues efficiently.
• 6. Strong communication skills to collaborate with team members and stakeholders effectively.