A technology solutions firm based in Maharashtra is seeking a skilled Data Engineer to design and maintain data pipelines using Python. The ideal candidate should have strong proficiency in Python and experience with ETL tools. Responsibilities include optimizing workflows, working with structured and unstructured data, and collaborating with Data Analysts and Scientists to enhance data quality. This role is ideal for those looking to thrive in a dynamic environment focused on data integrity and optimal performance.
Qualifications
Strong proficiency in Python is essential.
Experience with ETL tools and data pipeline development is required.
Hands-on experience with multiple SQL dialects is a must.
Responsibilities
Design, develop, and maintain scalable data pipelines using Python.
Build and optimize ETL/ELT workflows.
Collaborate with Data Analysts and Data Scientists.
Skills
Strong proficiency in Python
Experience with ETL tools / data pipeline development
Hands-on experience with SQL (MySQL/PostgreSQL/Oracle/SQL Server)
Experience with AWS / Azure / GCP
Knowledge of Airflow / Luigi / Prefect
Experience with Spark / PySpark
Understanding of Data Warehousing concepts
Familiarity with version control tools like Git
Job description
Responsibilities
Design, develop, and maintain scalable data pipelines using Python
Build and optimize ETL/ELT workflows
Work with structured and unstructured data from multiple sources
Develop data models and ensure data quality & integrity
Collaborate with Data Analysts, Data Scientists, and stakeholders
Optimize database performance and query tuning
Implement data validation and monitoring mechanisms
Required Skills
Strong proficiency in Python
Experience with ETL tools / data pipeline development
Hands-on experience with SQL (MySQL/PostgreSQL/Oracle/SQL Server)