Coimbatore South, India | Posted on 11/13/2026
ProminentContact India Private Limited was incorporated in August 2020 with just fouremployees. We have envisioned creating a B2B database solution forbusiness accelerators, offering customized data solutions in niche ICP, andnamed it "InFynd." InFynd serves as a one-stop solution for data intelligence.We have since expanded our operations to Coimbatore and Gateshead, UK. Today,we proudly uphold our Vision, Mission, and Core Values as we continue to grow and innovate.
Job Description
- Design,develop, and maintain scalable ETL/ELT data pipelines using Azure DataFactory and Azure Databricks.
- Developdata ingestion and transformation workflows using Python, SQL, andPySpark.
- Workwith Apache Spark and PySpark for large-scale distributed data processing.
- Implementbatch processing, incremental loading, full loading, and Change DataCapture (CDC) mechanisms.
- Integratedata from multiple sources, including relational databases, APIs, andcloud storage.
- Workwith Azure Data Lake Storage Gen2 and Azure Blob Storage.
- Developand optimize data models, fact tables, dimension tables, and datawarehouse structures.
- Performdata cleansing, validation, deduplication, and aggregation.
- Implementand manage workflows using Azure Data Factory and Apache Airflow.
- OptimizeSQL queries, Spark jobs, and data pipelines for better performance.
- Workwith Azure Synapse Analytics and relational databases.
- Implementerror handling, logging, monitoring, and alerting for productionpipelines.
- Manageversion control and CI/CD pipelines using Git, GitHub, and Azure DevOps.
- Troubleshootproduction issues, perform root cause analysis, and provide productionsupport.
- Maintaintechnical documentation and collaborate with cross-functional teams.
Requirements
Programming Languages
- Python,SQL, PySpark.
- Pandas,NumPy, OOP concepts, exception handling, and API integration.
- ApacheSpark and PySpark.
- SparkDataFrames, Spark SQL, transformations, actions, joins, aggregations, andwindow functions.
- Partitioning,caching, and performance optimization.
- Dataingestion, transformation, and migration.
- ChangeData Capture (CDC).
- Incrementalloading and full loading.
- Batchand distributed processing.
Database Technologies
- MicrosoftSQL Server, PostgreSQL, MySQL, and Oracle.
- ComplexSQL queries, indexing, stored procedures, and query optimization.
Data Modeling & Warehousing
- Dimensionaland relational data modeling.
- Factand dimension tables.
- Datanormalization and denormalization.
- Schemadesign and data warehouse development.
Workflow Orchestration & DevOps
- AzureData Factory and Apache Airflow.
- Git,GitHub, Azure DevOps, and CI/CD pipelines.
File Formats
- CSV,JSON, XML, Parquet, and Delta Lake.
- 4-5years of relevant experience in Data Engineering.
- Stronghands-on experience with Azure Data Factory, Azure Databricks, PySpark,Python, and SQL.
- Experiencedeveloping and optimizing scalable data pipelines.
- Goodunderstanding of cloud-based data engineering and data warehousingconcepts.
- Stronganalytical, debugging, and problem-solving skills.
- Goodcommunication and collaboration skills.