Senior Python Data Engineer

Convo; Islamabad; On-site; PKR 3,000,000 - 5,400,000; Full time

Benefits offered by this job

Medical benefits

Free lunch

Performance-based raises

Lean & agile culture

Job summary

Convo is seeking a Python Data Engineer with 3+ years of production data engineering experience to own and optimize data pipelines. You will work with Python, SQL, Airflow or Azure Data Factory, Spark, and focus on data quality, schema validation, and monitoring to ensure freshness and reliability.

You will troubleshoot pipeline incidents, implement automated checks, and contribute to scalable data platforms.

Qualifications

• 3+ years of production data engineering or data-pipeline operations.
• Strong Python and SQL for data engineering.
• Experience with Airflow/Azure Data Factory or comparable.
• Knowledge of Spark and distributed data processing.
• Experience with data-quality and schema-validation.
• Experience with monitoring, incident triage and root-cause analysis.
• Version control, automated testing and controlled deployment practices.

Responsibilities

• Maintain and enhance Python/SQL pipelines orchestrated through Airflow, Azure Data Factory or equivalent.
• Implement schema, completeness, freshness and reconciliation checks.
• Diagnose and resolve pipeline failures, data-quality incidents and performance regressions.
• Support Spark jobs and incremental data-processing patterns.
• Add monitoring, structured logging and actionable alerts.
• Document fixes, recurring failure patterns and operational procedures.

Skills

Python

SQL

Airflow

Azure Data Factory

Spark

Data quality

Schema validation

Monitoring

Tools

Databricks

Delta Lake

Job description

Job Summary

Convo is looking for Python Data Engineers with 3+ years of experience in production data engineering and pipeline operations. The ideal candidate should have strong expertise in Python, SQL, Airflow/Azure Data Factory, Spark, data quality, schema validation, and monitoring, with the ability to troubleshoot pipeline issues, maintain reliable data workflows, and ensure data quality, freshness, and operational stability.

Technical mission

Maintain data pipelines, implement schema-validation automation and resolve operational incidents within the approved platform architecture.

Key Responsibilities

• Maintain and enhance Python/SQL pipelines orchestrated through Airflow, Azure Data Factory or equivalent.
• Implement schema, completeness, freshness and reconciliation checks.
• Diagnose and resolve pipeline failures, data-quality incidents and performance regressions.
• Support Spark jobs and incremental data-processing patterns.
• Add monitoring, structured logging and actionable alerts.
• Document fixes, recurring failure patterns and operational procedures.

Required Technical Capabilities

• Minimum experience: 3+ years in production data engineering or data-pipeline operations using Python and SQL.
• Production Python and SQL for data engineering.
• Airflow, Azure Data Factory or comparable workflow orchestration.
• Working knowledge of Spark and distributed data-processing concepts.
• Data-quality and schema-validation implementation.
• Monitoring, incident triage and root-cause analysis.
• Version control, automated testing and controlled deployment practices.

Preferred Experience

• Databricks, Delta Lake and cloud storage patterns.
• On-call or production-support experience for data platforms.
• CPG, retail or enterprise-source data.

Expected deliverables / acceptance evidence

• Stable pipelines meeting agreed freshness and quality thresholds.
• Automated validation and monitoring coverage.
• Closed incidents with documented root cause and preventive action.
• Updated runbooks and maintainable handover documentation.

Primary Interfaces

Works with Senior Data Engineers, Telemetry Support, connector teams and platform operations.

What We Have For You

• Great compensation package, medical benefit for you and your family, free lunch, annual performance-tied increments & performance recognition awards and a great lean and agile work culture!
• Convo endorses a culture of diversity in all aspects and aims to build a diverse team of amazing individuals!