Senior Data Engineer - Real-Time AI Data Pipelines (Remote)

Smart Working; Peshawar City Tehsil; On-site; PKR 1,800,000 - 3,200,000; Full time

Job summary

Smart Working is seeking a Senior Data Engineer to design and scale data infrastructure powering an AI platform for property management. You will build real-time data pipelines, vector databases and ML data workflows, shaping data architecture and standards.

As the first senior data hire, you will define the data function, establish best practices, and help build the team while collaborating with AI, backend, product and leadership to translate data capabilities into product decisions.

Qualifications

• 7+ years of professional experience in data engineering.
• Strong focus on designing data pipelines and distributed systems.
• Proficient with relational databases (PostgreSQL preferred).
• Experience with NoSQL databases and vector databases used in AI.
• Solid Python programming and data-processing libraries.

Responsibilities

• Architect and build scalable data pipelines and infrastructure for AI/product systems.
• Design data ingestion, transformation and storage architectures for AI workloads.
• Develop batch and real-time data pipelines.
• Build and optimize systems for vector search and ML data pipelines.
• Ensure data reliability, security and governance.
• Collaborate with AI/backend teams to support training and product features.
• Implement monitoring, observability and data quality frameworks.
• Optimize performance of large-scale datasets and queries.
• Contribute to long-term data architecture decisions and strategy.
• Act as founding data hire, defining culture and hiring standards.

Skills

Python

Data pipelines

Distributed systems

PostgreSQL

NoSQL

Vector databases

Spark

Airflow

Kafka

Elasticsearch/OpenSearch

Pandas/Polars

Tools

PostgreSQL

MySQL

NoSQL databases

Vector databases (Qdrant, Milvus, pgvector)

Python

Pandas/Polars

Apache Spark

Apache Airflow

Kafka

Elasticsearch/OpenSearch

Job description

Smart Working is seeking a Senior Data Engineer to design and scale data infrastructure powering an AI platform for property management. You will build real-time data pipelines, vector databases and ML data workflows, shaping data architecture and standards.

As the first senior data hire, you will define the data function, establish best practices, and help build the team while collaborating with AI, backend, product and leadership to translate data capabilities into product decisions.