Senior Data Engineer - Build AI Data Platforms (Remote)

Smart Working; Lahore; On-site; PKR 24,979,000 - 41,632,000; Full time

Job summary

Smart Working is hiring a Senior Data Engineer to build and scale data infrastructure powering an AI platform for property management. You will design real-time data pipelines, vector databases and ML data workflows, shaping the data architecture and standards.

As the first senior data hire, you’ll define the data function, establish best practices, and help build the team as the company grows, partnering with founders and product leadership.

Qualifications

• 7+ years of professional data engineering experience.
• Experience designing and building data pipelines and distributed data systems.
• Relational DB experience; PostgreSQL preferred.
• Experience with NoSQL and vector databases.
• Strong Python programming skills.
• Ability to justify architectural decisions.
• Experience building scalable backend systems.
• Experience designing data models and storage architectures.
• Understanding of data processing performance and optimisation.
• Familiarity with Spark, Airflow, Kafka, Elasticsearch/OpenSearch desirable.

Responsibilities

• Architect and build scalable data pipelines and infrastructure to support AI and product systems.
• Design and maintain data ingestion, transformation and storage architectures for operational and AI workloads.
• Develop and manage batch and real-time data pipelines.
• Build and optimise systems for vector search, retrieval and machine learning data pipelines.
• Ensure data reliability, security and governance across the platform.
• Collaborate with AI and backend engineering teams to support training, inference and product features.
• Implement monitoring, observability and data quality frameworks.
• Optimise the performance of large-scale datasets and query systems.
• Contribute to technical architecture decisions and long-term data strategy.
• Act as the founding data hire, defining culture, standards and the hiring bar for the data function as it scales.
• Partner directly with founders and product leadership to translate data capabilities into product decisions.

Skills

Data engineering

Data pipelines

Distributed systems

Python programming

Architectural decisions

Backend scalability

Data modeling

Tools

PostgreSQL

MySQL

NoSQL

Qdrant

Milvus

pgvector

Pandas

Polars

Apache Spark

Apache Airflow

Kafka

Elasticsearch

OpenSearch

MongoDB

Job description

Smart Working is hiring a Senior Data Engineer to build and scale data infrastructure powering an AI platform for property management. You will design real-time data pipelines, vector databases and ML data workflows, shaping the data architecture and standards.

As the first senior data hire, you’ll define the data function, establish best practices, and help build the team as the company grows, partnering with founders and product leadership.