Senior Data Engineer: Real-Time Edge Pipelines

Motion Ventures; Islamabad; On-site; PKR 33,315,000 - 52,748,000; Full time

Job summary

ShipIn Systems is seeking a Senior Data Engineer to own end-to-end data pipelines running on-premises aboard vessels and integrated with AWS cloud services. You will design, implement, and optimize real-time streaming and batch processing of high-volume video and telemetry data, ensuring reliability in constrained environments.

You will collaborate with CV and ML teams to deploy models at the edge and drive architectural redesigns while maintaining 24/7 uptime and strong cross-functional

Qualifications

• 5+ years of experience designing and operating production data pipelines.
• Strong Python proficiency - this is your primary language day to day.
• Hands-on experience with PostgreSQL or equivalent relational databases.
• Solid understanding of integrating ML models into large-scale production environments.
• Comfort working across hybrid architectures (on-prem + cloud), ideally including AWS.
• Strong communication and collaboration skills.

Responsibilities

• Design, implement, and optimize data pipelines running in on-prem, vessel-based environments — with a focus on performance, reliability, and real-time throughput.
• Own the full pipeline lifecycle: from maintaining and stabilizing existing systems to driving architectural redesigns and optimizations.
• Develop high-performance pipelines for both stream and batch processing of large-scale video and telemetry data.
• Integrate on-prem pipeline infrastructure with AWS cloud services — covering deployment workflows and publishing pipeline output to the cloud.
• Collaborate with ML and computer vision engineers to deploy and operationalize models in real-time, resource-constrained edge environments.
• Partner with DevOps, product managers, and algorithm teams to build the infrastructure needed to support new product features and improve system performance.
• Write clean, maintainable Python code; participate in design and code reviews with high quality standards.
• Troubleshoot and resolve pipeline issues quickly, minimizing downtime on systems that run 24/7 at sea.
• Stay current with developments in data engineering and proactively apply them to improve existing processes.

Job description

ShipIn Systems is seeking a Senior Data Engineer to own end-to-end data pipelines running on-premises aboard vessels and integrated with AWS cloud services. You will design, implement, and optimize real-time streaming and batch processing of high-volume video and telemetry data, ensuring reliability in constrained environments.

You will collaborate with CV and ML teams to deploy models at the edge and drive architectural redesigns while maintaining 24/7 uptime and strong cross-functional