Data Engineer

IPinfo

Batu Pahat

On-site

MYR 180,000 - 280,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IPinfo seeks a Data Engineer to own end-to-end data pipelines, from messy public datasets to clean signals powering location products. You’ll work within a small, high-leverage team and own code quality, tests, and PRs.

You'll specialize in geospatial data with BigQuery, Python-based tooling, and transparent analytics. Expect ambiguity, rapid learning, and insightful dashboards that illuminate data pipelines for the company.

Qualifications

  • Advanced SQL with window functions, CTEs, performance tuning; BigQuery knowledge is a strong plus.
  • Strong communication skills; ability to discuss complex pipelines and data problems clearly.
  • Track record turning messy, ambiguous data into reliable, interpretable signals; explain your calls.
  • Proven experience as a data scientist or engineer with a public repo, StackOverflow, academia, or strong references.

Responsibilities

  • Maintain and extend BigQuery data pipelines with efficient, transparent code.
  • Work with geospatial data, leveraging geospatial tools and internals of GIS operations.
  • Handle large, inconsistent datasets from public sources and device datasets; extract meaningful signals.
  • Write concise, reproducible records of problems, solutions, and reasoning for internal tracking.
  • Occasionally develop web dashboards to provide visibility into data pipelines.

Skills

Advanced SQL
Communication skills
Data interpretation
Clean-code discipline
Geospatial fundamentals
Fast learning
AI-assisted development

Tools

BigQuery
Python
Geospatial tools

Job description

Data Engineer

This is a demanding role on a small, high-leverage team. You'll be one of a handful of people responsible for the data behind IPinfo's location and context products, working on ambiguous problems with messy inputs and owning your pipelines end to end - including understanding every line you ship.

What you'll do
  • Make sense of large, unfamiliar datasets sourced from publicly-contributed (and therefore inconsistent) datasets like OpenStreetMap and Overture, as well as error-prone device datasets with sometimes dozens of poorly-documented columns. Your job is to wade through these datasets, figure out what is going on, and extract a meaningful signal.
  • Maintain and extend BigQuery data pipelines, writing efficient, transparent code that achieves complex data tasks while avoiding bloat and spaghetti.
  • Work with particular expertise on Geospatial data, knowing the suite of BigQuery geospatial tools like the back of your hand, while dealing with the particular headaches and challenges that geospatial data poses. Occasionally working in python as well.
  • Use AI tooling to move quickly while fully owning every line in your PRs.
  • Communicate problems and solutions clearly using our internal issue-tracking platform; writing concise, reproducible records of the problem, the proposed solutions, and why you made the calls you did, so others can follow and build on them.
  • Work occasionally on web-based dashboards to provide visibility to our data pipelines for data engineers as well as others at the company.
What we're looking for
Must have
  • Advanced SQL - window functions, CTEs, query restructuring for performance, and an understanding of why a query is slow and how to fix it. BigQuery is a strong plus.
  • Strong communication skills - you know how to talk and write about complex problems and data pipelines productively.
  • A track record of turning messy, ambiguous data into reliable, interpretable signals, with the judgment to explain your calls.
  • An internet record of significant experience as a data scientist or engineer, on Github, StackOverflow, in the academic literature or on a personal blog, or strong references to back up a track record on proprietary code bases.
  • Clean-code discipline: you don't ship code without tests, code review, readable abstractions. You prefer subtractive solutions to additive solutions.
  • Fast learning - comfort becoming productive in unfamiliar domains (internet measurement, geospatial reasoning, internal tooling) with little hand-holding.
  • AI-assisted development paired with full ownership - you can read, debug, and defend everything the tools produce.
  • Geospatial fundamentals: coordinate systems, spatial joins, containment, polygon operations.
Nice to have
  • Cloud tooling and workflow orchestration (CI/CD, Docker, Airflow, etc.).
  • JavaScript and web dashboards (e.g. Retool, Mapbox, internal validation and visualization tooling).
  • Exposure to the science of internet measurement: BGP/ASN, rDNS, RTT-based geolocation, CGNAT, mobile vs. fixed-line IP behavior, geofeeds.
  • Strong Python for geospatial data work - comfortable with the data and geospatial stack (pandas, geopandas, shapely) and writing code that holds up in production, not just in a notebook.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Geospatial Data Engineer - End-to-End BigQuery Pipelines
Geospatial Data Engineer - End-to-End BigQuery Pipelines

IPinfo • Batu Pahat

On-site
MYR 180,000 - 280,000
Data Engineer
Data Engineer

Blue Data Digital SDN BHD • Kuala Lumpur

On-site
MYR 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

UpGrowth HR Sdn. Bhd. • Kuala Lumpur

On-site
MYR 90,000 - 130,000
Data Engineer
Data Engineer

Aetherion Dataworks Sdn. Bhd. • Malaysia

On-site
MYR 80,000 - 120,000
Senior Data Engineer
Senior Data Engineer

PERSOL • Kuala Lumpur

On-site
MYR 120,000 - 180,000
Data & Analytics Lead
Data & Analytics Lead

Involve Asia Technologies Sdn Bhd • Kuala Lumpur

On-site
MYR 240,000 - 360,000
Senior Data Engineer
Senior Data Engineer

5G-Starlink Pte. • Malacca City

On-site
MYR 150,000 - 210,000
Senior Data Engineer
Senior Data Engineer

Alliance Bank Malaysia Berhad • Kuala Lumpur

On-site
MYR 120,000 - 180,000
Senior Data Engineer (GCP)
Senior Data Engineer (GCP)

EPAM Systems • Malaysia

On-site
MYR 180,000 - 240,000
Data Analyst
Data Analyst

Publicis Groupe Malaysia • Kuala Lumpur

On-site
MYR 60,000 - 80,000