Remote Data Engineer: AI-Driven Pipelines & Dashboards

TekWissen ®; New York (NY); Remote; USD 90,000 - 117,000; Full time

Job summary

TekWissen® Group is hiring a Data Engineer for a 12-month temporary assignment to support a major client with end-to-end data pipelines, governance and AI-enabled analytics. This remote role favors candidates in the Bay Area or nearby hubs and is open to other U.S.

locations. You will design, build and maintain scalable data architectures (Python, SQL, Spark, Airflow, PrestoDB) and ensure data quality, security and cost efficiency while collaborating with product managers and data scientists.

Qualifications

• 5–10 years of data engineering experience with production pipelines at petabyte scale.
• Bachelor's degree in Computer Science, Engineering or related field, or equivalent experience.
• Ability to work in a team and independently with minimal direction.
• Excellent written, presentation and verbal communication skills with stakeholder-facing reporting.
• Collaborates with data architects, modelers, Product Managers and IT team members on project goals.

Responsibilities

• Manage data engineering projects through the full cycle, from requirements to production support.
• Identify and shape business initiatives from a data engineering perspective, working with client Product Managers and data scientists.
• Design, build, test and maintain scalable data management systems and production pipelines (Python, SQL, Spark, Presto).
• Design, implement, automate and maintain large-scale ETL processes across capture, move, refine, store and serve layers.
• Orchestrate pipelines with scheduling, retries, backfills and SLAs; ship changes through code review and CI/CD.
• Ensure systems meet business requirements, client privacy policy and data governance standards, including access control and retention.
• Monitor data quality, observability, cost and reliability at every layer; participate in 24/7 on-call rotations and SEV investigations.
• Build high-performance algorithms, prototypes, predictive models and proofs of concept, including AI agents that automate operational work.
• Build datasets, semantic layers and dashboards that give stakeholders self-service access to trusted metrics.

Skills

Python

SQL

Apache Spark

Airflow

PrestoDB

Bash/shell scripting

Education

Bachelor's degree in Computer Science, Engineering or related field

Tools

Scribe

Hive

Job description

TekWissen® Group is hiring a Data Engineer for a 12-month temporary assignment to support a major client with end-to-end data pipelines, governance and AI-enabled analytics. This remote role favors candidates in the Bay Area or nearby hubs and is open to other U.S.

locations. You will design, build and maintain scalable data architectures (Python, SQL, Spark, Airflow, PrestoDB) and ensure data quality, security and cost efficiency while collaborating with product managers and data scientists.