Data Engineer - End-to-End Pipelines & AI (Remote)

TekWissen LLC; Los Angeles (CA); À distance; USD 120 000 - 160 000; Temps partiel

Résumé du poste

TekWissen Group is seeking a Data Engineer to own the data lifecycle end-to-end for a client project. You will develop, test, and maintain data architectures and pipelines on the client’s stack, ensuring data is correct, timely, secure, and affordable.

You will execute plans and governance practices to protect and maximize data value, with AI assistants aiding efficiency across stages. Remote-first, Bay Area preferred, travel optional for other listed US cities, 12-month temporary assignment.

Qualifications

• 5–10 years of data engineering experience with production pipelines at petabyte scale.
• Bachelor's degree in Computer Science, Engineering or a related field, or equivalent experience.
• Ability to work as part of a team, and independently with minimal direction.
• Excellent written, presentation and verbal communication skills, including stakeholder-facing reporting.
• Collaborates with data architects, modelers, Product Managers and IT team members on project goals.
• Strong productivity tool skills: Google Workspace, Workplace, Google Chat, Wiki, Tasks; Microsoft SharePoint a plus.
• Process certification such as Six Sigma, CBPP, BPM, ISO 20000, ITIL or CMMI

Responsabilités

• Manage data engineering projects through the full cycle, from requirements to production support.
• Identify and shape business initiatives from a data engineering perspective, working with client Product Managers and data scientists.
• Design, build, test and maintain highly scalable data management systems and production pipelines (Python, SQL, Spark, PrestoDB).
• Design, implement, automate and maintain large-scale enterprise ETL processes across capture, move, refine, store and serve layers.
• Orchestrate pipelines with scheduling, retries, backfills and SLAs; ship changes through code review and CI/CD.
• Ensure systems meet business requirements, client privacy policy and data governance standards, including access control and retention.
• Monitor data quality, observability, cost and reliability at every layer; participate in 24/7 on-call rotations and SEV investigations.
• Build high-performance algorithms, prototypes, predictive models and proofs of concept, including AI agents that automate operational work.
• Build datasets, semantic layers and dashboards that give stakeholders self-service access to trusted metrics

Connaissances

Python

SQL

Apache Spark

Airflow

PrestoDB

Bash/shell scripting

Formation

Bachelor's degree in Computer Science, Engineering or a related field, or equivalent experience

Outils

Hive

Pub/Sub

Scribe

Daiquery

Presto

Description du poste

TekWissen Group is seeking a Data Engineer to own the data lifecycle end-to-end for a client project. You will develop, test, and maintain data architectures and pipelines on the client’s stack, ensuring data is correct, timely, secure, and affordable.

You will execute plans and governance practices to protect and maximize data value, with AI assistants aiding efficiency across stages. Remote-first, Bay Area preferred, travel optional for other listed US cities, 12-month temporary assignment.