Forward Deployed Engineer

KPG99 INC; New Jersey; On-site; USD 170,000 - 230,000; Full time

Job summary

KPG99 INC is seeking a senior data engineering and AI application development leader for on-site engagements across NJ/NYC and other client sites. You will design scalable data platforms, build AI-powered applications, and drive production-grade pipelines with robust security and governance.

The role requires deep expertise in Python, PySpark, cloud data platforms, MLOps, and enterprise integration, with strong client-facing and solution- shaping capabilities.

Qualifications

• 10+ years in data engineering, AI application development, and production-grade software engineering.
• Hands-on Python, PySpark, SQL, REST APIs, FastAPI and enterprise integration.
• Experience building AI-powered apps using Claude, RAG, vector databases and semantic search.
• Deep data engineering knowledge: ETL/ELT, batch/streaming pipelines, data quality, lineage and observability.
• Operationalizing MLOps / LLMOps: CI/CD, MLflow, monitoring, deployment automation and production support.
• Cloud data platforms expertise across compute, storage, security, networking and cost optimization.
• Containerization and orchestration: Docker, Kubernetes, CI/CD, Airflow, distributed processing.
• Security governance: IAM/RBAC, encryption, secrets, privacy controls, auditability and compliance.
• Ability to translate business needs into scalable designs and non-functional requirements.
• BFSI domain experience and familiarity with regulatory, security, privacy and resilience needs.

Responsibilities

• Design, develop, and deploy enterprise AI and data applications using Python, PySpark, Claude, SQL and cloud data platforms.
• Lead solution architecture and roadmaps; align with business goals and operational requirements.
• Develop scalable data pipelines (batch and streaming) with quality, observability and DataOps practices.
• Operate MLOps/LLMOps lifecycle: model versioning, CI/CD, monitoring, rollback and production support.
• Provide technical leadership across design, reviews, testing, deployment and runbook creation.
• Collaborate with client teams to map data, processes and success criteria; validate with real data.
• Drive reliability, performance tuning, cost optimization and security governance across data/AI workloads.
• Mentor engineers, support hiring, and share engineering best practices and accelerators.

Skills

Data engineering

AI application development

Python

PySpark

SQL

REST APIs

FastAPI

ETL/ELT

MLOps / LLMOps

Cloud data platforms

CI/CD

Git

Docker

Kubernetes

Airflow

MLflow

IAM/RBAC & security

Education

Bachelor's degree in CS / Engineering / Information Systems

Tools

Git

Docker

Kubernetes

Airflow

MLflow

Job description

NJ/NYC/ Charlotte/Columbus OH/ Pittsburg/Boston/ Malvern PA/Washington DC - (Onsite)

Job Description

• 10+ years of experience in Data Engineering, AI Application Development, Cloud Data Platforms, and Production-grade Software Engineering.
• Strong hands-on expertise in Python, PySpark, SQL, REST APIs, FastAPI, and enterprise application integration.
• Experience designing and building AI-powered applications using Claude, Prompt Engineering, Retrieval-Augmented Generation (RAG), Vector Databases, Semantic Search, and Agentic AI patterns.
• Deep understanding of Data Engineering frameworks, including ETL/ELT, batch and streaming pipelines, data quality, metadata management, lineage, observability, and DataOps practices.
• Experience implementing and operationalizing MLOps / LLMOps capabilities including model lifecycle management, CI/CD pipelines, MLflow, monitoring, deployment automation, rollback, and production support.
• Strong knowledge of cloud and modern data platforms, including compute, storage, integration, orchestration, security, networking, monitoring, and cost optimization services.
• Hands-on experience with Git, Docker, Kubernetes, Airflow, MLflow, CI/CD, and distributed data processing frameworks.
• Strong understanding of enterprise security and governance principles, including IAM/RBAC, encryption, secrets management, privacy controls, auditability, compliance, and secure data access.
• Ability to translate business requirements into scalable solution designs, define non-functional requirements, estimate effort, and drive production-ready implementation.
• Experience working with Banking, Financial Services, or Insurance (BFSI) data environments and familiarity with regulatory, security, privacy, and resilience requirements.
• Strong client-facing consulting skills with experience conducting discovery workshops, solution shaping, rapid prototyping, stakeholder communication, and technical presentations.
• Bachelor’s degree in computer science, Engineering, Information Systems, Data Management, or a related discipline.
• Preferred certifications in Cloud Platforms, Kubernetes, AI Engineering, MLOps, Data Engineering, Enterprise Architecture, Security, or Program Delivery.
• Experience working in a forward-deployed delivery model by embedding with client SMEs, business users, and engineering teams through solution validation, production deployment, adoption, and handover.
• Strong hands-on data discovery skills, including profiling unfamiliar client data with Python, pandas, PySpark, and SQL; assessing coverage and quality; and quantifying volumes, distributions, edge cases, and business-process gaps before development.
• Ability to rapidly build thin working solutions using real client data and APIs, validate them with users, and iteratively harden them with automated tests, security controls, error handling, observability, and production support procedures.
• Experience creating business-relevant evaluation datasets with client SMEs, measuring ML or LLM quality, performing structured error analysis, grouping failures by root cause, and prioritizing improvements across releases.
• Demonstrated production ownership after go-live, including monitoring, incident diagnosis, rollback, stabilization, performance and latency troubleshooting, and resolution of user-reported issues.
• Ability to measure user adoption and business impact after launch using usage data and agreed KPIs such as time saved, error reduction, straight-through processing, quality improvement, or productivity gains.
• Willingness and ability to travel or work onsite with client teams when an engagement requires close collaboration and accelerated delivery.
• Design, develop, and deploy enterprise-grade AI and data applications using Python, PySpark, Claude, SQL, APIs, and modern cloud-based data platforms.
• Engage with business and technology stakeholders to understand business objectives, data landscape, functional requirements, non-functional requirements, and delivery expectations.
• Define solution architecture, implementation roadmaps, and technical approaches that align with business goals and operational requirements.
• Architect scalable data platforms, data pipelines, and AI solutions with a strong focus on performance, security, reliability, and cost optimization.
• Develop batch, real-time, and streaming data processing solutions integrating multiple enterprise data sources and downstream applications.
• Build and operationalize Claude-powered applications, copilots, and AI workflows using prompt engineering, Retrieval-Augmented Generation (RAG), vector search, and enterprise data integration.
• Implement responsible AI practices, including governance, security, privacy, traceability, validation, and human oversight controls.
• Design and enforce engineering standards, reusable frameworks, CI/CD practices, infrastructure automation, and production deployment patterns.
• Provide technical leadership across solution design, code reviews, architecture reviews, testing, deployment, and production support activities.
• Drive platform reliability, performance tuning, observability, incident resolution, and operational excellence across data and AI workloads.
• Collaborate closely with architects, data engineers, AI specialists, platform teams, and client stakeholders to deliver production-ready solutions.
• Support solutioning, RFP responses, technical demonstrations, effort estimation, and client workshops for new opportunities.
• Develop reusable accelerators, reference architectures, implementation playbooks, and engineering best practices to improve delivery efficiency.
• Mentor engineering teams and contribute to hiring, capability development, technical assessments, and knowledge-sharing initiatives.
• Embed with client SMEs, product owners, and engineers for a defined, time-bound outcome; map the workflow, users, data, constraints, and decision points; and agree on the first useful release and measurable success criteria.
• Analyze client data early to assess coverage, quality, volumes, distributions, edge cases, and process feasibility before committing to solution design and build scope.
• Build a thin working version quickly on real data and APIs, validate it with business users, and harden it iteratively for security, reliability, maintainability, and production operations.
• Create evaluation datasets with client SMEs, perform model and LLM error analysis. and suggest improvements.
• Resolve data-access, API, identity, network, security, infrastructure, and deployment blockers in partnership with client data, platform, security, and engineering teams.
• Own post-go-live stabilization by monitoring services, diagnosing user-reported failures, latency and cost issues, executing rollback or recovery where required, and shipping fixes.
• Measure adoption and realized business impact using usage data and agreed KPIs, and communicate results through concise dashboards, demonstrations, or executive summaries.
• Complete structured handover with runbooks, support ownership, knowledge transfer, and reusable components, test documents, and deployment patterns.

Generic Managerial Skills, If any

• Strong problem-solving and decision-making abilities with a balanced focus on business outcomes, technology strategy, security, scalability, and operational excellence.
• Excellent communication, presentation, and stakeholder management skills, with the ability to engage effectively with business, technical, and executive audiences.
• Strong consulting mindset with the ability to analyze complex challenges, recommend practical solutions, and clearly articulate architectural trade-offs.
• Proven ability to lead and influence cross-functional, distributed teams in a collaborative and fast-paced delivery environment.
• High level of ownership, accountability, attention to detail, and commitment to engineering quality and delivery excellence.
• Strong planning, prioritization, and multitasking skills with the ability to manage multiple initiatives, stakeholders, and delivery commitments simultaneously.
• Ability to mentor engineers and architects, foster knowledge sharing, and drive adoption of engineering best practices.
• Adaptability and resilience to work effectively in rapidly evolving technologies, business priorities, and client environments.