Data Engineer

Orion Innovation; Lawrence Township (NJ); On-site; USD 160,000 - 210,000; Full time

Job summary

Orion Innovation is seeking a US Data Lead to manage end-to-end data products on Databricks for the CBI&T Data & AI New Build team. You will translate business requirements into technical designs, collaborate with CASA data owners, and guide offshore engineers to deliver scalable data assets.

The role requires 6–10+ years in data engineering, Databricks expertise, and strong data modeling capabilities, with excellent communication to partner stakeholders across the business.

Qualifications

• 6–10+ years in data engineering
• Databricks experience
• Strong data product and data modeling skills with business stakeholders
• Hands-on Databricks: PySpark, Spark SQL, Delta Lake; medallion architecture
• Unity Catalog: catalogs, schemas, access control, data classification
• Leading distributed/offshore teams; India-based delivery pod
• Advanced SQL, Python; Git-based development workflow
• Excellent written and verbal communication; able to work independently with stakeholders
• Self-directed; able to translate ambiguous business asks into released data products

Responsibilities

• Data delivery: lead design, build, UAT, releases
• Translate data product scope into technical design and execution
• Produce core design artifacts: source-to-target mappings, analytical requirement docs, Bronze/Silver/Gold models
• Provide technical direction to offshore engineering pod and SI partners
• Review vendor deliverables against SOW and flag gaps early

Skills

Strong data product & data modeling

Advanced SQL

Python

Git-based development workflow

Excellent written & verbal communicate

Tools

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Role Summary

The Company’s Commercialization Business Insights & Technology (CBI&T) Dat and AI (D&A) New Build team is responsible for executing on prioritized work leveraging Databricks as its data foundation platform. Seeking US Data Lead to manage delivery of these data assets and data products end to end. This position is the technical point of contact for this work, translating business requirements from our Commercialization AI Strategy & Analytics (CASA) business partners into designed, built, tested, and released data products on Databricks. Work with US data team members, other commercialization BI&T stakeholders, company offshore engineers and systems integrator resources. MUST HAVE DATABRICKS EXP, DATA MODELING EXP, AND DATA PRODUCTS EXP.

Key Responsibilities

Data delivery

• Lead design, build, UAT, releases
• Partner with CASA data owners, domain leads, and business SMEs to translate data product scope: critical data elements, business rules, metric definitions, grain, aggregation logic, and acceptance criteria into technical design and execution.
• Produce core design artifacts: source-to-target mappings, analytical requirement documents, Bronze, Silver Gold-layer logical data models.

Technical build and data modeling

• Hands on understanding of of Databricks tools, (PySpark, Spark SQL, Delta Lake, etc.)
• Apply platform standards for Unity Catalog cataloging, table design and clustering, performance tuning, data quality controls, and CI/CD through Git.
• Data Product data modeling

Offshore/Vendor Engagement

• Day-to-day work of an offshore engineering pod in Hyderabad, India — backlog grooming, task assignment, design review, and code review.
• Provide technical direction to systems integrator and consulting partners working on the same domains, and hold their deliverables to company standards.
• Review vendor work products against statement-of-work scope and flag gaps early.

Required Qualifications

• 6–10+ years in data engineering
• Databricks experience
• Strong data product and data modeling skills. Proven experience defining and delivering data products with business stakeholders, not just executing handed-down specifications.
• Demonstrated hands-on Databricks experience: PySpark, Spark SQL, Delta Lake, and experience with medallion architecture (Bronze/Raw, Silver/Refined, Gold/Published) including what logic belongs in which layer and why.
• Experience with Unity Catalog: catalogs and schemas, access control, and data classification.
• Experience leading distributed and offshore teams, with demonstrated ability to get quality output from an India-based delivery pod.
• Advanced SQL, Python, and a Git-based development workflow.
• Excellent written and verbal communication; able work independently with business stakeholders
• Self-directed. This team needs people who can take an ambiguous business ask and drive it to released data products

Preferred Qualifications

• Pharmaceutical or life sciences commercial data experience, and familiarity with industry data sources such as IQVIA, Symphony Health, Komodo, Flatiron, specialty pharmacy and distributor data, Veeva CRM, and marketing or digital engagement platforms.
• Understanding of commercial analytics use cases: field force performance, customer, patient journey and line of therapy
• Familiarity with data governance concepts: data ownership, stewardship, critical data elements, and data quality frameworks.
• Experience in a regulated environment with audit, privacy, and access-control requirements

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains

• What information we collect during our application and recruitment process and why we collect it;
• How we handle that information; and
• How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.