Data Engineer

Orioninnovation

Lawrence Township (NJ)

On-site

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Orion Innovation is seeking a US Data Lead to own end‑to‑end data assets and products on Databricks. You will translate CASA requirements into designed, built, tested, and released data products while coordinating with offshore engineers and vendor partners.

Strong data modeling, SQL, and Python skills are essential, with a track record of delivering complex data solutions. The role emphasizes leadership of distributed teams, data product delivery, and ensuring adherence to data governance and

Qualifications

  • 6-10+ years in data engineering or related field.
  • Proven Databricks experience and data product delivery.
  • Strong SQL and Python, with advanced data modeling skills.
  • Experience with medallion architecture and Unity Catalog.
  • Ability to lead offshore delivery pods and coordinate with vendors.

Responsibilities

  • Lead design, build, UAT, releases of data products on Databricks.
  • Translate business data requirements into technical designs and plans.
  • Produce source-to-target mappings and Bronze-Silver-Gold models.
  • Direct offshore engineering pod in Hyderabad and ensure quality outputs.
  • Guide vendor work and enforce scope, timelines, and standards.
  • Apply CI/CD processes using Git and platform best practices.

Skills

Databricks
Data modeling
SQL
Python
Delta Lake
PySpark
Unity Catalog
Data product development
Stakeholder communication
Offshore team leadership

Tools

Git
Spark SQL

Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

ROLE SUMMARY

The Company's Commercialization Business Insights & Technology (CBI&T) Dat and AI (D&A) New Build team is responsible for executing on prioritized work leveraging Databricks as its data foundation platform. Seeking US Data Lead to manage delivery of these data assets and data products end to end. This position is the technical point of contact for this work, translating business requirements from our Commercialization AI Strategy & Analytics (CASA) business partners into designed, built, tested, and released data products on Databricks. Work with US data team members, other commercialization BI&T stakeholders, company offshore engineers and systems integrator resources. MUST HAVE DATABRICKS EXP, DATA MODELING EXP, AND DATA PRODUCTS EXP.

KEY RESPONSIBILITIES
Data delivery
  • Lead design, build, UAT, releases
  • Partner with CASA data owners, domain leads, and business SMEs to translate data product scope: critical data elements, business rules, metric definitions, grain, aggregation logic, and acceptance criteria into technical design and execution.
  • Produce core design artifacts: source-to-target mappings, analytical requirement documents, Bronze, Silver Gold-layer logical data models.
Technical build and data modeling
  • Hands on understanding of of Databricks tools, (PySpark, Spark SQL, Delta Lake, etc.)
  • Apply platform standards for Unity Catalog cataloging, table design and clustering, performance tuning, data quality controls, and CI/CD through Git.
  • Data Product data modeling
Offshore/Vendor Engagement
  • Day-to-day work of an offshore engineering pod in Hyderabad, India - backlog grooming, task assignment, design review, and code review.
  • Provide technical direction to systems integrator and consulting partners working on the same domains, and hold their deliverables to company standards.
  • Review vendor work products against statement-of-work scope and flag gaps early.
REQUIRED QUALIFICATIONS
  • 6-10+ years in data engineering
  • Databricks experience
  • Strong data product and data modeling skills. Proven experience defining and delivering data products with business stakeholders, not just executing handed-down specifications.
  • Demonstrated hands-on Databricks experience: PySpark, Spark SQL, Delta Lake, and experience with medallion architecture (Bronze/Raw, Silver/Refined, Gold/Published) including what logic belongs in which layer and why.
  • Experience with Unity Catalog: catalogs and schemas, access control, and data classification.
  • Experience leading distributed and offshore teams, with demonstrated ability to get quality output from an India-based delivery pod.
  • Advanced SQL, Python, and a Git-based development workflow.
  • Excellent written and verbal communication; able work independently with business stakeholders
  • Self-directed. This team needs people who can take an ambiguous business ask and drive it to released data products
PREFERRED QUALIFICATIONS
  • Pharmaceutical or life sciences commercial data experience, and familiarity with industry data sources such as IQVIA, Symphony Health, Komodo, Flatiron, specialty pharmacy and distributor data, Veeva CRM, and marketing or digital engagement platforms.
  • Understanding of commercial analytics use cases: field force performance, customer, patient journey and line of therapy
  • Familiarity with data governance concepts: data ownership, stewardship, critical data elements, and data quality frameworks.
  • Experience in a regulated environment with audit, privacy, and access-control requirements

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, \"Orion,\" \"we\" or \"us\") are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (\"Notice\") explains:

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable ter

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Orion Innovation • Lawrence Township (NJ)

On-site
USD 160,000 - 210,000
Azure DB Administrator
Azure DB Administrator

Orioninnovation • Montvale (NJ)

On-site
USD 120,000 - 180,000
Data Architect
Data Architect

Orion Innovation • Woodbridge Township (NJ)

On-site
USD 170,000 - 240,000
206328 - Technical Delivery Manager
206328 - Technical Delivery Manager

Orion Innovation • Montvale (NJ)

On-site
USD 180,000 - 230,000
Databricks Data Engineer - Lead Data Products
Databricks Data Engineer - Lead Data Products

Orion Innovation • Lawrence Township (NJ)

On-site
USD 160,000 - 210,000
Data Solutions Engineer– Pharma (Hybrid- Lawrenceville, NJ)
Data Solutions Engineer– Pharma (Hybrid- Lawrenceville, NJ)

Stage 4 Solutions • Lawrenceville (NJ)

Hybrid
USD 110,000 - 115,000
Health benefits
401(k)
Sr. Data Engineer
Sr. Data Engineer

Orion180 Insurance Services, LLC • Irving (TX)

On-site
USD 140,000 - 190,000
Data Engineer
Data Engineer

Orioninnovation • United States

Remote
USD 110,000 - 170,000
Sr. Data Engineer
Sr. Data Engineer

Orion180 Insurance Services LLC • Irving (TX)

On-site
USD 130,000 - 170,000
Medical, dental, vision
401k
Paid holidays, PTO
Senior Data Platform Engineer
Senior Data Platform Engineer

Arrowhead Pharmaceuticals, Inc. • Madison (WI)

On-site
USD 140,000 - 180,000
Competitive salary
Excellent benefits package