Data Engineer

Orioninnovation; Lawrence Township (NJ); On-site; USD 150,000 - 210,000; Full time

Job summary

Orion Innovation is seeking a US Data Lead to manage end-to-end data assets and products on Databricks. You will translate CASA business requirements into designed, built, tested, and released data products, coordinating with offshore engineers and SI partners.

Lead design and delivery across Bronze/Silver/Gold data layers, applying Unity Catalog and Delta Lake standards, with strong data modeling and SQL/Python skills to drive business impact.

Qualifications

• Six to ten+ years in data engineering.
• Databricks experience with data products.
• Strong data product and data modeling skills.
• Advanced SQL and Python; Git-based development.

Responsibilities

• Lead design, build, UAT, and releases of data products.
• Translate data product scope into technical design and execution with stakeholders.
• Produce core design artifacts: mappings, requirements, and data models (Bronze/Silver/Gold).
• Hands-on Databricks work: PySpark, Spark SQL, Delta Lake, Unity Catalog usage.
• Coordinate offshore delivery with Hyderabad engineering pod and SI partners, ensuring quality and adherence to scope.

Skills

Data engineering

Databricks

Data modeling

SQL

Python

Git

Team leadership

Communication

Self-management

Pharma/Life sciences data

Data governance

Regulatory/compliance data

Tools

Unity Catalog

Delta Lake

Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

ROLE SUMMARY

The Company's Commercialization Business Insights & Technology (CBI&T) Dat and AI (D&A) New Build team is responsible for executing on prioritized work leveraging Databricks as its data foundation platform.Seeking US Data Lead to manage delivery of these data assets and data products end to end. This position is the technical point of contact for this work, translating business requirements from our Commercialization AI Strategy & Analytics (CASA) business partners into designed, built, tested, and released data products on Databricks.Work with US data team members, other commercialization BI&T stakeholders, company offshore engineers and systems integrator resources.MUST HAVE DATABRICKS EXP, DATA MODELING EXP, AND DATA PRODUCTS EXP.

KEY RESPONSIBILITIES

Data delivery

• Lead design, build, UAT, releases
• Partner with CASA data owners, domain leads, and business SMEs to translate data product scope: critical data elements, business rules, metric definitions, grain, aggregation logic, and acceptance criteria into technical design and execution.
• Produce core design artifacts: source-to-target mappings, analytical requirement documents, Bronze, Silver Gold-layer logical data models.

Technical build and data modeling

• Hands on understanding of of Databricks tools, (PySpark, Spark SQL, Delta Lake, etc.)
• Apply platform standards for Unity Catalog cataloging, table design and clustering, performance tuning, data quality controls, and CI/CD through Git.
• Data Product data modeling

Offshore/Vendor Engagement

• Day-to-day work of an offshore engineering pod in Hyderabad, India - backlog grooming, task assignment, design review, and code review.
• Provide technical direction to systems integrator and consulting partners working on the same domains, and hold their deliverables to company standards.
• Review vendor work products against statement-of-work scope and flag gaps early.

REQUIRED QUALIFICATIONS

• 6-10+ years in data engineering
• Databricks experience
• Strong data product and data modeling skills. Proven experience defining and delivering data products with business stakeholders, not just executing handed-down specifications.
• Demonstrated hands-on Databricks experience: PySpark, Spark SQL, Delta Lake, and experience with medallion architecture (Bronze/Raw, Silver/Refined, Gold/Published) including what logic belongs in which layer and why.
• Experience with Unity Catalog: catalogs and schemas, access control, and data classification.
• Experience leading distributed and offshore teams, with demonstrated ability to get quality output from an India-based delivery pod.
• Advanced SQL, Python, and a Git-based development workflow.
• Excellent written and verbal communication; able work independently with business stakeholders
• Self-directed. This team needs people who can take an ambiguous business ask and drive it to released data products

PREFERRED QUALIFICATIONS

• Pharmaceutical or life sciences commercial data experience, and familiarity with industry data sources such as IQVIA, Symphony Health, Komodo, Flatiron, specialty pharmacy and distributor data, Veeva CRM, and marketing or digital engagement platforms.
• Understanding of commercial analytics use cases: field force performance, customer, patient journey and line of therapy
• Familiarity with data governance concepts: data ownership, stewardship, critical data elements, and data quality frameworks.
• Experience in a regulated environment with audit, privacy, and access-control requirements

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.