Staff Data Engineer

Nayya; New York (NY); On-site; USD 185,000 - 225,000; Full time

Job summary

Nayya is seeking a Staff Data Engineer to lead the design and implementation of scalable data systems and pipelines. This key role in our innovative environment requires a skilled data expert ready to make significant contributions by developing and optimizing data infrastructure, driving technical strategy, and fostering collaboration across teams.

Qualifications

• 7+ years of experience in data engineering.
• Strong experience with Python, PySpark, RDBMS.
• Proficiency with workflow orchestration tools.

Responsibilities

• Develop a centralized data strategy to improve data access.
• Lead the development of scalable data pipelines.
• Enhance APIs and event-driven architecture for data access.

Skills

Python

PySpark

SQL

Apache Spark

AWS Glue

Terraform

Education

7+ years of experience in data engineering

Tools

Airflow

Apache Hudi

Redshift

Job description

Founded in 2019, Nayya is on a mission to connect people’s most important information, so they can thrive in their health and wealth. Powered by AI and advanced analytics, Nayya’s platform transforms complex benefits experiences into intuitive, seamless, and ongoing interactions—meeting people meeting people's real world needs. As a trusted platform and partner to leading employers, benefits solutions, and HR tech providers, Nayya unlocks long-term value through helping employees live more resilient lives. Backed by strategic investors like ICONIQ, Felicis Ventures, SemperVirens, Workday Ventures, MetLife Nextgen Ventures, and ADP Ventures, Nayya is ushering in the future of health and wealth for all.

About the RoleWe are seeking a highly skilled and motivated Staff Data Engineer to join our growing team at Nayya. In this role, you will lead the design and implementation of scalable data systems and pipelines that power our data extraction and integration services, while also developing a centralized data strategy. You will work on building batch, event processing, and stream processing infrastructure, enhancing our data enrichment services, developing a robust, de-identified analytics platform for our Data Science, BI, and Analytics teams to consume, and enabling our entire organization with data by developing easy access patterns. We are looking for a data expert who thrives in an environment that values impatience, excellence, resilience, and courage—a leader ready to make an immediate impact on our data infrastructure in a fast-paced, high-growth environment.

As a Staff Data Engineer, you will play a key role in shaping our data systems' architecture, reliability, and performance while fostering innovation and collaboration across teams. This position provides an exciting opportunity to drive technical strategy and lead efforts to solidify and scale our data infrastructure.

Objectives and Responsibilities

Technical Leadership & Data Infrastructure

• Centralized Data Strategy: Develop a single source of truth for organizational data, driving data validation, governance, and improved access for analytical and operational use.
• Build, Improve, and Maintain Data Systems: Lead the development of scalable data pipelines that handle high-volume batch and streaming data.
• Data API and Eventing Development: Enhance and maintain APIs and event driven architecture to provide efficient and reliable access to internal and external data consumers.

Anonymization and Tokenization Development

• Build utilities and workflows to de-identify data, link disparate sources, and build a holistic view of entities across data sources.
• Data Enrichment & Integration: Implement data enrichment solutions at scale that interface with third-party data sources to enhance product capabilities.
• Analytics & Reporting Platform: Improve our reporting and analytics platform while treating security and compliance as a top priority.
• Cross-Functional Collaboration: Work closely with product, engineering, business, and infrastructure teams to design solutions that meet evolving business and technical needs. Advocate for data-driven decision making.
• Mentor and Develop: Provide guidance and mentorship to engineers, fostering a culture of continuous learning and growth.
• Lead by Example: Identify and evaluate our current processes, documentation, workflows and governance and make recommendations and plans for improvements. Lead with documentation.
• Optimize Performance: Focus on tuning, performance testing, and optimization of the data platform.
• Innovate with Agility: Embrace a growth mindset, iterating on data infrastructure and processes to ensure scalability and reliability.
• Ensure Security and Scalability: Identify gaps and risk in current infrastructure to solidify the data platform.

Skills and Qualifications

• 7+ years of experience in data engineering, data infrastructure, or related roles.
• Strong experience with Python and PySpark.
• Strong experience with RDBMS.
• Proficiency with workflow orchestration tools (Airflow, Dagster, etc.).
• Experience implementing data pipelines using Apache Spark, AWS Glue, or EMR.
• Expertise in SQL optimization, query performance tuning, and data warehousing.
• Experience with infrastructure as code tools such as Terraform.
• Experience with AWS suite of data engineering managed services and OSS tools.
• Familiar with Domain Driven Design.
• Experience with monitoring and observability frameworks and tools.
• Familiarity with data quality measures, tools, and frameworks.
• Ability to identify tradeoffs for warehousing vs data lake infrastructure and applying solutions to the appropriate use case.
• Ability to communicate highly technical topics to non-technical stakeholders.
• Familiar with common pitfalls in high volume, partitioned data ingestion pipelines such as orphaned records and table locks.

Preferred Qualifications

• Experience with Apache Hudi or similar data lake platforms.
• Experience with provisioning and managing Redshift.
• Experience with federated query engines.
• Experience with data catalogues.
• Experience with claims data.
• Experience with MLOps engineering and best practices.
• Experience with data governance over PHI and other sensitive information.
• Experience in fast-paced startup environments or high-growth companies.

The salary range for New York based candidates for this role is $185,000 - $225,000. We use a location factor to adjust this range for candidates that are located outside of geographic region of our New York office. Placement within the salary band is determined based on experience.

Nayya is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Nayya by 2x

Sign in to set job alerts for “Data Engineer” roles.

Brooklyn, NY $100,000.00-$150,000.00 6 days ago

New York, NY $100,000.00-$150,000.00 4 days ago

New York, NY $46.63-$134,000.00 1 hour ago

Brooklyn, NY $120,000.00-$170,000.00 6 days ago

New York, NY $120,000.00-$170,000.00 4 days ago

New York City Metropolitan Area $119,000.00-$137,000.00 2 weeks ago

New York, NY $130,000.00-$200,000.00 3 weeks ago

New York, NY $170,000.00-$240,000.00 3 months ago

New York, NY $114,000.00-$171,000.00 1 day ago

New York, NY $175,000.00-$230,000.00 2 weeks ago

New York, NY $170,000.00-$250,000.00 2 weeks ago

New York, NY $24,000.00-$72,000.00 1 week ago

Data Engineer III, Go-to-Market Operations

New York, NY $120,000.00-$170,000.00 1 month ago

New York, NY $90,000.00-$130,000.00 3 months ago

Software Engineer, Search Infrastructure

New York, NY $220,000.00-$260,000.00 2 weeks ago

New York, NY $150,000.00-$200,000.00 2 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.