Senior Data Engineer

Paul Hastings LLP

New York (NY)

On-site

USD 135,000 - 195,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical benefits
Dental benefits
Vision benefits
Life/AD&D
Long Term Care
Short- and Long-Term Disability
401(k) Plan
Profit Sharing
Paid Holidays
Parental Leave
Wellbeing program

Job summary

Paul Hastings LLP is seeking a Senior Data Engineer in the United States to design, build and maintain modern data pipelines in the Azure Cloud. The role focuses on delivering clean, timely data for analytics platforms such as Power BI, collaborating with architects, analysts and business stakeholders to ensure scalable, secure data solutions.

Key duties include ELT development, DevOps automation, pipeline observability, and data modeling.

Qualifications

  • 7+ years of data engineering or BI development experience.
  • 3+ years building data solutions in Microsoft Azure Cloud.
  • 2+ years using Azure DevOps for automated builds, releases and pipeline orchestration.

Responsibilities

  • Design, build and manage scalable data pipelines using Azure Databricks.
  • Develop ELT frameworks for ingesting and transforming structured and semi-structured data from on-prem and cloud sources.
  • Implement robust DevOps pipelines for code versioning, testing, deployment and monitoring using Azure DevOps.
  • Collaborate with BI teams to support Power BI datasets and ensure optimal data model performance.
  • Automate environment setup, configuration and permissions using infrastructure-as-code where possible.
  • Write modular, testable code in SQL, Python or PySpark and manage version control with Git.
  • Support production operations, root cause analysis and performance tuning.
  • Maintain technical documentation for pipelines, data mappings and deployment processes.

Skills

Azure Databricks
Azure DevOps
SQL
PySpark
Delta Lake
Git
Power BI

Education

Bachelor’s degree in Computer Science, Engineering or related field

Tools

Azure
Azure Repos
Purview

Job description

Paul Hastings is a leading international law firm that provides innovative legal solutions to many of the world's top financial institutions and Fortune Global 500 companies. With a strong presence throughout the U.S., Asia, Europe, Latin America, and the Middle East, we have the global reach and extensive capabilities to provide personalized service wherever our clients’ needs take us. As one of the world’s leading law firms, we seek dynamic individuals who share our commitment to service, innovation, and professional growth.Job TitleSenior Data EngineerLocationBoston, Chicago, Dallas, Houston, Los Angeles, New York, San Francisco, Washington, D.C.Regular/TemporaryRegularJob Description SummaryWe have an opening for a Senior Data Engineer.The Senior Data Engineer is responsible for designing, building and maintaining modern data pipelines and data integration solutions in the Azure Cloud. This role enables enterprise analytics by delivering clean, timely and well-structured data to platforms such as Power BI. The Senior Data Engineer collaborates closely with architects, analysts, and business stakeholders to deliver scalable, secure and efficient data solutions using Azure Databricks, and Azure DevOps.Job DescriptionIn this capacity, the Senior Data Engineer will:Design, build and manage scalable data pipelines using Azure Databricks;Develop ELT frameworks for ingesting and transforming structured and semi-structured data from on-prem and cloud sources – including cloud based API’s;Implement robust DevOps pipelines for code versioning, testing, deployment and monitoring using Azure DevOps;Ensure pipeline performance, reliability and observability using tools like Azure Monitor and Log Analytics;Collaborate with BI teams to support Power BI datasets and ensure optimal data model performance;Automate environment setup, configuration and permissions using infrastructure-as-code where possible;Write modular, testable code in SQL, Python or PySpark and manage version control with Git;Support production operations, root cause analysis and performance tuning;Understand data sources and data relationship models.Maintain technical documentation for pipelines, data mappings and deployment processes;Work as part of an Agile delivery team, participating in sprints, retrospectives and code review; andMentor junior data engineers and promote best practices in CI/CD, version control, and release management.Proficiencies:Advanced proficiency in Azure Databricks;Experience building and managing CI/CD pipelines in Azure DevOps for data solutions;Strong SQL and ELT experience; familiarity with schema design (e.g., star, snowflake, denormalized);Hands-on expertise with PySpark and Databricks notebooks, including Delta Lake workflows;Familiarity with Git, branching strategies and repository management within Azure Repos;Understanding of data security and privacy best practices in Azure (RBAC, managed identities, encryption);Experience with Power BI dataflows, datasets and refresh configuration (preferred);Familiarity with data cataloging and governance tools (e.g., Microsoft Purview) a plus; andExperience with Agile tools such as Azure Boards or JIRA.Qualifications:Bachelor’s degree in Computer Science, Engineering or related field (required);7+ years of data engineering or BI development experience;3+ years building data solutions in Microsoft Azure Cloud;2+ years using Azure DevOps for automated builds, releases and pipeline orchestration;Proven experience working with structured and semi-structured data (Parquet, JSON, Avro); andExperience in professional services, legal, or financial environments preferred.The salary wage range for Boston that we expect to pay for this position is a minimum of $134,500 and a maximum of $194,750 annually. The actual pay wage may vary based on experience or other relevant factors.The salary wage range for Washington, DC that we expect to pay for this position is a minimum of $125,800 and a maximum of $182,450 annually. The actual pay wage may vary based on experience or other relevant factors.The salary wage range for Los Angeles that we expect to pay for this position is a minimum of $125,800 and a maximum of $182,450 annually. The actual pay wage may vary based on experience or other relevant factors.The salary wage range for San Francisco that we expect to pay for this position is a minimum of $134,500 and a maximum of $194,750 annually. The actual pay wage may vary based on experience or other relevant factors.The salary wage range for New York that we expect to pay for this position is a minimum of $134,500 and a maximum of $194,750 annually. The actual pay wage may vary based on experience or other relevant factors.Employees will be provided with an excellent career opportunity in a collaborative environment, in addition to a generous total compensation package with the opportunity to earn bonuses based on individual contribution and firm profitability.The actual salary offered will depend on a variety of factors, including without limitation, the qualifications of the individual applicant for the position, years of relevant experience, level of education attained, certifications or other professional licenses held, and if applicable, the location in which the applicant lives and/or from which they will be performing the job. This role is exempt meaning it is not overtime pay eligible.Eligible employees can participate in the Firm’s comprehensive benefits program, which include the following:Medical, Dental, Vision, Life/AD&D, Long Term Care, and Short- and Long-Term DisabilityFlexible Spending Accounts and Health Savings AccountHealthcare Concierge and AdvocacyLifestyle Spending AccountVoluntary 401(k) Plan and Profit Sharing10 Paid Holidays per year and a generous PTO ProgramFamily Support including Paid Parental Leave, Fertility Benefits, Breast Milk Shipping, Back-up Child Care, Elder Care, and TutoringWellbeing programs (Employee Assistance Program, Relationship Support, Mental Health, Menopause and Midlife Health and Well-Being Events)Retirement Plan ConsultingAnniversary Bonus ProgramProfessional Development ProgramsTransportation and Commuter BenefitsInternational Travel InsuranceCritical Illness, Hospital Indemnity and Accident InsuranceAuto/Home/Pet InsurancePrepaid Legal InsuranceEmployee DiscountsAnd More!The Firm fosters an open and inclusive work environment that enables us to provide clients with the innovative thinking of teams rich in talent, experience and creativity. We regularly host programs intended to increase cultural competencies and address key topics related to community, opportunity and inclusion. Learn more about our Global Inclusion initiatives here: Global InclusionPaul Hastings is an equal opportunity employer. Pursuant to applicable local law, we will consider qualified applicants with criminal histories in a manner consistent with the requirements of the relevant fair chance ordinance.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Paul Hastings, LLP • New York (NY)

On-site
USD 135,000 - 195,000
Medical, Dental, Vision
Long-term Disability
401(k) Plan & Profit Sharing
+2
Senior Data Analyst, Risk Management and Compliance
Senior Data Analyst, Risk Management and Compliance

Paul Hastings LLP • New York (NY)

On-site
USD 102,000 - 132,000
Comprehensive benefits package
Bonuses based on performance
PTO & holidays
+1
Applications Engineer, Risk and Compliance Systems
Applications Engineer, Risk and Compliance Systems

Paul Hastings LLP • Chicago (IL)

On-site
USD 102,000 - 148,000
Medical coverage
Dental coverage
Vision coverage
+3
Coordinator, Billing Compliance
Coordinator, Billing Compliance

Paul Hastings LLP • California

On-site
USD 57,000 - 80,000
Medical, Dental, Vision
Flexible Spending Accounts
401(k) Plan and Profit Sharing
+2
Conflicts Researcher II
Conflicts Researcher II

Paul Hastings LLP • New York (NY)

On-site
USD 80,000 - 102,000
Medical coverage
Dental coverage
Vision coverage
+3
Specialist, Business Development, Corporate
Specialist, Business Development, Corporate

Paul Hastings LLP • New York (NY)

On-site
USD 92,000 - 117,000
Medical, Dental, Vision coverage
Life/AD&D and Disability benefits
Paid holidays and generous PTO
+1
TMS Senior Enablement Analyst
TMS Senior Enablement Analyst

Paul Hastings LLP • New York (NY)

On-site
USD 102,000 - 141,000
Medical, Dental, Vision
401(k) Plan with Profit Sharing
Paid Holidays and PTO
Data Engineering Senior Manager
Data Engineering Senior Manager

Sidley Austin • Chicago (IL)

Hybrid
USD 148,000 - 211,000
Practice Manager (Structured Credit and Tax)
Practice Manager (Structured Credit and Tax)

Paul Hastings LLP • New York (NY)

On-site
USD 156,000 - 226,000
Medical insurance
Dental insurance
Vision insurance
+15
IT Support Center Supervisor
IT Support Center Supervisor

Paul Hastings LLP • Washington

On-site
USD 95,000 - 135,000
Generous benefits package
Bonus opportunities based on personal/
Paid holidays and PTO