Data Engineer

IDR; Oakland (CA); Remote; USD 103,000 - 112,000; Full time

Benefits offered by this job

Medical, Vision, Dental

Competitive compensation

Industry leading organization

Job summary

IDR is seeking a senior Data Engineer for a remote contract with California preference. You will design, build, and maintain scalable data pipelines and ETL/ELT workflows across modern data platforms.

You will work with Spark, PySpark, Databricks, Snowflake, SQL, Informatica, and Palantir Foundry to deliver reliable data products and collaborate with business stakeholders. CI/CD and cloud-native experience are valued.

Qualifications

• BA/BS in Computer Science, MIS, or related field, or equivalent experience.
• 7+ years of data engineering / ETL experience across multiple ecosystems.
• Experience with Spark/PySpark, Databricks, Snowflake, SQL, Informatica, Palantir Foundry.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop and optimize solutions using Spark, PySpark, Databricks, Snowflake, SQL, Informatica, Palantir Foundry.
• Partner with stakeholders to translate requirements into durable data products.
• Apply software engineering practices including unit testing, CI/CD, and source control.
• Support platform modernization and cloud-native data initiatives; guide development teams.

Skills

Data pipelines

ETL/ELT workflows

CI/CD

Stakeholder collaboration

Generative AI awareness

Education

BA/BS in CS or related field

Tools

Palantir Foundry

Spark/PySpark

Databricks

Snowflake

SQL

Informatica

Job description

IDR is seeking a Data Engineer to join one of our top clients for a remote contract opportunity (California preferred) . This role is ideal for a senior Data Engineer who can build and optimize modern data pipelines across multiple ETL/data ecosystems and partner closely with technical and business stakeholders to deliver reliable data products.

Position Overview for the Data Engineer:

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows across modern data platforms
• Develop and optimize solutions using tools such as Spark, PySpark, Databricks, Snowflake, SQL, Informatica, and/or Palantir Foundry
• Partner with stakeholders to understand requirements and translate needs into durable datasets and data products
• Apply software engineering best practices including unit testing, CI/CD, and source control
• Contribute to platform modernization and continuous improvement (cloud-native data platform experience is a plus)
• Support/guide development teams; leadership experience is a plus
• (Nice to have) Contribute to Generative AI initiatives (LLMs, RAG, agentic workflows) and/or geospatial analytics use cases

Requirements for the Data Engineer:

• BA/BS in Computer Science, MIS, or related field (or equivalent experience)
• 7+ years of experience in data engineering / ETL ecosystems (e.g., Palantir Foundry, Spark/PySpark, Databricks, Snowflake, SQL, Informatica)
• Proven experience working across multiple data engineering/ETL ecosystems
• Knowledge of software engineering principles such as unit testing, CI/CD, and source control (preferred)
• (Preferred) Cloud-native data platform experience
• (Preferred) Generative AI experience (LLMs, RAG, agentic workflows)
• (Preferred) Geospatial/spatial analytics experience

Whats in it for you?

• Competitive compensation package
• Full Benefits; Medical, Vision, Dental, and more!
• Opportunity to get in with an industry leading organization.

Why IDR?

• 25+ Years of Proven Industry Experience in 4 major markets
• Employee Stock Ownership Program
• Dedicated Engagement Manager who is committed to you and your success.
• Medical, Dental, Vision, and Life Insurance
• ClearlyRated's Best of Staffing Client and Talent Award winner 12 years in a row.

$75-$81/hr
#LI-REMOTE All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement.  You may access this form here.