Lead Data Engineer – Databricks & Big Data Pipelines

Accion Labs

United States

On-site

USD 130,000 - 140,000

Full time

4 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Premium health benefits

65% premiums covered

Job summary

Accion Labs is seeking a senior data professional to design and optimize data architectures, pipelines and warehouses across complex datasets. You will work with SQL and big data tools to build scalable data flows and ensure high performance read/write schemas.

The role requires 12-15+ years of experience with a bachelor’s degree and familiarity with Salesforce/Marketo integrations, Databricks, Hadoop, Spark, Python and Scala. W2 or corp-to-corp options are available.

Qualifications

12-15+ years of related experience with a bachelor’s degree.
Advanced SQL knowledge and experience with relational databases.
Experience building and optimizing big data pipelines and data sets.
In-depth knowledge of DB schemas for read and write performance.
Experience with big data tools: Hadoop, Spark, Python, Scala.

Responsibilities

Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Manipulate, process and extract value from large, disconnected datasets.
Collaborate with cross-functional teams in a dynamic environment.
Support data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday.