Data Engineer II

Crystal Equation Corporation; California (MO); Hybrid; USD 102,000 - 109,000; Full time

Benefits offered by this job

Paid time off

Medical/dental/vision

Life insurance

401K

Parental leave

Job summary

Crystal Equation Corporation is seeking a Data Engineer II for a remote role. You will design and operate scalable data systems, build ETL pipelines, and contribute to architecture decisions within a highly collaborative team.

Expertise in SQL and Python is required, with experience in Airflow and end-to-end project leadership preferred. The ideal candidate will navigate ambiguity, maintain privacy and security considerations, and thrive in a fast-paced startup-like environment while delivering

Qualifications

• Expert-level SQL across Presto, Postgres, MySQL and related forms.
• Expert-level Python.
• Expert-level proficiency using pipelining tools such as Airflow.
• Experience leading data engineering efforts on large cross-functional projects.
• Excellent written and verbal communications.

Responsibilities

• Design, construct, install, test and maintain highly scalable data management systems.
• Ensure systems meet business requirements and industry practices.
• Design, implement, automate and maintain large-scale enterprise data ETL processes.
• Build high-performance algorithms, prototypes, predictive models and proofs of concept.

Skills

SQL

Python

Stakeholder comms

Data pipeline design

Collaborative

Tools

Airflow

Job description

Data Engineer II Remote Summary:

Experienced Data Engineer to support our infrastructure work. This role would be primarily responsible for building and modifying high-complexity pipelines and alerting systems for my team in legal. Beyond years of experience, due to the technical complexity of the role, we'd ideally like to find someone who has experience working on data warehousing and building (+ leading end-to-end projects to build) high-complexity monitoring and alerting systems. We're a very XFN-heavy team, so someone who is very communicative, collaborative, comfortable navigating ambiguity / tenacious in finding answers, and cognizant of privacy/security would do very well in this role.

Responsibilities:

• Design, construct, install, test and maintain highly scalable data management systems.
• Ensure systems meet business requirements and industry practices.
• Design, implement, automate and maintain large scale enterprise data ETL processes.
• Build high-performance algorithms, prototypes, predictive models and proof of concepts.

Minimum Requirements:

• Expert-level SQL (Presto, Postgres, MySQL, etc--any form is fine)
• Expert-level Python
• Expert-level proficiency using pipelining tools (e.g. Airflow, Dataswarm, etc)
• Experience leading DE efforts on large XFN projects with a wide variety of technical and non-technical stakeholders
• Expert-level comms

Preferred Requirements:

• Demonstrated experience using AI to expedite project delivery (or even better--building AI components to help automate workflows for non-technical stakeholders)
• Experience working on projects for highly-regulated industries (e.g. legal, compliance, finance, security, privacy, etc)
• Experience mentoring junior team members
• Experience working in startups / ambiguous environments with a broader scope of work

Pay and Benefits:

Pay range is $74 - $79 per hour with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.

• paid time off
• medical/dental/vision/life insurance
• 401K
• parental leave

THE PROMISES WE MAKE:

At Crystal Equation, we empower people and advance technology initiatives by building trust.

For more information regarding our Privacy Policy, please visit crystalequation.com/privacy.