Lead Data Engineer

Egen; United States; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Retirement plans

Professional development opportunities

Job summary

Egen is seeking a Senior Data Engineer to join our Nashville team and drive ML and data engineering initiatives. You will design, develop, and deploy robust data solutions that empower data-driven decisions and improve patient outcomes.

Join a cross-functional team leveraging GCP (BigQuery, GCS, Airflow) to transform healthcare data. You will lead projects, optimize SQL, and contribute to CI/CD and Python-based ELT pipelines.

Qualifications

• 5+ years of hands-on experience as a Data Engineer or Data Architect.
• Proven track record leading technical projects and teams.
• Expert proficiency in Google Cloud Platform (GCP) tools: GCS, BigQuery, Cloud Composer/Airflow, Dataproc/Spark.
• Strong data analysis and problem-solving skills.
• Proficiency in a BI tool.
• Advanced SQL skills with tuning.
• Unix/Linux shell scripting experience.
• DBT knowledge.
• Experience with CI/CD pipelines.
• Machine Learning experience.
• Python-based ELT data pipelines.
• GCP BigQuery SQL optimization expertise.

Responsibilities

• Design, architect, and develop GCP data pipelines (ETL/ELT).
• Maintain comprehensive data asset documentation.
• Collaborate with project team to estimate and plan work.
• Attend daily standups and review business requirements with analysts to produce technical designs.
• Deliver robust data solutions to enable data-driven decisions and better patient outcomes.

Skills

SQL

Python (ELT)

CI/CD

Unix/Linux shell

DBT

Machine Learning

BI tools

Data modeling

Tools

GCS

BigQuery

Cloud Composer/Airflow

Dataproc/Spark

Job description

About Egen:

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.

About Egen:

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.

Want to learn more about life at Egen? Check out these resources in addition to the job description.

• "> Meet Egen
• "> Life at Egen
• "> Culture and Values at Egen
• "> Career Development at Egen

About the opportunity:

Are you an experienced Data Engineer ready to make a significant impact on healthcare? Join our dynamic team in Nashville and help us revolutionize patient care through data-driven innovation.

As a Senior Data Engineer, you will play a pivotal role in driving our ML and data engineering initiatives. You will collaborate with cross-functional teams to design, develop, and deploy robust data solutions that enable data-driven decision-making and improve patient outcomes.

About the job:

• Design, architect, develop, support GCP data pipelines to extract, load, and transform data
• Maintain a holistic view of information assets by creating and maintaining artifacts that illustrate how information is stored, processed, and supported (i.e. documentation)
• Work with the project team, estimate and plan the work effort
• Attend daily team standups
• Work with business analysts and project management to review business requirements and and produce technical design specs that will meet the requirements

About you:

• 5+ years of hands-on experience as a Data Engineer or Data Architect
• Proven track record leading technical projects and teams
• Expert proficiency in Google Cloud Platform (GCP) tools, including: Google Cloud Storage (GCS), BigQuery, Cloud Composer/Airflow, Dataproc/Spark
• Strong data analysis and problem-solving skills
• Proficiency in a Business Intelligence (BI) tool
• Advanced SQL skills, including writing, tuning, and interpreting complex SQL queries
• Experience writing and maintaining Unix/Linux shell scripts
• Solid understanding of Data Build Tool (DBT)
• Experience with CI/CD pipelines
• Machine Learning experience
• Proficiency in developing Python-based ELT data pipelines
• Expertise in optimizing GCP BigQuery SQL queries and scripts

Compensation:

Compensation will be commensurate with experience and skills. We offer a competitive salary and benefits package, including health insurance, retirement plans, and professional development opportunities

EEO and Accommodations:

Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.