Senior Data Engineer

Talentify; Kansas City (MO); On-site; USD 120,000 - 160,000; Full time

Job summary

Netsmart is seeking an experienced Data Engineer to design, optimize, and lead complex data pipelines and integration strategies that support advanced analytics and scalable data platforms.

You will collaborate with cross-functional teams, drive automation and scalability, and shape data governance policies while leveraging Hadoop, Spark, Kafka, and cloud services across Azure, AWS, or GCP.

Qualifications

• Bachelor's degree or higher in CS/Info Management or related field.
• 5+ years in data engineering or related roles.
• Proficiency in Python, Java, Scala and expert-level SQL.
• Extensive experience with big data tech (Hadoop, Spark, Kafka) and cloud (Azure/AWS/GCP).
• Proven ability to design large-scale data warehousing and data modeling with ETL tools.

Responsibilities

• Design, implement, and optimize complex data pipelines using SQL, ETL tools, and integration technologies.
• Collaborate with cross-functional teams for advanced analytics and data science initiatives.
• Lead process improvements for data delivery, automation, and scalable infrastructure.
• Evaluate emerging data technologies to build comprehensive data integration strategies.
• Lead technical discovery and define complex data requirements and scenarios.
• Develop and maintain data governance policies and procedures.

Skills

Python

Java

Scala

SQL

Education

Bachelor's degree in Computer Science/Information Management

Tools

Hadoop ecosystem

Spark

Kafka

Azure

AWS

GCP

Job description

Design, optimize, and lead complex data engineering solutions, pipelines, and integration strategies to support advanced analytics and scalable enterprise data platforms.

RESPONSIBIETIES

• Design, implement, and optimize complex data pipelines using advanced SQL, ETL tools, and integration technologies.
• Collaborate with cross-functional teams to implement optimal data solutions for advanced analytics and data science initiatives.
• Spearhead process improvements, including automation, data delivery optimization, and infrastructure redesign for scalability.
• Evaluate and recommend emerging data technologies to build comprehensive data integration strategies.
• Lead technical discovery processes, defining complex requirements and mapping out detailed scenarios.
• Develop and maintain data governance policies and procedures.

QUALIFICATIONS Required

• Bachelor's degree in Computer Science, Information Management, or related field
• At least 5 years of experience in data engineering or related roles.
• Advanced proficiency in multiple programming languages (e.g., Python, Java, Scala) and expert-level SQL knowledge.
• Extensive experience with big data technologies (Hadoop ecosystem, Spark, Kafka) and cloud-based environments (Azure, AWS, or GCP).
• Proven experience in designing and implementing large-scale data warehousing solutions.
• Deep understanding of data modeling techniques and enterprise-grade ETL tools.
• Demonstrated ability to solve complex analytical problems.

Preferred

• Experience in the healthcare industry, including clinical, financial, and operational data.
• Knowledge of machine learning and AI technologies and their data requirements.
• Familiarity with data visualization tools and real-time data processing.
• Understanding of data privacy regulations and experience implementing compliant solutions.

Netsmart is proud to be an equal opportunity workplace and is an affirmative action employer, providing equal employment and advancement opportunities to all individuals. We celebrate diversity and are committed to creating an inclusive environment for all associates. All employment decisions at Netsmart, including but not limited to recruiting, hiring, promotion and transfer, are based on performance, qualifications, abilities, education and experience. Netsmart does not discriminate in employment opportunities or practices based on race, color, religion, sex (including pregnancy), sexual orientation, gender identity or expression, national origin, age, physical or mental disability, past or present military service, or any other status protected by the laws or regulations in the locations where we operate.

Netsmart desires to provide a healthy and safe workplace and, as a government contractor, Netsmart is committed to maintaining a drug-free workplace in accordance with applicable federal law. Pursuant to Netsmart policy, all post-offer candidates are required to successfully complete a pre-employment background check, including a drug screen, which is provided at Netsmart’s sole expense. In the event a candidate tests positive for a controlled substance, Netsmart will rescind the offer of employment unless the individual can provide proof of valid prescription to Netsmart’s third party screening provider.

If you are located in a state which grants you the right to receive information on salary range, pay scale, description of benefits or other compensation for this position, please use this form to request details which you may be legally entitled.

All applicants for employment must be legally authorized to work in the United States. Netsmart does not provide work visa sponsorship for this position.

Netsmart's Job Applicant Privacy Notice may be found here.