Data Analytics with financial background

TechDigital Group

Minneapolis (MN)

On-site

USD 80,000 - 140,000

Full time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

An established industry player is seeking a skilled Data Engineer with extensive experience in Big Data technologies and data governance. This role involves architecting and implementing robust data solutions, ensuring data integrity, and optimizing CI/CD processes to enhance production systems. The ideal candidate will possess strong problem-solving skills and a passion for automation, working collaboratively across teams to drive innovation. Join this forward-thinking company and contribute to shaping the future of data infrastructure with your expertise and creativity.

Qualifications

  • 5+ years of experience in data engineering and production systems.
  • Strong coding ability in Python and SQL with Big Data technologies.

Responsibilities

  • Architect and implement data governance processes and tooling.
  • Support stakeholders and optimize code for production systems.

Skills

Data Engineering
Big Data Technologies
Python
SQL
Data Governance
CI/CD Tools
Problem-Solving
Communication Skills

Education

Bachelor's degree in Computer Science

Tools

Hadoop
Hive
Spark
Git
Jenkins
Maven
Chef
Elastic Search

Job description

Job description:

Bachelor's degree in computer science, software engineering, or a similar field.

Experience in the Big Data technologies (Hadoop, Hive, Spark, Nifi, Impala, Looker, Elastic Search etc.).

Experience with performing data analysis, data observability, data ingestion and data integration.

5+ years of relevant data engineering, data infrastructure, DataOps, DevOps, SRE, or general systems engineering experience.

5+ years of experience in running production systems.

2+ years of hands-on experience in industry standard CI/CD tools like Git/BitBucket, Jenkins, Maven, Artifactory, and Chef.

Experience architecting and implementing data governance processes and tooling (such as data catalogs, lineage tools, role-based access control, PII handling).

Strong coding ability in Python or other languages like Java, C#, Golang, C, C++, Perl or Ruby, and a solid grasp of SQL fundamentals.

Experience with algorithms, data structures, scripting, pipeline management, and software design.

Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.

Ability to help debug and optimize code and automate routine tasks.

Ability to support many different stakeholders. Experience in dealing with difficult situations and making decisions with a sense of urgency is needed.

Interest in designing, analyzing and troubleshooting large-scale distributed systems.

Appetite for change and pushing the boundaries of what can be done with automation.

Experience in working across development, operations, and product teams to prioritize needs and to build relationships is a must.

Experience designing and implementing an effective and efficient CI/CD flow that gets code from dev to prod with high quality and minimal manual effort is desired.

Good handle on Change Management and Release Management aspects of Software.

What could set you apart:

Strong Big Data Experience.

Strong Oracle & SQL Experience.

Strong Data Observability Experience.

Operations experience in supporting highly scalable systems.

Self-motivating and creatively solves software problems and effectively keeps the lights on for production systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines
Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines

Compunnel Inc. • Tysons (VA)

On-site
USD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Unisys • McLean (VA)

On-site
USD 120,000 - 180,000
Senior Data & Analytics Engineer
Senior Data & Analytics Engineer

Ycotek Pvt. Ltd. • Minneapolis (MN)

On-site
USD 120,000 - 180,000
Senior Data Engineer: Build Scalable Data Platforms & Analytics
Senior Data Engineer: Build Scalable Data Platforms & Analytics

Compunnel Inc. • Durham (NC)

On-site
USD 100,000 - 130,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Durham (NC)

On-site
USD 100,000 - 130,000
Sr Data Engineer
Sr Data Engineer

MeridianLink, Inc. • United States

On-site
USD 140,000 - 210,000
Big Data Engineer
Big Data Engineer

Vortalsoft Inc • New Jersey

On-site
USD 90,000 - 120,000
Big Data Architect
Big Data Architect

Roberts Recruiting • Framingham (MA)

On-site
USD 120,000 - 150,000
Data Platform Engineer
Data Platform Engineer

Beecruit Pte Ltd • United States

Remote
USD 120,000 - 170,000
Lead Big Data Engineer - Cloud Pipelines & Analytics
Lead Big Data Engineer - Cloud Pipelines & Analytics

Compunnel Inc. • Atlanta (GA)

On-site
USD 120,000 - 150,000