Data Engineer Company Hidden Utilities Columbus, OH 1 Opening 4 weeks ago $1,000 reward per hire

Agility Partners LLC; Columbus (OH); Hybride; USD 12 345 - 678 910; Plein temps

Avantages offerts par ce poste

Medical, Dental, and Vision Insurance

401(k) plan

Life Insurance

Disability coverage

Résumé du poste

A leading utility company in Columbus, OH, is seeking a Data Engineer to work on data pipelines using Azure Data Factory and Databricks. The ideal candidate has a Bachelor's degree and extensive cloud technology experience. This role involves data ingestion, quality testing, and automation in a fast-paced Agile environment, with onsite work 2-3 days per week. Competitive benefits include medical insurance and a 401(k) plan.

Qualifications

• 5+ years of experience in various cloud technologies.
• 6+ years in Enterprise Data Management or Data Engineering role.
• 3+ years building data pipelines using Azure Data Factory, Databricks/Spark.
• 5+ years of data analysis and wrangling experience.

Responsabilités

• Create and maintain the data ingestion and quality testing framework.
• Build and automate data ingestion and aggregation pipelines.
• Set up and improve data quality and audit monitoring.
• Document Data Flow Diagrams and Technical Data Mapping.

Connaissances

Data ingestion

Data transformation

Azure Data Factory

Databricks/Spark

SQL

Data analysis

Formation

Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field

Outils

Snowflake

Kafka

Description du poste

# Data EngineerCompany HiddenUtilitiesColumbus, OHBase pay$12,345 - $678,910or to view salary and company informationOtherContract1 Opening$1,000reward per hire## About this RoleAgility Partners is seeking qualified applicants for a Data Engineer position at one of the largest utility companies in the United States, serving approximately 4 million customers. This is an exciting opportunity to work for a company whose mission is to deliver safe, reliable energy that drives value to their customers. You will be part of a team that supports corporate application integration.* Create and maintain the data ingestion, quality testing, and audit framework.* Build and automate data ingestion, transformation, and aggregation pipelines using Azure Data Factory, Databricks/Spark, Snowflake, and Kafka.* Set up and continuously improve data quality and audit monitoring, as well as alerting.* Evaluate process automation options and collaborate with engineering and architecture teams to review proposed designs.* Demonstrate mastery of build and release engineering principles and methodologies, including source control, branch management, build and smoke testing, archiving, and retention practices.* Enhance and document design principles and best practices by collaborating with Solution and Enterprise Architects.* Respond to SLA-driven production data quality or pipeline issues.* Work in a fast-paced Agile/Scrum environment.* Document Data Flow Diagrams, Data Models, Technical Data Mapping, and Production Support Information for Data Pipelines.## Benefits and PerksReasons to Love It:* Join an organization where people are at the center of everything they do, prioritizing a shift to a greener, more sustainable energy supply.* Onsite work 2-3 days/week in Columbus, OH.* Opportunity to be part of a team focused on code quality and best practices.* Medical, Dental, and Vision Insurance.* 401(k) plan.* Life Insurance.* Disability coverage.## The Ideal CandidateThe ideal candidate would bring the following:* Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field, and 5+ years of experience in various cloud technologies within a large-scale organization.* 6+ years of experience in an Enterprise Data Management or Data Engineering role.* 3+ years of hands-on experience in building data pipelines using Azure Data Factory, Databricks/Spark for Cloud Datalake.* 5+ years of hands-on experience with data analysis and wrangling using Databricks, Python/PySpark, etc.* Expert-level SQL knowledge on databases such as Snowflake, Netezza, Oracle, SQL Server, MySQL, Teradata.* Experience with platform infrastructure and ability to deploy and support pipelines in production.Share this job. Make $1,000.When a friend applies to this position and gets hired, you’ll get credited with a referral reward!\*\*Reward paid upon hire of your candidate according to our Recruiting Agreement Policy (see right).