AWS Python Data Quality Engineer - Cloud Ingestion

Trigyn; City of Albany (NY); On-site; USD 110,000 - 140,000; Full time

Job summary

Trigyn Technologies, Inc. is seeking a Software Developer in Albany, NY to support data ingestion, cleaning and analysis. You will modernize data cleaning processes, build cloud data pipelines and collaborate with managers to ensure the right software solutions meet program needs.

The role requires extensive experience with AWS, Python on Linux, data transformation, and technical documentation, with opportunities to present to non-technical audiences.

Qualifications

• Involved with all facets of the software development process, including the research, design, programming, testing and implementation of computer software.
• Candidate is able to provide guidance to large teams and/or has extensive industry experience and is considered at the top of his/her field.
• 84 months experience in designing and implementing scalable cloud-based web applications using AWS.
• 84 months experience with analysis of complex business rules, workflow processes, and re-engineering business processes.
• 84 months experience with data processing and analysis using Python on Linux platform.
• 72 months experience writing transformations with Informatica Data Quality (IDQ) or similar ETL tool.
• 72 months experience with relational and NoSQL databases (like Oracle, Postgres, MongoDB, DynamoDB, etc.) containing large amounts of data (greater than 10 million rows).
• 72 months experience authoring a complete set of technical documentation
• Bachelor’s degree or higher in Computer Science or Information Technology from an accredited institution.

Responsibilities

• Work with teams to modernize data cleaning and transformation processes using version control and collaborative repositories.
• Build, test and maintain data ingestion pipelines in the Cloud
• Work with technical manager to ensure the team implements the correct software solution and the solution will meet the needs of the program.
• Collaborate with your team to design technical solutions.
• Present or demo your work to a non-technical audience,
• Documentation of technical process and code.
• Follow department level, and division level directives, best practices, standards, and methodologies, as appropriate or requested.

Skills

AWS

Python

Data analysis

ETL tooling

NoSQL databases

Technical leadership

Education

Bachelor's degree in Computer Science or Information Technology

Tools

Informatica Data Quality (IDQ)

Oracle

PostgreSQL

MongoDB

DynamoDB

Job description

Trigyn Technologies, Inc. is seeking a Software Developer in Albany, NY to support data ingestion, cleaning and analysis. You will modernize data cleaning processes, build cloud data pipelines and collaborate with managers to ensure the right software solutions meet program needs.

The role requires extensive experience with AWS, Python on Linux, data transformation, and technical documentation, with opportunities to present to non-technical audiences.