Job Title: Data Engineer (4122-1) - Milford or Milwaukee, WI
Job Summary:
- Design, develop, and implement large-scale and medium-scale data warehousing applications.
- Utilize ETL tools such as IBM Infosphere Information Server DataStage, SQL, and Unix for data processing.
- Work with a broad portfolio of AWS Infrastructure tools (EBS, S3, EC2, Elastic IP, Route 53, VPC) and manage cloud infrastructure automation technologies.
- Handle structured, semi-structured, and unstructured data.
- Engage with modern data and analytics architectures, including Big Data and Cloud technologies.
- Use advanced analytics tools such as Python and R.
- Develop scripts (shell, Python, Ruby) for monitoring and automation tasks.
- Create and maintain efficient ETL pipelines for data extraction, transformation, and loading.
- Design and optimize ETL jobs using IBM DataStage, including familiarity with IIS Suite tools like Information Analyzer and Quality Stage.
- Perform performance tuning of ETL jobs and SQL queries.
- Work with various databases including Oracle (10g/9i/8i), DB2, SQL Server, and Teradata.
- Write PL/SQL stored procedures, functions, and packages.
- Proficient in Unix shell scripting and experienced with Unix operating systems.
- Load data from flat files, XML, Oracle, and DB2 into databases, performing various transactions and transformations using DataStage stages.