ETL Developer SR

SAN ANTONIO (SAT) - Riverwalk

Brief Summary

                            ETL Developer/Data Engineer Senior 

Senior Level- Minimum 6 years experience

An Data Engineer / ETL senior developer is responsible for developing data flow architectures (designed by an Architect) within various integration patterns for loading analytical structures (DW, DM, ODS etc.), or integrating and migrating applications (EAI). In doing so, he/ she leverages industry-strength data movement technologies such as InfoSphere DataStage,  Informatica PowerCenter, Kafka, Nifi, Spark, or others.  The person must be able to:
•	Utilizing technical expertise; Creates system requirements, performs design and analysis, and coding and unit testing of complex to highly complex system functionality and/or defect correction across multiple platforms.
•	Identifies ideas to improve system performance and impact availability.
•	Resolves complex technical design issues.
•	Configure and customize the chosen ETL tool for client installations.
•	Optimally leverage the ETL tool components for developing efficient solutions for data management, conversion, migration and integration. Develop overall design and determine division of labor across various architectural components (for example ETL tool vs. database).
•	Deploy and customize Standard Architecture components.
•	Mentor client personnel. Train junior staff on the Integration Methodologies and related supplemental solutions.
•	Support development of task plans including schedule and effort estimation, under the guidance of an ETL architect. 

Minimum Requirements:  

Core Data Experience – Must show competency in core data & analytics concepts 
•	Advanced ETL experience using Data Stage
•	Strong ETL performance tuning skills.  The ability to quickly and efficiently analyze and resolve performance issues within variety of operational environments
•	Strong understanding of Data warehousing design concepts/skills
•	Data modeling for data warehouse 3NF & datamarts - star 
•	High level of competency with SQL, including advanced concepts
•	Strong SQL skills including complex query building and query performance tuning
•	Batch Data Movement – ETL (Datastage experience is preferred, but mandatory they have deep knowledge of the concepts)
•	UDB, SQL Server, Oracle, My SQL, Netezza or Teradata database experience
•	Traditional Relational Databases – Prefer DB2/UDB
•	Data analysis skills - ability to dig in and understand complex models and business processes  
•	Strong UNIX shell scripting skills 
•	Proven experience in working directly with business customers
•	Proven problem-solving / problem resolution abilities. 
•	Demonstrated ability to analyze data concerning production volumes, batch schedules, and i/o statistics

Data Engineering Experience
•	Distributed data & compute (partitioning, indexes, access patterns) 
•	Hadoop / Big Data Ecosystem (HDFS/S3, Hive, Spark)
•	NoSQL Platforms & Concepts (Doc Store – Couchbase, Wide Column Store – Cassandra, Graph – Datastax Enterprise Graph)
•	Event-based application patterns & streaming data
•	Kafka
•	Kafka producers & consumers
•	Nifi
•	Java Enterprise Application Development
•	API Development
•	Python
•	Experience in Data Science, Machine Learning, and advanced modeling activities