Data Engineer Sr
Role
Summary:
The Data Engineer Sr. will execute the full development life cycle of integrating data from disparate sources to consolidated repositories such as the operational data store, the data warehouse, and the data lake. Designs and develops data pipelines, data ingestion and ETL processes that are scalable, repeatable and secure. This will be accomplished by collaborating with team members and applying ETL, database and API development skills to devise best in class solutions. We are looking for an experienced, energetic, and entrepreneurial engineer who has successfully imagined, built and launched data integration solutions. Role
Responsibilities:
Strategic Work - 25% Educate and inform yourself and team members about data integration technology solutions and emerging trends Continually participate in visioning exercises and contribute to the data strategy for VCI Operational Work - 75% of time Design, develop, test and deploy data integration solutions based on business requirements Troubleshoot and resolve production issues Implement Data Warehouse data quality processes. Provide solutions where issues are identified Participate in code reviews Continually refine and document data integration best practices Educate end users (where applicable) in the use of metadata and understanding where data originates Identify, evaluate and refine leading-edge data integration tools and methods Build prototypes and POCs Bring a passion to stay on top of tech trends, experiment with and learn new technologies, participate in internal & external technology communities, and mentor other members of the engineering community Collaborate with team members on data integration designs and alternatives Own the development of cross-functional, multi-platform prototypes Work within and across Agile teams to design, develop, test, implement, and support data analytics integration solutions. Document and support deployment activities. Report on status of IT Data Operations products and projects on a regular and timely basis. Ensure the timely resolution of issues. Follow VCI standards and guidelines. Escalate anticipated risks to management promptly and properly. Partner with Domain Architects regarding data integration design options Experience 7-10 years of experience designing, developing and maintaining data integration solutions Education B.S. in Computer Science or related discipline. Advanced degree a plus Specialized Skills Required - Data integration development experience with the following skill sets:
Extract, transformation and load (ETL) of disparate data sources to targets including databases, files and API's. Informatica Power Center preferred Ability to detect, identify and resolve source to target performance / load issues Expert level proficiency in structured query language (SQL) Data Warehousing:
Thorough understanding of relational data models including third normal form and fact / dimension designs Change data capture (CDC) design options and application Data marts Oracle database platform features including indexing, partitioning and PL/SQL Open source integration technologies including Hadoop, Hive, Hue, Spark and Kafka Proficient in Python Linux O/S commands and scripting Secure File Transfer Protocol (SFTP) KanBan and Agile methodologies Desire to work in the data integration space (data warehouse, data lake, AWS, data API's) while continuing to grow skill sets Desired - Modern development practices - e.g. DevOps Experience with open source database platforms such as MySQL and MariaDB Data Lake integration design and development (Informatica Big Data Management a plus) Experience with data quality tools such as SAS Experience with AWS platform :
Kinesis / Firehose, Glue, Redshift, S3, etc AWS Certifications Experience in API development Master data management integration and concepts Experience with job scheduling solutions such asTidal Experience in Financial Services (automotive finance preferable) DataFlux or Informatica IDQ
Salary Range:
$100K -- $150K
Minimum Qualification
Software DevelopmentEstimated Salary: $20 to $28 per hour based on qualifications.
Summary:
The Data Engineer Sr. will execute the full development life cycle of integrating data from disparate sources to consolidated repositories such as the operational data store, the data warehouse, and the data lake. Designs and develops data pipelines, data ingestion and ETL processes that are scalable, repeatable and secure. This will be accomplished by collaborating with team members and applying ETL, database and API development skills to devise best in class solutions. We are looking for an experienced, energetic, and entrepreneurial engineer who has successfully imagined, built and launched data integration solutions. Role
Responsibilities:
Strategic Work - 25% Educate and inform yourself and team members about data integration technology solutions and emerging trends Continually participate in visioning exercises and contribute to the data strategy for VCI Operational Work - 75% of time Design, develop, test and deploy data integration solutions based on business requirements Troubleshoot and resolve production issues Implement Data Warehouse data quality processes. Provide solutions where issues are identified Participate in code reviews Continually refine and document data integration best practices Educate end users (where applicable) in the use of metadata and understanding where data originates Identify, evaluate and refine leading-edge data integration tools and methods Build prototypes and POCs Bring a passion to stay on top of tech trends, experiment with and learn new technologies, participate in internal & external technology communities, and mentor other members of the engineering community Collaborate with team members on data integration designs and alternatives Own the development of cross-functional, multi-platform prototypes Work within and across Agile teams to design, develop, test, implement, and support data analytics integration solutions. Document and support deployment activities. Report on status of IT Data Operations products and projects on a regular and timely basis. Ensure the timely resolution of issues. Follow VCI standards and guidelines. Escalate anticipated risks to management promptly and properly. Partner with Domain Architects regarding data integration design options Experience 7-10 years of experience designing, developing and maintaining data integration solutions Education B.S. in Computer Science or related discipline. Advanced degree a plus Specialized Skills Required - Data integration development experience with the following skill sets:
Extract, transformation and load (ETL) of disparate data sources to targets including databases, files and API's. Informatica Power Center preferred Ability to detect, identify and resolve source to target performance / load issues Expert level proficiency in structured query language (SQL) Data Warehousing:
Thorough understanding of relational data models including third normal form and fact / dimension designs Change data capture (CDC) design options and application Data marts Oracle database platform features including indexing, partitioning and PL/SQL Open source integration technologies including Hadoop, Hive, Hue, Spark and Kafka Proficient in Python Linux O/S commands and scripting Secure File Transfer Protocol (SFTP) KanBan and Agile methodologies Desire to work in the data integration space (data warehouse, data lake, AWS, data API's) while continuing to grow skill sets Desired - Modern development practices - e.g. DevOps Experience with open source database platforms such as MySQL and MariaDB Data Lake integration design and development (Informatica Big Data Management a plus) Experience with data quality tools such as SAS Experience with AWS platform :
Kinesis / Firehose, Glue, Redshift, S3, etc AWS Certifications Experience in API development Master data management integration and concepts Experience with job scheduling solutions such asTidal Experience in Financial Services (automotive finance preferable) DataFlux or Informatica IDQ
Salary Range:
$100K -- $150K
Minimum Qualification
Software DevelopmentEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
