Lead Data Engineer - Snowflake
Join a World Class Team of the most innovative minds in technology; engineers who thrive in an evolving, fast-paced, matrix-structured environment that is marked by high energy, flexibility, quick learning, and collaboration The Data Engineer will be responsible for designing and developing high-performance, resilient, automated data pipelines, and data transformation applications that feed our cloud-based Enterprise Data Platform. The Cloud Data Engineer's broad experience with data management technologies will enable matching the right technologies to the required schemas and workloads. You will partner with business users, senior architects, and infrastructure engineers to form complete end-to end-solutions. We are looking for an Engineer who will thrive in an evolving fast-paced environment and bring a work style that is marked by high energy, flexibility, quick learning, and collaboration. Location:
Rosemont, IL, Hooksett, NH, or Hybrid/Remote This is what you day looks like:
Design and build extensible data acquisition and integration solutions to meet the functional and non-functional requirements of the business Designs and implements best in class data ingestion strategies and scalable pipelines, data warehouse and data mart structures Build and maintain serverless data ingestion & refresh pipelines using Azure cloud services - Azure Data Factory, Azure Logic Apps, Azure Functions, Azure Streaming Analytics, Azure Event Hubs, and Azure Databricks Incorporate new data sources from external vendors using streams, flat files, APIs, and databases Leverage data modeling skills to design, and develop dimensional model (Facts, Dimensions) Maintain and provide support for the existing data pipelines using Python, ADF, and SQL Plan & execute using agile methodologies, developing & delivering within predefined sprints Develop real-time / near real-time data ingestion solutions from web API, Kafka, and Event Based technologies Develop and implement tests to ensure data quality across all integrated data sources Eager to explore how machine learning and artificial intelligence can support business objectives The Skills you bring:
Implementation experience with streaming data pipelines that leverage Azure Analytics Products and the Snowflake data platform Implementation Experience with Data Warehousing (data lakes, operational data stores, integration hubs, etc.) and OLTP database management systems Implementation experience with building data solutions in the Snowflake platform and with managing the administration of the Snowflake platform Solid understanding of concepts of cloud computing; Azure Data Architecture preferred Advanced experience with data modeling, table design and mapping business needs to data structures. Experience with Data Architecture / Data Modeling, both Dimensional and Relational Working knowledge of Power BI reporting applications History of working successfully with cross-functional engineering teams Strong organizational and interpersonal skills; Excellent verbal and written communication skills Must be able to effectively handle multiple deliverables simultaneously in a deadline driven environment The Expertise and Education you have:
Bachelor's degree in computer science, engineering, or data science 7
years' experience designing, building, and optimizing data integration architectures across batch, near real-time, and streaming integration requirements 3
years working with Snowflake and Azure Data Lake platforms 4
years with relational databases (Microsoft SQL Server preferred) 2
years with Azure Data Integration services including:
Logic Apps, Azure Functions, Azure Data Factory, Streaming Analytics, Event Hub In-depth SQL, plus Python, R and/or similar analytical languages Experience analyzing data for data quality and supporting the use of data in an enterprise setting Understanding of Restful Web services / Microservices architectures What We Offer:
Choose from multiple health plans, best dental available, first day 401k match, 3 weeks PTO, casual dress code, work from home, employer paid professional development, robust wellness offerings, and volunteer hours. Merchants Fleet is the nation's fastest growing fleet management company, providing flexible funding and service options for organizations that leverage vehicles to run their operations. Merchants Fleet offers comprehensive & customizable fleet solutions, serving as a single source for all vehicle needs. Our programs range from long-term leases to monthly rentals, including unique options such as rent-to-lease and own-to-lease. With over 160,000 managed vehicles nationwide, our expert teams have experience working with nearly every industry, from corporate fleets to last mile delivery to franchise systems. We offer the most high-touch service and innovative experience across the industry, with specialized teams and a FleetTech model that merges fleet with technology to ensure our clients get the best performance out of their fleets. Merchants Fleet is headquartered in Hooksett, New Hampshire, and its Innovation Center is located in the Chicago, Illinois area. Merchants is an award-winning place to work with accolades including; Best & Brightest, Best Company to Work For 2015-2021, Great Place to Work and Coolest Company for Young Professionals. #LI-CC1 To provide all candidates with the highest level of our attention, Merchants Fleet does not accept uninvited solicitations or resumes from third parties.
Salary Range:
$100K -- $150K
Minimum Qualification
Data Science & Machine LearningEstimated Salary: $20 to $28 per hour based on qualifications.
Rosemont, IL, Hooksett, NH, or Hybrid/Remote This is what you day looks like:
Design and build extensible data acquisition and integration solutions to meet the functional and non-functional requirements of the business Designs and implements best in class data ingestion strategies and scalable pipelines, data warehouse and data mart structures Build and maintain serverless data ingestion & refresh pipelines using Azure cloud services - Azure Data Factory, Azure Logic Apps, Azure Functions, Azure Streaming Analytics, Azure Event Hubs, and Azure Databricks Incorporate new data sources from external vendors using streams, flat files, APIs, and databases Leverage data modeling skills to design, and develop dimensional model (Facts, Dimensions) Maintain and provide support for the existing data pipelines using Python, ADF, and SQL Plan & execute using agile methodologies, developing & delivering within predefined sprints Develop real-time / near real-time data ingestion solutions from web API, Kafka, and Event Based technologies Develop and implement tests to ensure data quality across all integrated data sources Eager to explore how machine learning and artificial intelligence can support business objectives The Skills you bring:
Implementation experience with streaming data pipelines that leverage Azure Analytics Products and the Snowflake data platform Implementation Experience with Data Warehousing (data lakes, operational data stores, integration hubs, etc.) and OLTP database management systems Implementation experience with building data solutions in the Snowflake platform and with managing the administration of the Snowflake platform Solid understanding of concepts of cloud computing; Azure Data Architecture preferred Advanced experience with data modeling, table design and mapping business needs to data structures. Experience with Data Architecture / Data Modeling, both Dimensional and Relational Working knowledge of Power BI reporting applications History of working successfully with cross-functional engineering teams Strong organizational and interpersonal skills; Excellent verbal and written communication skills Must be able to effectively handle multiple deliverables simultaneously in a deadline driven environment The Expertise and Education you have:
Bachelor's degree in computer science, engineering, or data science 7
years' experience designing, building, and optimizing data integration architectures across batch, near real-time, and streaming integration requirements 3
years working with Snowflake and Azure Data Lake platforms 4
years with relational databases (Microsoft SQL Server preferred) 2
years with Azure Data Integration services including:
Logic Apps, Azure Functions, Azure Data Factory, Streaming Analytics, Event Hub In-depth SQL, plus Python, R and/or similar analytical languages Experience analyzing data for data quality and supporting the use of data in an enterprise setting Understanding of Restful Web services / Microservices architectures What We Offer:
Choose from multiple health plans, best dental available, first day 401k match, 3 weeks PTO, casual dress code, work from home, employer paid professional development, robust wellness offerings, and volunteer hours. Merchants Fleet is the nation's fastest growing fleet management company, providing flexible funding and service options for organizations that leverage vehicles to run their operations. Merchants Fleet offers comprehensive & customizable fleet solutions, serving as a single source for all vehicle needs. Our programs range from long-term leases to monthly rentals, including unique options such as rent-to-lease and own-to-lease. With over 160,000 managed vehicles nationwide, our expert teams have experience working with nearly every industry, from corporate fleets to last mile delivery to franchise systems. We offer the most high-touch service and innovative experience across the industry, with specialized teams and a FleetTech model that merges fleet with technology to ensure our clients get the best performance out of their fleets. Merchants Fleet is headquartered in Hooksett, New Hampshire, and its Innovation Center is located in the Chicago, Illinois area. Merchants is an award-winning place to work with accolades including; Best & Brightest, Best Company to Work For 2015-2021, Great Place to Work and Coolest Company for Young Professionals. #LI-CC1 To provide all candidates with the highest level of our attention, Merchants Fleet does not accept uninvited solicitations or resumes from third parties.
Salary Range:
$100K -- $150K
Minimum Qualification
Data Science & Machine LearningEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
