Search Jobs

Data Engineer (Closed)

About the Company

Our client is a global fresh item management software company, and they are looking for a Data Engineer to join their team.

About the Opportunity

• The Data Engineer will work with data scientists and team to bring in client data from on-prem, databases, and cloud into a single data link in Azure, and then assist the Data Science team in running predictions, AI, learnings, etc.
• The Data Engineer will also check the new data coming in, ensure the data pipelines are working well, and work with the Data Science team to see if there are new requirements or experiments required
• An example could be that there is a big weather event coming, and looking at data to see how it would affect retail stores in a geographic area, and how they would need to scale up systems to address this
• Power BI is extensively used for the visualization layer, and the Data Engineer will do more than just move the data, but can understand Azure Analytics, provision the services and operate it

About You

• 5+ years working in Azure Platform
• Strong exposure to Azure Synapse Analytics
• Working Experience with Azure data stack/ecosystem is required - i.e., Azure Data Lake,Azure Data  Factory, Azure Synapse, etc.
• Experience with Power BI and Power Query is required
• Strong understanding of data warehouse/data lake design patterns and best practices (e.g. data lake zones, partitioning, delta tables, etc.)
• Strong understanding of data ingestion (batch, micro-batch, and streaming)
• Advanced knowledge of cloud infrastructure management and automation while working with massive data volumes
• Good understanding of ML and AI concepts
• 5+ years of experience in managing data pipeline, ETL Development, and Data Warehousing is an asset
• Strong foundational knowledge of relational databases (e.g. SQL Server) and experience with NoSQL stores (Elasticsearch, Redis, MongoDB, etc.) is an asset
• Experience in operationalization of Machine Learning projects (MLOps) using at least one of the popular frameworks or platforms (e.g., Azure Machine Learning, ML Flow) is an asset
• Exposure to Terraform Flow (need to be willing to learn) is an asset

Salary

$130,000/year

How to Apply

Click the “Apply Now” button and follow the instructions to submit your resume. Please know that we only accept documents in MS Word or Rich Text formats. When referencing this job, quote # 283634.

You must currently reside within the Greater Toronto Area and be permitted to work in Canada to be considered for this opportunity. A recruiter will be in touch with you if your profile meets our client’s requirements for this role.