Data Engineer
We are looking for a Data Engineer for a 6 months contract with high possibility of extension. Role is hybrid with 2 days a week Downtown Toronto
Description;
• This role will lead enhancements requested by Investment business partners, including Front Office, Investment Risk, and Investment Operations. They will be providing occasional production support to their core investment data warehouse.
Responsibilities:
• As a key member of the data platform design committee, set guidelines, standards, and best practices for new project initiatives across development and data management teams.
• Design and implementation of data and technology infrastructure for new data and analytics platform with Azure data stack
• Design and build data solutions for distributed ETL processing for all data ingestion into the data platform (dimensional layer) with scalable and usable data pipelines.
• Be the primary liaison and owner for data projects, technical backlog, and managing the delivery solutions with business stakeholders.
• Oversee and build custom web APIs using Azure Function Apps to integrate with external services
• Oversee and develop complex SQL for ETL and data extractions with high-performing and easy-to-manage code.
MUST HAVE;
- ETL with Azure Data Factory experience, building pipelines, with strong experience building Dimensional data warehouses
o Azure Data Factory (ADF)
o Azure Data Lake Storage (ADLS)
o Azure Databricks (ADB)
o Azure Synapse
o Azure Function apps
- Expert in SQL – development from transformation perspective, writing complex SQL queries, views, and procedures
- Strong experience cloud data platforms with Azure data solutions including
- Build processes (plan, design, and implement enhancements end-to-end)
Soft skills:
- Independent worker needing very little guidance after being trained on framework
- Flexible and accommodating with work being done – learn existing practice/framework, can enhance and work with it
- Strong communication skills
Nice Have;
- Power BI
- Snowflake - VERY NICE TO HAVE
- Investment experience