Job Information
Ontario Power Generation Data Engineer in Oshawa, Ontario
Data Engineer
Location:
Oshawa, ON, CA, L1H 8W8
Req ID: 48424
Status: Full Time, Permanent
Education Level: 4-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.
Location(s): Pickering, ON
Travel: 10%
Deadline to Apply: September 18, 2024.
Salary Range: $1,651.02 - $2,832.86 Per Week
Electrify your career and help build a brighter tomorrow.
Every generation has a challenge that defines them. At OPG, we are calling on all innovators, disruptors, thought leaders and change-makers. Join us to electrify life in one generation and build a sustainable future powered by our electricity, our ideas, and our people. Join OPG and make history.
Whether you work in the skilled trades or are a business professional, a career at OPG is an opportunity to electrify your life on -- and off -- the job.
ACCOMMODATIONS
OPG is committed to fostering an inclusive, equitable, and accessible environment where all employees feel valued, respected, and supported. If you require accommodation during the application or interview process, please advise us as soon as possible so appropriate arrangements can be made.
If you requireinformationin a format that is accessible to you, please contact AODA@opg.com
This position is moving to OPG Corporate Headquarters: In Summer 2025, OPG will officially welcome employees to our new Corporate Headquarters located at 1908 Colonel Sam Drive, Oshawa, Ontario. This new space will enable teamwork, collaboration and innovation that will help us to achieve our mission to electrify life in one generation. This position will be temporarily based in Pickering, ON until the move to Headquarters in the Summer of 2025.
JOB OVERVIEW
Ontario Power Generation (OPG) is looking for dynamic, strategic, and results-driven professional to join our team in the role of a Data Developer.
Reporting to the Senior Manager, IT Programs, the Data Developer is primary responsible for building and supporting the data driven applications which enable innovative, customer centric digital experiences. You will be working as part of a cross-discipline agile team who help each other solve problems across all business areas. You will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation. You will employ best practice in development, security and accessibility to achieve the highest quality of service for our customers.
KEY ACCOUNTABILITIES
Build and productionize modular and scalable data ELT/ETL pipelines and data infrastructure leveraging the wide range of data sources across the organization
Implement curated common data models that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect
Work closely with infrastructure and cyber teams to ensure data is secure in transit and at rest
Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle
Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods
Troubleshoot issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity
Collaborate with business analysts, data scientists, data engineers, data analysts, solution architects and data modelers to develop data pipelines to feed our data marketplace
Assist in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI
Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban/SCRUM toolsets
Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use
Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats
Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base
Implement orchestration of data pipeline execution to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use
Create tooling to help with day to day tasks, and reduce toil via automation wherever possible
Work with Continuous Integration/Continuous Delivery and DevOps pipelines to automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning
Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis
Implement and manage appropriate access to data products via role-based access control
Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases
Participate in peer code review sessions, and approve non-production pull requests
Other Duties as Required
EDUCATION
- 4-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artifical intelligence, or machine learning
QUALIFICATIONS
Minimum 6 years experience with Data Engineering
Experience as a Data Engineer building data pipelines.
Fluent in creating data processing frameworks using Python, PySpark, SparkSQL and SQL
Experience with Azure Data Factory, ADLS, Synapse Analytics and Databricks
Experience building data pipelines for Data Lakehouses and Data Warehouses
Good understanding of data structures and data processing frameworks
Knowledge of data governance and data quality principles
Effective communication skills to translate technical details to non-technical stakeholders
What Makes a Career at OPG Different?
As Ontario’s largest clean energy generator, we’re building, expanding, and innovating the equipment and technology that keeps Ontario powered with clean, reliable energy.
At OPG, our values are our strengths. They are fundamental truths about our organization that don’t change:
Safety – it’s our business
Integrity – always lead with integrity
Excellence – never satisfied with good enough
Inclusion – working together for powerful outcomes
Innovation - creativity accelerates possibility.
Here's why OPG might just be the ideal workplace for you:
Exceptional range of opportunities province-wide
Long-term career growth and development opportunities
Electricity is vital to the province and OPG’s clean electricity is helping decarbonize other sectors.
Our promise to you:
We care about the safety and the well-being of our employees. It is our utmost priority.
A supportive work environment where you can be your best every day.
Opportunities to stretch and develop.
Offer different ways for you to give back to communities where we operate.
Partner with Indigenous communities and support local businesses.
We support employment equity, diversity and inclusion.
Are you ready to start a career that has the power to electrify life on and off the job? Apply now.
APPLICATION PROCESS
Please submit your application online at https://jobs.opg.com/ by 11:59 PM EST: Wednesday , September 18, 2024. OPG thanks all those who apply; however, only candidates considered for an interview will be contacted.
period
The base salary range considers many factors including, but not limited to experience, education, and training, including any collective agreement requirements for union represented positions. It is not typical for the salary to be offered near the top of the range, and salary is dependent on numerous factors. For management roles, the base salary range does not represent the total compensation package. The total compensation package for regular full-time management roles includes pay-for-performance programs for annual and medium time periods. Maintaining a high-performance culture and excellence is a core expectation of every member of our leadership team and is rewarded through the established compensation framework.
OPG is committed to employment equity. As such, we encourage applicants from equity-seeking communities (Indigenous Peoples, racialized persons, persons with disabilities, and women). We strongly believe that alleviating the under-representation of equity-seeking individuals will create a stronger OPG team and allow us to better serve the needs of our diverse communities.
In order to fulfill the above-mentioned purpose, priority in hiring may be given to qualified persons who self-identify as a member of equity-seeking groups as identified in the application process. This initiative constitutes a special program under the Human Rights Code/Canadian Human Rights Act.