LDC Public Safety Measure Recommendation on Awareness Survey Presented to OEB Presented by Farrah Bourre (Electrical Safety Authority) Jason Lockhart (Innovative Research Group Inc.) November 24, 2015

2

Public Safety Scorecard Measure The ESA and OEB have been working to develop a standard survey methodology for use as one of three components of a Public Safety scorecard measure for distributors to ensure consistency in practice throughout the industry. ESA’s Objectives: • To ensure compliance with the OEB’s regulatory requirements; and • To drive continuous improvement in the level of public awareness of safety precautions related to electricity. To meet OEB scorecard requirements, the ESA has to develop a standardized set of Public Safety questions for LDC use – in consultation with the OEB and key stakeholders, including distributors.

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

3

Public Safety Scorecard Measure The ESA has engaged a third party, Innovative Research Group Inc. (INNOVATIVE) to assist with the development of two key documents:

1

Standardized Scorecard Survey

2

Scorecard Methodology and Implementation Guide

• Online survey instrument

• Implementation Guide

• Telephone survey instrument

• Methodology • Background

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Developing Public Safety Awareness Measures 1.

Develop DRAFT public safety measures. ESA and INNOVATIVE develop draft questions and methodological design for stakeholder consideration.

2.

Working Group Session #1. Share draft material and collect facilitated feedback on questions and methodological design with working group.

3.

Working Group Session #2. Present revised materials to working group for review and facilitated discussion.

4.

Solicit broader stakeholder feedback. Send REVISED questionnaire and methodology guide to all stakeholders for final comment.

5.

Finalize Public Safety Awareness Measures. Review stakeholder feedback, present Questions and Methodology to OEB for approval. 4

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Recommendation: Questionnaire Outline + Index Scores The questions have been designed specifically to focus on public awareness related to the incidents (fatalities, critical injuries and injuries) involving utility equipment-related that have most frequently occurred in Ontario in the last decade. The standardized questionnaire will be structured as follows:

Screening and Demographic Questions

To ensure representative sample and assist LDCs in identifying where among the population awareness levels are lower and where outreach can be targeted. Likelihood to “call before you dig” Impact of touching a power line

Core Safety Awareness Questions

Proximity to overhead power line Danger of tampering with electrical equipment

Proximity to downed power line Actions taken in vehicle in contact with wires 5

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Responses indexed to create a single comparable public awareness score

Calculating Public Electrical Safety Awareness Index Scores Likelihood to “call before you dig”

0 to 1pts

Impact of touching a power line

0 to 1pts

Proximity to overhead power line

0 to 1pts

Danger of tampering with electrical equipment

0 to 1pts

Proximity to downed power line Actions taken in vehicle in contact with wires

0 to 1pts 0 to 1pts

All section points bound between 0 and 1

Add all 6 section points among survey respondents

Divide score sections and survey sample size

Multiply score by 100 6

LDC public awareness score bound between 0-100%

Recommendation Methodology & Survey Design •

Sample Representation – Sample should be representative of the adult population living within an LDC’s service territory.

•

Survey Execution – LDCs will have the choice of online and telephone survey execution. Should an LDC not have in-house research expertise, a professional research firm is best suited to execute surveys on behalf of the distributor.

•

Sample Size – To obtain generalizable data that is both comparable over time and across the sector, a minimum sample size of n=400 will be required for LDCs with a service territory population of 5,000 or more. Exceptions based on population are outlined on slide 10.

7

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Consultation Feedback & Responses Common responses from 18 LDCs, CLD, EDA: Can we add questions to the survey? Can we educate/tell respondent answers at the same time? Questions can be added and answers can be given, as long as the core survey questions are executed according to the methodology guide. Who is responsible/will pay for electrical safety awareness initiatives? ESA has been delivering province wide campaign powerline safety campaigns for three years, and has offered turnkey materials for LDCs to use in their territory. ESA plans to continue this in partnership with the LDC community.

8

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Consultation Feedback & Responses Can we add questions to the survey? Can we educate/tell respondent answers at the same time?

Electrical safety is applicable to everyone, not just the individual responsible for payment of the electricity bill. Consider a combined survey for similar LDCs

Each LDC must have results based on their service territory How will the online survey work?

ESA will offer a webinar for all LDCs to answer any questions they may have about research methodology. (how to obtain representative samples, how many completed surveys, etc.)

9

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Sample Size Given the OEB’s requirement for generalizable data that is both comparable over time and across the sector, a minimum sample size of n=400 will be required. Note: distributors are welcome to increase their sample size of respondents beyond the required minimum of n=400. Should a distributor have a small population in their service territory, exceptions to the required sample size will be made. General Rule  15:1 Ratio for GenPop Surveys. In general, for every 15 calls, only one respondent is expected to complete the survey. This reality poses problems for smaller LDCs with a small population to draw upon. Reductions of sample size requirements should be considered by the OEB for distributors with small population sizes:

• LDCs with a population under 5,000  minimum sample size of n=300. • LDCs with a population under 3,000  minimum sample size of n=200. 10

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015

Next Steps 2015 Dates

Activities

August

• Working Group Session #1

September

• Receive Feedback from Working Group (Session #1) • Revise Scorecard Questionnaire & Methodology • Working Group Session #2

October

• Revise Scorecard Questionnaire • Solicit Input from Broader Stakeholder Community • Incorporate final review feedback

November

• Finalized Questionnaire & Methodology

November

• ESA to submit Standardized Questionnaire & Recommended Methodology to OEB

11

AWARENESS SURVEY RECOMMEDATION • NOV 24 2015