COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP Continuous Monitoring Approach

Briefing

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Objective  

     

Review ICAO USOAP Continuous Monitoring Approach Introduce revised / updated PQs (May 2013) and impact on States’ LEI Annex 19 Introduce ICAO CMA Online Framework Filing of Differences (EFoD) USOAP Reports Actions Required of States CMA Training

COSCAP 2013

2

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

2 Operating Regulations

1 Legislation 3 Organization, Safety Oversight Functions

ESTABLISH

5 Guidance, Procedures & Info.

IMPLEMENT 7 6 Surveillance Licensing & & Inspection Certification 8 Obligations Obligations Resolution of Safety Concerns COSCAP 2013

3

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP Comprehensive Systems Approach CSA

COSCAP 2013

4

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Comprehensive Systems Approach       

Traditional approach audit Fixed cycle Each ICAO Member in turn 6 year cycle Concentrated preparation Infrequent follow-up Results fixed at time of Report

COSCAP 2013

5

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

[State]

COSCAP 2013

6

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP CMA

COSCAP 2013

7

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP CMA

COSCAP 2013

8

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP CMA Components • States • Internal stakeholders • External stakeholders • Mandatory Information Requests (MIRs) • Protocol findings • Significant Safety Concerns (SSCs) • Corrective Action Plans (CAPs)

COSCAP 2013

Collection of safety information Update of LEI and status of SSCs

• Analysis of safety risk factors Determination • Evaluation of State’s safety of State safety management risk profile capabilities

Prioritization and conduct of USOAP CMA activities

• CSA audits • Safety audits • ICAO Coordinated Validation Missions (ICVMs) • Online monitoring activities

9

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Collection of Safety Information

COSCAP 2013

10

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Collection & Processing of CMA Info

COSCAP 2013

11

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Collection of Safety Information States provide:  The State Aviation Activity Questionnaire (SAAQ)  Compliance Checklists (CCs) or Electronic Filing of Differences (EFOD)  The self-assessment checklist  Updated CAPs

COSCAP 2013

12

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Collection of Safety Information Internal stakeholders include:  ICAO Secretariat Bureaus/Sections  Regional Offices (ROs)

COSCAP 2013

13

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Collection of Safety Information External stakeholders include:        

EASA; EC; EUROCONTROL; IATA; CANSO; Interstate Aviation Committee (IAC); Airports Council International (ACI); and other national, regional, supranational and international organizations recognized by ICAO.

Note: These organizations conduct activities that generate safety information. COSCAP 2013

14

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Determination of State safety risk profile

COSCAP 2013

15

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

State Safety Risk Profile Safety risk factors • Previous USOAP activity results • Level of traffic in the Safety risk State factors • Progress made by the State in resolving USOAP deficiencies

COSCAP 2013

Safety risk indicators

Safety risk profile

• LEI vs. traffic (exposure) • Continuous Monitoring Office (CMO) determines • Existence of SSC(s) the safety risk profile Safety risk •Safety Level of risk aviation activities is generated by for each audit area indicators profile which determining safety risk • Projected growth of factors and indicators. aviation activities • Level of acceptability of State’s CAPs • Progress in implementation of State’s CAPs • Ongoing or planned assistance projects • Major changes in the organizational structure 16

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Prioritization and conduct of USOAP CMA activities

COSCAP 2013

17

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Prioritization and conduct of USOAP CMA activities States are prioritized by CMO, based on their safety risk profile and information including:  Input from the States/ROs on States’ progress in implementing their CAPs  Input from the States/ROs on States’ progress in resolving identified SSCs  Specific requests from States/ROs for conduct of a USOAP CMA activity

COSCAP 2013

18

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Prioritization and conduct of USOAP CMA activities 

Scope of an ICVM based on: Level of aviation activity in the State State’s self-assessment Level of progress reported by State to implement CAPs Level of progress reported by States to address not satisfactory PQs Request by a State (cost-recovery ICVM)



Duration of ICVM determined by scope.

COSCAP 2013

19

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Prioritization and conduct of USOAP CMA activities 

Scope of an Audit (safety/CSA) based on: All relevant PQs Level of aviation activity in the State State’s self-assessment Request by the State (cost-recovery audit)



Duration of Audit is determined by scope

COSCAP 2013

20

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP CMA Components • States • Internal stakeholders • External stakeholders • Mandatory Information Requests (MIRs) • Protocol findings • Significant Safety Concerns (SSCs) • Corrective Action Plans (CAPs)

COSCAP 2013

Collection of safety information Update of LEI and status of SSCs

• Analysis of safety risk factors Determination • Evaluation of State’s safety of State safety management risk profile capabilities

Prioritization and conduct of USOAP CMA activities

• CSA audits • Safety audits • ICAO Coordinated Validation Missions (ICVMs) • Online monitoring activities

21

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of LEI and Status of SSCs

COSCAP 2013

22

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of Lack of Effective Implementation (LEI)  



ICAO Validates collected safety information Validation enables ICAO to continuously update State LEI status State LEI for the previous audit cycle is reported on iSTARS

COSCAP 2013

23

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of Lack of Effective Implementation (LEI) PQs have been revised and updated  Applicable in May 2013.  New / amended PQs will impact State’s LEI deletion of some PQs new PQs merging of existing PQs 

Detail later in Presentation

COSCAP 2013

24

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of Lack of Effective Implementation (LEI) Mandatory Information Request (MIR) can be issued by CMO when:  SAAQ, CCs and/or PQs are not submitted, are out-dated or are contradictory to other available information  CAPs are not submitted or are not kept up-to-date by State  Available information is insufficient  Concerns are raised by internal / external stakeholders.

COSCAP 2013

25

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of Lack of Effective Implementation (LEI) Mandatory Information Request (MIR)  States required to provide status of compliance with PQs  “Manage State self-assessment” tool on the OLF  CMO will communicate with States through MIRs to seek additional information

COSCAP 2013

26

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of Lack of Effective Implementation (LEI) Status of PQs may be changed through the CMO validation process based on:  CAPs or other information received from States, supported by appropriate evidence  Information received from ICAO ROs, recognized organizations and other stakeholders  information received from States in response to MIRs

COSCAP 2013

27

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update of Lack of Effective Implementation (LEI)

With the new online monitoring activities, CMO may review and validate some PQs related to CE-1 to CE-5 offsite and from ICAO HQ. However, validation of PQs related to CE-6 , CE-7, and CE-8 will typically require an on-site activity.

COSCAP 2013

28

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Status of Significant Safety Concerns (SSCs)

“SSC occurs when the audited State allows the holder of an authorization or approval to exercise the privileges attached to it, although the minimum requirements established by the State and by the Standards set forth in the Annexes to the Chicago Convention are not met, resulting in an immediate safety risk to international civil aviation.” Reference: EB 2010/7 dated 19 February 2010

COSCAP 2013

29

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Status of SSCs SSCs identified by ICAO

34

SSCs unresolved in 12 States

15

SSCs resolved through corrective actions taken by the States

14

SSCs resolved by immediate actions taken by the States prior to being posted on the ICAO website

5

COSCAP 2013

30

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Status of SSCs Continuous monitoring process Ongoing monitoring of evidence and information collected from the State and other sources

USOAP CMA on-site activity Evidence collected points to a SSC • Team leader brings it to the attention of the State as soon as it is discovered • State may initiate corrective actions immediately • Team leader provides all relevant information to C/CMO

COSCAP 2013

Preliminary SSC identified

SSC Committee convened to validate

31

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Audit Areas And Critical Elements of the State Safety Oversight System COSCAP 2013

32

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Primary aviation legislation & civil aviation regulations (LEG) Chicago Convention

COSCAP 2013

Civil aviation organization (ORG) SAAQ

Personnel licensing & training (PEL) Annex 1

Aircraft operations (OPS) Annexes 6, 9, 18 PANS-OPS

Airworthiness of aircraft (AIR) Annexes 6,7,8 and 16

Aircraft accident and incident investigation (AIG) Annex 13

Air navigation services (ANS) Ann 2,3,4,5,10,11,12,15 PANS-ATM

Aerodromes and ground aids (AGA) Annex 14 33

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Critical Elements of State Safety Oversight System ICAO Audits to determine States safety oversight capabilities include:  Assessing the effective implementation of the 8 CEs of a safety oversight system  Verifying State implementation of: all safety-related ICAO SARPs associated procedures guidance materials best safety practices

COSCAP 2013

34

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

2 Operating Regulations

1 Legislation 3 Organization, Safety Oversight Functions

ESTABLISH

5 Guidance, Procedures & Info.

IMPLEMENT 7 6 Surveillance Licensing & & Inspection Certification 8 Obligations Obligations Resolution of Safety Concerns COSCAP 2013

35

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-1: Primary aviation legislation 



The State shall promulgate a comprehensive and effective aviation law, consistent with the size and complexity of the State’s aviation activity and with the requirements contained in the Convention on International Civil Aviation, that enables the State to regulate civil aviation and enforce regulations through the relevant authorities or agencies established for that purpose. The aviation law shall provide personnel performing safety oversight functions access to the aircraft, operations, facilities, personnel and associated records, as applicable, of service providers.

COSCAP 2013

36

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-2: Specific operating regulations The State shall promulgate regulations to address, at a minimum, national requirements emanating from the primary aviation legislation, for standardized operational procedures, products, services, equipment and infrastructures in conformity with the Annexes to the Convention on International Civil Aviation. Note The term “regulations” is used in a generic sense and includes but is not limited to instructions, rules, edicts, directives, sets of laws, requirements, policies, and orders.



COSCAP 2013

37

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-3: State system and functions The State shall establish relevant authorities or agencies, as appropriate, supported by sufficient and qualified personnel and provided with adequate financial resources. Each State authority or agency shall have stated safety functions and objectives to fulfill its safety management responsibilities.  The State shall ensure that inspectors are provided with guidance that addresses ethics, personal conduct and the avoidance of actual or perceived conflicts of interest in the performance of official duties. Note In addition, Appendix 5 to Annex 6, Part I, and Appendix 1 to Annex 6, Part III, require the State of the Operator to use such a methodology to determine its inspector staffing requirements. Inspectors are a subset of personnel performing safety oversight functions. 

COSCAP 2013

38

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-4: Qualified technical personnel 



The State shall establish minimum qualification requirements for the technical personnel performing safety oversight functions and provide for appropriate initial and recurrent training to maintain and enhance their competence at the desired level. The State shall implement a system for the maintenance of training records.

COSCAP 2013

39

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-5: Technical guidance, tools and provision of safety-critical information 



The State shall provide appropriate facilities, comprehensive and up-to-date technical guidance material and procedures, safety critical information, tools and equipment, and transportation means, as applicable, to the technical personnel to enable them to perform their safety oversight functions effectively and in accordance with established procedures in a standardized manner. The State shall provide technical guidance to the aviation industry on the implementation of relevant regulations.

COSCAP 2013

40

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-6: Licensing, certification, authorization and/or approval obligations 

The State shall implement documented processes and procedures to ensure that personnel and organizations performing an aviation activity meet the established requirements before they are allowed to exercise the privileges of a license, certificate, authorization and/or approval to conduct the relevant aviation activity.

COSCAP 2013

41

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-7: Surveillance obligations 

The State shall implement documented surveillance processes, by defining and planning inspections, audits, and monitoring activities on a continuous basis, to proactively assure that aviation license, certificate, authorization and/or approval holders continue to meet the established requirements. This includes the surveillance of personnel designated by the Authority to perform safety oversight functions on its behalf.

COSCAP 2013

42

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CE-8: Resolution of safety issues 



The State shall use a documented process to take appropriate corrective actions, up to and including enforcement measures, to resolve identified safety issues. The State shall ensure that identified safety issues are resolved in a timely manner through a system which monitors and records progress, including actions taken by service providers in resolving such issues.

COSCAP 2013

43

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Critical Elements of State Safety Oversight System 



Definitions of the 8 CEs of a safety oversight system are now an Appendix of Annex 19 Guidance on the eight CEs is provided in ICAO Doc 9734, Part A

COSCAP 2013

44

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Annex 19 – Safety Management

COSCAP 2013

45

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Annex 19 – Safety Management The Air Navigation Commission, at the fourth and fifth meetings of its 190th Session on 8 May 2012, considered proposals developed by the Safety Management Panel (SMP) to transfer the provisions on safety management responsibilities and processes from existing Annexes for consolidation in new Annex 19 — Safety Management, and related consequential amendment proposals to existing Annexes developed by the Secretariat.

The proposed new Annex 19 and consequential amendments to Annexes 1, 6, 8, 11, 13 and 14, Volume I are envisaged for applicability on 14 November 2013.

COSCAP 2013

46

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Annex 19 – Safety Management The Standards and Recommended Practices (SARPs) in this Annex are intended to assist States in managing aviation safety risks, with the objective of continuously reducing the number of aviation accidents and incidents. Given the increasing complexity of the global air transportation system and the interrelated nature of aviation activities required to assure the safe operation of aircraft, this Annex provides the means to support the continued evolution of a proactive strategy to improve safety performance. The foundation of a proactive safety strategy is based on the implementation of the State safety programme (SSP) of a State and will continue to rely on the successful implementation of existing international provisions and accident/incident investigation activities. COSCAP 2013

47

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Annex 19 – Safety Management The 4 components of the SSP framework are:  State safety policy and objectives;  State safety risk management;  State safety assurance; and  State safety promotion.

COSCAP 2013

48

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

SSP Roll-out

The ICAO Secretariat will be proposing to Council a detailed roll-out plan of the SSP to guide States in its implementation.

The roll-out will include details on how USOAP CMA will monitor the implementation of the SSP.

COSCAP 2013

49

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP CMA Audit Areas

COSCAP 2013

50

COSCAP South East Asia 1997

1998

1999

2000

Cooperative Development of Operational Safety and Continuing Airworthiness Programme 2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

As of January 2013, safety oversight information is available ICAO has on identified a significant safety concern with STATES the ICAO public website. respect to the ability of [State] to properly 2005: USOAP CSA Audit oversee the [insert airlines (air operators); results full transparency to airports; aircraft; or air navigation services, as all States 1997: Voluntary Assessment 2006:This SSC introduced, fast applicable] under its jurisdiction. does not Programme, Fully Confidential track notification to all necessarily indicate a particular safety deficiency in (Annexes 1-6-8) States (restricted web site) the [insert airlines (air operators); airports; 1999: USOAP Audit Summary aircraft; or air navigation services, as Reports to all States (Annexes 16-8) applicable] but, rather, indicates that the State is not providing sufficient safety oversight to ensure the PUBLIC effective implementation of applicable ICAO 2001: Full Generic, non-Statedetails specific of LEIthe results globally and by Standards. technical ICAO findings region have been made available to [State] to guide 2005: Public access to LEI, Critical rectification, as well as to allElement ICAO results Member States to by State. All States provided facilitate any actions that theyconsent may consider to make full necessary to ensure safety. [State]2006: hasMechanism undertaken USOAP results available to the to regularly report progress on this matter to ICAO. public with State consent. 1st cycle

2013 +

SSCs published on the CMA on line framework Proposed layout of the SSCs for the public to receive State feed back

2014 Unresolved SSCs to be made available to the public in the format and conditions approved by Council

audits 45% of States COSCAP 2013

51

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Revision of Protocol Questions (PQs)

COSCAP 2013

52

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Revision of Protocol Questions (PQs)      

PQ revision Change in PQ methodology Applicability (May 2013) PQ mapping and addressing revised PQs Impact LEI Score Actions required by States

COSCAP 2013

53

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Overview of the PQ revision 





In preparation for USOAP CMA, all PQs from the CSA cycle were revised and updated to reflect the latest changes in ICAO provisions. The review also took into consideration comments from States, ICAO (ROs, ANB, etc.), USOAP audit team members and external stakeholders. Under the USOAP CMA, PQs will be reviewed and updated on a periodic basis to reflect emerging issues and changes in Annex provisions and guidance materials.

COSCAP 2013

54

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Overview of the PQ revision 



The CSA cycle had a total of 975 PQs addressing the 8 audit areas of LEG, ORG, PEL, OPS, AIR, AIG, ANS, AGA. The new USOAP CMA PQs have a total of 1016 PQs, including several revised PQs Deleted PQs: 15 PQs merged with other PQs: 53 New PQs: 105 5 PQs without a CE assignment have been deleted.

COSCAP 2013

55

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Change in Methodology Finding & Recommendation based to Protocol Based COSCAP 2013

56

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

ORG/01 ORG

ORG/01 Finding text The current organizational structure of the CAD is not determined in sufficient detail as to provide a clear definition of the regulatory and safety oversight functions and responsibilities related to PEL, IOS, AIR< ANS and AGA. In addition, the available organizational charts have not been approved yet.

COSCAP 2013

One CAP/CAP update including: Item 1 . . . . . . . . . . . Item 20

One CAP assessment

2.011 3.101 3.103 4.027 5.021 5.023 5.045 7.031 7.053 7.203 7.271 7.327 …

Finding text

One CAP/CAP update

One CAP assessment

2.011

PEL Finding text

One CAP/CAP update

One CAP assessment

3.101

. .. ANS Finding text

One CAP/CAP update

One CAP assessment

7.327

57

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

PQ Mapping & Addressing Revised PQs

COSCAP 2013

58

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

PQ Mapping & Addressing Revised PQs 





Revisions to PQs have resulted in minor changes in LEIs of all States. LEIs on the CMA OLF should be considered live, since their status can change on a continuous basis. With the introduction of the revised PQs, States will regularly update their status of compliance and provide evidence on the CMA OLF (through the “Manage State self-assessment” and “Manage CAP” functionalities).

States may also be required to respond to MIRs, when applicable. COSCAP 2013

59

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

PQ Mapping & Addressing Revised PQs 





PQs that are currently “satisfactory” will remain satisfactory, unless new evidence results in a change of status. Status of “not satisfactory” PQs may be changed by CMO on the basis of existing evidence provided for some PQs related to CE-1 to CE-5. PQs related to CE-6, CE-7 and CE-8 will typically require an evaluation through an on-site USOAP CMA activity to verify effective implementation.

COSCAP 2013

60

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Highlights of Changes Per PQ Area

COSCAP 2013

61

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

General 





Addition of new PQs on new ICAO Standards and Recommended Practices (SARPs) and guidance material Moving of certain LEG and ORG PQs to other audit areas (i.e. OPS and ANS) Harmonization of text for all PQs

COSCAP 2013

62

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

LEG 

Area-specific PQs previously under LEG are now moved to the relevant audit areas, such as: 2 PQs on interception of civil aircraft → OPS and ANS; PQ on units of measurement → ANS; and PQ on journey log book and documents to be carried on board an aircraft → OPS.

COSCAP 2013

63

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

ORG 

New PQs have been added on mechanisms to avoid perceived or potential conflict of interest of inspectorate staff.



5 PQs have been deleted that were not associated with any CEs (3 ORG, 1 PEL and 1 OPS; related information now obtained from State Aviation Activity Questionnaire or SAAQ).

COSCAP 2013

64

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

PEL 

ICAO Doc 9379 — Manual of Procedures for Establishment and Management of a State’s Personnel Licensing System (Second Edition) has been published in 2012.



All references (in “ICAO ref.” column) have been revised to include ICAO Doc 9379.

COSCAP 2013

65

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

OPS 

2 PQs on flight data recorders have been moved to AIR (AIR PQs 5.204 and 5.205)



These PQs have been moved from LEG to OPS: 1 PQ on interception of civil aircraft 1 PQ on journey log book 1 PQ on documents to be carried on board an aircraft

COSCAP 2013

66

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

AIR  

New PQs have been added Examples: Aircraft registration (identification plate and use of registration marks – AIR PQs 5.120 and 5.130); Safety Management System (SMS – AIR PQs 5.372 and 5.373); and AIR-related approval of CAT II and III instrument approaches (AIR PQs 5.330 and 5.331).

COSCAP 2013

67

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

AIG 

New PQs have been added on procedures for inclusion of safety recommendations in draft final report forwarded to States and organizations concerned.

COSCAP 2013

68

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

ANS 

Revisions include PQs on: New RVSM monitoring requirements; Performance-based navigation (PBN) implementation; Implementation of SMS/State Safety Programme (SSP); and Runway safety programme.

COSCAP 2013

69

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

AGA 





PQs associated with multiple CEs (CE-2, CE-5, CE-6 and CE7) are split into PQs associated with single CEs New CE-2 PQs have been added to address all chapters of Annex 14, Volume I New PQs have been added on minimum qualifications for aerodrome inspectors

COSCAP 2013

70

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Actions Required by States

COSCAP 2013

71

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Actions required by States   





Manage user accounts of the CMA online framework Keep up-to-date SAAQ and CC/EFOD Provide a CAP update and/or progress per corresponding protocol finding Provide self-assessment result on each PQ with a priority on the PQs that have a “Not Satisfactory” status Respond to MIR in a timely manner

COSCAP 2013

72

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CMA On-line Framework 



A suite of web-integrated applications and centralized database systems to support the implementation of CMA activities Includes: Collection of safety-related information and documents from different sources Monitoring and reporting of safety oversight activities by Member States

COSCAP 2013

73

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

On-line Framework

COSCAP 2013

74

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Access Control 

NCMCs Have a full control of user accounts for the State Issuing additional user accounts Deactivating invalid user accounts Setting individual user rights/permissions



Individual Users

Manage user profile information Personalize password Note: If you are not an NCMC and want to have access to the online framework, please contact the NCMC(s) of your State

COSCAP 2013

75

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Access Control 

User account composed of “ID or Email address” and password duplicate IDs or email addresses are not accepted



Access rights 3 types (no access, read-only or read/write) CC/EFOD : access rights can be granted per Annex PQ, CAP and F&R : access rights are permitted for all technical areas

COSCAP 2013

76

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

State Dashboard 

States (NCMCs) to view at a glance: Status of CMA information completion Status of overall LEI/EI Status of CAP progress

COSCAP 2013

77

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Update on Electronic Filing of Differences (EFoD)

COSCAP 2013

78

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

ICAO Misleading, inconsistent, insufficient guidance

Limited value of Supplements

Frequent Annex Am’t and unrealistic applicability dates

COSCAP 2013

States Not at all or not properly file differences Not publish significant differences in AIPs

Difficulty in comprehendin g and interpreting Annex provisions

Lack of States’ commitment

Lack of effective national process and procedures

Lack of knowledge and expertise

79

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Filing Differences – Transition 



March 2011, Council agreed to use EFOD as an alternative means of filing of differences Jan 2011, CC data from 153 States were migrated into the EFOD system File differences pursuant to Article 38 of Chicago Convention

COSCAP 2013

Keep up-to-date compliance checklist pursuant to MOU for USOAP CMA

80

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Filing Differences – Transition  



In April 2011, States were requested to (SL AN 1/1-11/28): Recognize EFOD as an alternative means of filing of differences Verify and confirm the data in EFOD which had previously been submitted through CC under USOAP. Over 100 States have been updating data in EFOD 45 States sent replies (34 States completed verification, 11 States submitted plan for completion)

COSCAP 2013

81

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Procedures on the Use of EFOD







Considered and approved by Council at its 195th Session To be Published by Secretary General in 2nd Quarter 2013 Table of Contents 1. 2. 3. 4. 5. 6. 7.

COSCAP 2013

Introduction/Scope Access to the System Languages Annex Information Compliance/Differences Information System performance References

82

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Previous USOAP Report  



Static Report Final reports based on onsite activities conducted since the first cycle of USOAP Published according to predetermined timelines after the closing meeting of an onsite activity

COSCAP 2013

83

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

CMA USOAP Report Dynamic Report  Based on the most recent online and/or onsite activity for each audit area/CE

COSCAP 2013

84

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

USOAP CMA Computer Based Training (CBT)  





Understanding of the USOAP CMA methodologies Essential knowledge required to participate in USOAP CMA activities Enhance the competencies in the areas addressed by USOAP CMA NCMC and others

COSCAP 2013

85

COSCAP South East Asia

Cooperative Development of Operational Safety and Continuing Airworthiness Programme

Questions & Comments Kim Trethewey Chief Technical Advisor COSCAP South East Asia [email protected] +66 8 8686 0002

COSCAP 2013

86