[Previous] [Contents] [Next]

How Good is Our Community Learning and Development? 2 Self-evaluation for Quality Improvement

Part 3 Illustrations of graded evaluations

What key outcomes have we achieved?
(Key Area 1: Key Performance Outcomes)
PI 1.1 Improvements in performance

Measures

Evidence of standards of and trends in performance will normally include comparative data measured against appropriate benchmarks. Examples of performance data and measures might include:

Performance will also be measured against objectives within the CLD strategy and action plans or equivalent and aspects of social and health targets which are appropriate to the CLD functions. Evidence will be published in progress reports and public performance reports. Examples could include:

Level 5 illustrations — continued

Level 2 illustrations

What key outcomes have we achieved?
(Key Area 1: Key Performance Outcomes)
PI 1.2 Fulfilment of statutory duties

Measures

Evaluation of financial performance will be based on financial data and measures derived from local Best Value reviews and audits carried out by Audit Scotland. Comparative data on CLD expenditure, including expenditure on the national literacies programme will also be used.

Compliance with statutory requirements relates to legislation and guidance such as the Race Relations Amendment Act, the Disability Discrimination Act and the Local Government Scotland Act.

How well do we meet the needs of our stakeholders?
(Key Area 2: Impact On Service Users)
QI 2.1 Impact on participants

Themes:

This indicator relates to the impact of CLD providers on learners of all ages and focuses particularly on their current experiences. Taken together, the range of evidence should demonstrate that the work of CLD providers is having a positive effect on learners’ all-round development and life chances.

The first theme draws on quantitative data and evidence from direct observation, documentation and discussions with other stakeholders. Examples may include:

The second theme deals with participants’ views as reported in responses to questionnaires, surveys, focus groups and unsolicited comments. These responses provide evidence of the extent of their satisfaction with the CLD services and may cover aspects such as:

Evaluation should take into account both themes and result in a considered view of the overall impact on learners.

Level 5 illustrations

Level 2 illustrations

How well do we meet the needs of our stakeholders?
(Key Area 3: Impact On Staff and Volunteers)
QI 2.2 Impact on paid and voluntary staff

Theme

This indicator focuses on the extent to which paid and voluntary staff are supported and empowered to contribute positively to effective service delivery. It deals with the motivation of paid and voluntary staff, the impact of opportunities for them to learn and improve, peer and line management relationships and management of change. These measures draw on responses to questionnaires, surveys, focus groups and interviews. It also takes account of evidence such as levels of absence, staff turnover and the uptake of training and development opportunities.

Level 5 illustrations

Level 2 illustrations

How well do we meet the needs of our stakeholders?
(Key Area 4: Impact On The Community)
QI 4.1 Impact on the local community

Theme

This indicator focuses on the impact of CLD providers on community groups and organisations. It deals with the CLD contribution to aspects such as participation, learning and opportunities for community members to be involved in developments. It takes account of information such as participation rates, levels of responses to consultations and documentation and attendance at activities and meetings. It also draws on responses to questionnaires, focus groups, interviews and formal complaints processes.

Level 5 illustrations

Level 2 illustrations

How well do we meet the needs of our stakeholders?
(Key Area 4: Impact on the Community)
QI 4.2 Impact on the wider community

Theme

This indicator focuses on the impact the CLD partnership has on the wider community. It deals with the culture of the organisation in encouraging and supporting staff to be creative, innovative, open to new ideas and proactive. It is about being a learning organisation that deals well with change. It also refers to the influence and impact of the authority on wider developments across Scotland, the UK or internationally.

Individual organisations can use this indicator to look at similar indicative themes in order to consider their impact on the wider community.

The theme draws on quantitative and qualitative data from direct observation, documentation and discussions with stakeholders. Examples may include:

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.1 Opportunities for people in the community

Themes

This indicator is concerned with the range, appropriateness and promotion of informal learning opportunities for young people and adults in the community. It is also concerned with how participants are supported to progress to further learning, training, volunteering or employment opportunities.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.2 Context for learning/development

Themes

This indicator is concerned with the effectiveness of CLD providers in setting a context for participants’ learning and development. It focuses on the quality of guidance available in local areas to prospective participants. It addresses the appropriateness of the accommodation or other facilities used for CLD delivery. It is also concerned with how well staff support participants to engage with learning and to celebrate their successes.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.3 Planning for learning/development

Themes

This indicator focuses on the way staff ensure that prior learning is recognised and taken into account when planning programmes. It addresses the extent to which learning is rooted in the needs and aspirations of participants. It is also concerned with the way staff plan and deliver learning sessions and with how they record achievement and progression.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.4 Facilitating learning/development

Themes

This indicator is concerned with the key processes used by staff to facilitate the learning and development of participants.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.5 Participant learning/development

Themes

This indicator is concerned with aspects of participants’ experience of learning/development. It focuses on how learning opportunities engage and motivate learners, the quality and use of the learning resources available to them, and how they are supported to reflect on and consolidate their learning.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.6 Engaging with communities and other stakeholders to identify and plan to meet their own needs

Themes

This indicator is used to evaluate how well the CLD service and partner agencies identify the needs and aspirations of local communities. It evaluates whether priority needs are articulated in CLD or other local action plans.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.7 Developing skills and confidence for community engagement

Themes

This indicator is used to evaluate the effectiveness of the support given to, and relationships with, community members and volunteers. It also considers the quality of training programmes delivered and the progression of participants.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.8 Assisting communities to exercise power and influence to achieve outcomes

Themes

This indicator is used to evaluate how well community organisations are supported in managing change. It focuses on how community members are supported to influence local planning and their skills developed to deliver local services.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.9 Inclusion, equality and fairness

Themes

This indicator provides a basis for evaluating how well excluded communities, groups and individuals are included, how well the barriers to access and participation are addressed and positive attitudes to social and cultural diversity fostered.

Level 5 illustrations

Level 2 illustrations

How good is our delivery of key processes?
(Key Area 5: Processes and Delivery)
QI 5.10 Improving services

Themes

This indictor provides a basis for evaluating how well services are evaluated, improved and reported to stakeholders.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 6: Policy Development and Planning)
QI 6.1 Policy review and development

Themes

This indicator focuses on approaches to policy review and development. Policies will provide clear strategic direction and will help to ensure consistency in practice across CLD providers and contribute to continuous improvement.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 6: Policy Development and Planning)
QI 6.2 Participation of service users and other stakeholders

Themes

This indicator focuses on involving service users and stakeholders in policy development and review. It is also concerned with effective approaches to communication and consultation and the active participation of service users in the work of CLD providers.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 6: Policy Development and Planning)
QI 6.3 Operational planning

Themes

This indicator is concerned with the coherence and impact of arrangements for planning, monitoring and evaluating services.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 7: Management and Support of Paid and Voluntary Staff)
QI 7.1 Sufficiency, recruitment and retention

Themes

This indicator focuses on arrangements for recruitment and retention of paid and voluntary staff. It is used to evaluate the extent to which staff resources and skills are sufficient to achieve the planned outcomes.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 7: Management and Support of Paid and Voluntary Staff)
QI 7.2 Deployment and teamwork

Themes

The main asset in any service is its people. This indicator evaluates how well paid and voluntary staff are deployed to meet planned priorities and the effectiveness of teamwork, communication and consultation.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 7: Management and Support of Paid and Voluntary Staff)
QI 7.3 Development and support

Themes

This indicator evaluates the effectiveness of development and support procedures for paid and voluntary staff. It is concerned with arrangements to ensure the continuous support, learning and development of CLD staff.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 8: Partnerships and Resources)
QI 8.1 Partnership working

Themes

This indicator refers to the role of CLD services in promoting and encouraging effective partnership working with other services and partner agencies. A central role for local authorities is to secure and sustain cohesive partnerships to take forward the vision, values and goals of the CLD strategy. To fulfil this role, the CLD service will require to bring key partners together at a strategic decision-making level and to ensure effective partnership working at local level.

Individual organisations can use this indicator to consider their roles and engagement in appropriate partnerships.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 8: Partnerships and Resources)
QI 8.2 Financial management

Themes

This indicator will require the service to have developed a rigorous and thorough approach to managing core budgets and an enterprising approach to securing additional funding. The working relationship with the finance, other services and funders will be critically important. This indicator also relates to the service’s capacity to deliver Best Value through its approach to financial management.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 8: Partnerships and Resources)
QI 8.3 Resource and risk management

Themes

This indicator focuses on approaches to resource and risk management. It covers procedures for health and safety, risk management, including appropriateness of accommodation for CLD purposes, and arrangements for the protection and welfare of children, young people and vulnerable adults.

Level 5 illustrations

Level 2 illustrations

How good is our management?
(Key Area 8: Partnerships and Resources)
QI 8.4 Information systems

Themes

A performance information system is used to enter, store, manipulate and retrieve information about the performance of CLD services. This indicator focuses on how the service uses a system to help it to evaluate the outputs and outcomes of its services.

Level 5 illustrations

Level 2 illustrations

How good is our leadership?
(Key Area 9: Leadership)
QI 9.1 Vision, values and aims

Themes:

This indicator relates to the corporate leadership of CLD within the authority and to the way in which it exercises its functions. This will be expressed through the authority’s effectiveness in establishing direction for CLD within its wider community vision. To demonstrate good practice, the authority will have to ensure that this vision actively influences practice at the point of delivery. This indicator focuses on the extent to which vision, values and aims guide planning for and impact on maintaining and improving the quality of services for participants, their families and the community.

Individual organisations can use this indicator to look at their own approach to setting and sustaining vision, values and aims.

Level 5 illustrations

Level 2 illustrations

How good is our leadership?
(Key Area 9: Leadership)
QI 9.2 Leadership and direction

Themes:

This indicator is fundamentally about strategic planning for future sustainable development. It focuses on the mapping out of future developments which are challenging, realisable and sustainable. This indicator also relates to the success of senior managers in linking the authority’s vision to strategic deployment of resources to deliver services, secure Best Value and manage sustainable development. Significant current and planned organisational activities will take place within a culture that supports and enables effective risk management.

Individual organisations can use this indicator to look at leadership and direction of senior staff, management committees and boards of directors.

Level 5 illustrations

Level 2 illustrations

How good is our leadership?
(Key Area 9: Leadership)
QI 9.3 Developing people and partnerships

Themes:

This indicator relates to the effectiveness of the authority or organisation in building capacity for leadership at all levels and securing positive working relationships and successful outcomes with stakeholders and partner agencies. The indicator relates to the ethos and culture of the CLD service and beyond, through its operations corporately within the council and in joint working with its partner agencies. The effectiveness of the management team, their deployment, responsibilities and co-working in relation to organisational requirements and key strengths are relevant. Delegation to and empowerment of staff and partners are important features, alongside the development and support of effective teamwork.

Level 5 illustrations

Level 2 illustrations

How good is our leadership?
(Key Area 9: Leadership)
QI 9.4 Leadership of change and improvement

Themes:

This indicator is concerned with the effectiveness of the leadership of CLD within the authority in maintaining high levels of quality, delivering continuous improvement, and working towards achieving excellence in the quality of provision for all participants. A critically important component of the leadership function is the need for senior managers, team leaders and stakeholders to challenge staff continuously to improve the quality of provision for participants, by setting demanding but realistic performance targets and by providing high-level support to assist them to achieve these. The indicator also relates to the ability and success of the senior management team systematically to encourage and support innovative and effective practices which bring about positive step changes in participants’ experiences.

Level 5 illustrations

Level 2 illustrations

What is our capacity for improvement?
(Key Area 10: Capacity for Improvement)
A global judgement based on evidence of all key areas, in particular, outcomes, impact, and leadership

This last of the high-level questions requires a global judgement based on evidence and evaluations of all Key Areas. In answering this question CLD providers should also take into account contextual issues such as impending retirements of senior staff, plans to restructure, and significant changes in funding. They should also consider their ability to respond quickly to change and to be creative and innovative in the pursuit of excellence.

The council CLD service and partners should be able to make a statement with the following components:

"The council is confident/not confident that the evidence and evaluation to date indicates that:

The levels of confidence expressed for each component may be different and may include some reservations or caveats, but should lead to an overall statement of confidence in the council’s capacity to improve in relation to CLD. For example, the statement could say:

"The council is confident that the evidence and evaluation to date indicates that:

Individual CLD providers can also use this indicator to form a global judgement on their capcity for improvement.

[Previous] [Contents] [Next]