Introduction

We demonstrate the methodology to evaluate a minimum viable software product (MVP) to facilitate the use of the ICF by the population. This requires careful assessment of needs and usability before a product can be rolled out to a larger group of users.

cropped-cropped-CO_05_Castaneda_BLIND-MESSAGING.jpgMethods

This work will occur in close collaboration with both content specification (WP2) and lean MVP design (WP3) teams, which run as parallel processes. This work package addresses the question, if the application is not only usable but also if it describes the person’s level of functioning in a valid way.

To inform the development team in a timely fashion, the test sites will work with relatively small user groups of about 30 service users and 2 to 4 service providers. This allows for a quick collection of relevant data, feedback to the software designers and rapid updating and bug fixing. Each iteration of the product will be tested in a new group of users without previous exposure to the application. This allows for capturing relevant data from first-time users and avoids a masking effect of potential issues through learning from subsequent exposures. The captured results will then be sent back to the content (WP2) and software design (WP3) working groups. It is estimated that in a period of 6 months, 5 iterations can be concluded in each testing site (see table for testing sites).

Evaluations will be conducted in different parts of the world focusing specifically on 3 important and interrelated aspects: information quality, system quality and service quality that will be measured separately. Both formative and summative evaluations will be used to gather opinions of service user and service provider groups to enhance further development and dissemination. Their opinions are important in the further development and dissemination of the mICF.

The aim of the tool is to assess how users’ are interacting with mICF (users per country, frequency of contacts with different service providers, costs and net benefits).

Countries Partners
Finland THL, North Karelia District, Barona Hoiva Oy, JAMK & PT centre (low back pain), JAMK & Onerva Centre for Learning and Consulting
Denmark MC & Spine Centre
Portugal ESTeSC – Coimbra Health School
Italy AAS2 (adults), FINCB (children)
Germany MSH & Early Intervention Centres
South Africa SU – Rural sites: Cape Winelands Health Districts, Ukwanda Rural Clinical School

SU – Urban sites: Developmental and Community-based healthcare centres

Canada MCM Children’s Hospital, ASD Services
Brazil CIF & Functional Health Centres from Municipality of Barueri
India DFI and Community Health Settings (elderly)
Korea Silla University Hospital (low back pain)

The technology acceptance model (TAM) will be used for measuring use/intention to use and user satisfaction. TAM evaluates:

TheHome page - what is mICF perceived usefulness:

“People tend to use or not use an application to the extent they believe it will help perform their job better”. Perceived ease of use refers to “the degree to which a person believes that using a particular system would be free of effort“. To guarantee the validation of the results, the evaluation will use data triangulation with regard to time, space, or persons, investigator triangulation, theory triangulation, and methods triangulation.

Acceptance and use of IT: information technology:

We will also assess by whom and why technology is adopted and/or abandoned. As we strive to hit the “sweet spot” of maximizing well-being and functioning through technology without undermining the future performance potential of the individual we will also assess the potential negative outcomes. The harmful effects could be e.g. compromising autonomy and independence and by promoting a false sense of security.

Conclusion

The evaluation results will contribute to a strengthened evidence base on health outcomes, quality of life and care efficiency gains from the use of the ICT (mICF solution) in integrated service provision. This will reinforce knowledge with respect to management of co-morbidities