We demonstrate the methodology to evaluate a minimum viable software product (MVP) to facilitate the use of the ICF by the population. This requires careful assessment of needs and usability before a product can be rolled out to a larger group of users.
This work will occur in close collaboration with both content specification (WP2) and lean MVP design (WP3) teams, which run as parallel processes. This work package addresses the question, if the application is not only usable but also if it describes the person’s level of functioning in a valid way.
To inform the development team in a timely fashion, the test sites will work with relatively small user groups of about 30 service users and 2 to 4 service providers. This allows for a quick collection of relevant data, feedback to the software designers and rapid updating and bug fixing. Each iteration of the product will be tested in a new group of users without previous exposure to the application. This allows for capturing relevant data from first-time users and avoids a masking effect of potential issues through learning from subsequent exposures. The captured results will then be sent back to the content (WP2) and software design (WP3) working groups. It is estimated that in a period of 6 months, 5 iterations can be concluded in each testing site (see table for testing sites).
Evaluations will be conducted in different parts of the world focusing specifically on 3 important and interrelated aspects: information quality, system quality and service quality that will be measured separately. Both formative and summative evaluations will be used to gather opinions of service user and service provider groups to enhance further development and dissemination. Their opinions are important in the further development and dissemination of the mICF.
The aim of the tool is to assess how users’ are interacting with mICF (users per country, frequency of contacts with different service providers, costs and net benefits).
|Finland||THL, North Karelia District, Barona Hoiva Oy, JAMK & PT centre (low back pain), JAMK & Onerva Centre for Learning and Consulting|
|Denmark||MC & Spine Centre|
|Portugal||ESTeSC – Coimbra Health School|
|Italy||AAS2 (adults), FINCB (children)|
|Germany||MSH & Early Intervention Centres|
|South Africa||SU – Rural sites: Cape Winelands Health Districts, Ukwanda Rural Clinical School
SU – Urban sites: Developmental and Community-based healthcare centres
|Canada||MCM Children’s Hospital, ASD Services|
|Brazil||CIF & Functional Health Centres from Municipality of Barueri|
|India||DFI and Community Health Settings (elderly)|
|Korea||Silla University Hospital (low back pain)|
The technology acceptance model (TAM) will be used for measuring use/intention to use and user satisfaction. TAM evaluates:
“People tend to use or not use an application to the extent they believe it will help perform their job better”. Perceived ease of use refers to “the degree to which a person believes that using a particular system would be free of effort“. To guarantee the validation of the results, the evaluation will use data triangulation with regard to time, space, or persons, investigator triangulation, theory triangulation, and methods triangulation.
Acceptance and use of IT: information technology:
We will also assess by whom and why technology is adopted and/or abandoned. As we strive to hit the “sweet spot” of maximizing well-being and functioning through technology without undermining the future performance potential of the individual we will also assess the potential negative outcomes. The harmful effects could be e.g. compromising autonomy and independence and by promoting a false sense of security.
The evaluation results will contribute to a strengthened evidence base on health outcomes, quality of life and care efficiency gains from the use of the ICT (mICF solution) in integrated service provision. This will reinforce knowledge with respect to management of co-morbidities