Selected Cell
Cell:
Value:
Sheet1
A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
| "Variable / Field Name" | "Form Name" | "Section Header" | "Field Type" | "Field Label" | "Choices | Calculations | OR Slider Labels" | "Field Note" | "Text Validation Type OR Show Slider Number" | "Text Validation Min" | "Text Validation Max" | Identifier? | "Branching Logic (Show field only if...)" | "Required Field?" | "Custom Alignment" | "Question Number (surveys only)" | "Matrix Group Name" | "Matrix Ranking?" | "Field Annotation" |
| record_id | post_questionnaire | text | "Record ID" | ||||||||||||||||
| cons_info | post_questionnaire | "Information and consent" | descriptive | "<div class=""rich-text-field-label""><p><strong>Expert consultation: what characterises AI in the care of older people? – Closing questionnaire</strong><br><br><span style=""font-weight: normal;"">Thank you for taking part in the questionnaire and the meeting. In this last step you rate statements that we derived from your answers and the discussion. It takes about 15 minutes.</span><br><br><span style=""font-weight: normal;"">- The questionnaire is anonymous: no name | e-mail address or IP address is stored. Publications report only aggregated results and anonymized quotes.</span><br><span style=""font-weight: normal;"">- The anonymous data are kept for 10 years | in line with good scientific practice. The results inform a systematic review and a reporting guideline.</span><br><span style=""font-weight: normal;"">- Participation is voluntary. You may stop at any time. Because the answers are anonymous | they cannot be assigned to you or deleted after you submit them.</span><br><span style=""font-weight: normal;"">- Data controller: Kempten University of Applied Sciences. Contact: Jonas Schropp | jonas.schropp@hs-kempten.de</span></p></div>" | |||||||||||
| cons_participate | post_questionnaire | radio | "I agree to take part." | "1 | Yes | 0 | No" | y | ||||||||||||
| cons_quotes | post_questionnaire | radio | "I agree to anonymized quotes from my comments being published." | "1 | Yes | 0 | No" | "[cons_participate] = '1'" | y | |||||||||||
| intro | post_questionnaire | Instructions | descriptive | "<div class=""rich-text-field-label""><p><strong>Reference: clinical prediction models</strong><br><span style=""font-weight: normal;"">All statements compare AI in the care of older people with <strong>clinical prediction models</strong>: AI models that estimate an individual patient's probability of having (diagnosis) or developing (prognosis) a particular health outcome | as covered by the reporting guideline TRIPOD+AI and the risk-of-bias tool PROBAST+AI.</span><br><br><strong>How to rate</strong><br><span style=""font-weight: normal;"">- Please rate each statement <strong>in general</strong> | not for the case pairs from the first questionnaire.</span><br><span style=""font-weight: normal;"">- For each statement | say how far you agree (1) that the statement is true and (2) that it matters for how studies of AI in the care of older people should be reported or appraised.</span><br><span style=""font-weight: normal;"">- If you cannot judge a statement from your own expertise | choose <i>Cannot judge</i>.</span><br><span style=""font-weight: normal;"">- If you think a statement is put the wrong way or want to expand on your answer | you can suggest a better wording in the comment field. Comments are optional.</span></p></div>" | "[cons_participate] = '1'" | |||||||||
| s1_agree | post_questionnaire | "Statement 1 of 18<br><br>Unlike clinical prediction models | AI in the care of older people often affects the care recipient’s health only indirectly." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s1_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s1_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s2_agree | post_questionnaire | "Statement 2 of 18<br><br>Clinical prediction models usually target outcomes defined by a biomedical model of health (disease | complications | death). AI in the care of older people more often targets outcomes defined by a functional model of health (everyday functioning | participation | independence)." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | ||||
| s2_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s2_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s3_agree | post_questionnaire | "Statement 3 of 18<br><br>Unlike clinical prediction models | AI in the care of older people serves a broader spectrum of tasks." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s3_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s3_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s4_agree | post_questionnaire | "Statement 4 of 18<br><br>It is often harder to show that AI in the care of older people benefits the care recipient than it is for clinical prediction models." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s4_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s4_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s5_agree | post_questionnaire | "Statement 5 of 18<br><br>Unlike the outcomes of clinical prediction models | care outcomes often lack an accepted reference standard." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s5_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s5_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s6_agree | post_questionnaire | "Statement 6 of 18 | |||||||||||||||||
| Unlike clinical prediction models | which are usually tied to a defined clinical episode | AI in the care of older people is often used in everyday life without a defined end. " | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s6_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s6_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s7_agree | post_questionnaire | "Statement 7 of 18<br><br>Errors of AI in the care of older people often become visible later than errors of clinical prediction models." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s7_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s7_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s8_agree | post_questionnaire | "Statement 8 of 18<br><br>Errors of clinical prediction models usually have more critical consequences for health and life than errors of AI in the care of older people." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s8_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s8_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s9_agree | post_questionnaire | "Statement 9 of 18 | |||||||||||||||||
| Unlike for clinical prediction models | it is often not well defined who acts on the output of AI in the care of older people | and how." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s9_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s9_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s10_agree | post_questionnaire | "Statement 10 of 18<br><br>Unlike clinical prediction models | AI in the care of older people is often used under external conditions that can hardly be controlled." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s10_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s10_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s11_agree | post_questionnaire | "Statement 11 of 18<br><br>Unlike the structured routine clinical data used by clinical prediction models | the data used by AI in the care of older people are often less standardised." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s11_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s11_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s12_agree | post_questionnaire | "Statement 12 of 18<br><br>Unlike for clinical prediction models | much of the information relevant to decisions in care is undocumented knowledge held by formal and informal caregivers and therefore not available to the system." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s12_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s12_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s13_agree | post_questionnaire | "Statement 13 of 18<br><br>Whether results from laboratory or clinical studies transfer to real care settings is more uncertain than transfer between clinical settings." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s13_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s13_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s14_agree | post_questionnaire | "Statement 14 of 18<br><br>Unlike clinical prediction models | whose users are clinicians | AI in the care of older people is used by a broader range of people with very different levels of training." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | |||||
| s14_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s14_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s15_agree | post_questionnaire | "Statement 15 of 18<br><br>The target population of AI in the care of older people is often more heterogeneous in factors that affect the system’s performance than that of clinical prediction models." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | ||||||
| s15_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s15_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s16_agree | post_questionnaire | "Statement 16 of 18<br><br>Unlike for clinical prediction models | what AI in the care of older people achieves depends heavily on the care recipient’s support network." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s16_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s16_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s17_agree | post_questionnaire | "Statement 17 of 18<br><br>Unlike clinical prediction models | AI in the care of older people often collects data on the care recipient’s private everyday life | not only on their health." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | |||||
| s17_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s17_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| s18_agree | post_questionnaire | "Statement 18 of 18<br><br>Unlike for clinical prediction models | it is often less clearly defined who consents to the use of AI in the care of older people on behalf of a care recipient who cannot decide for themselves." | radio | "The statement is true." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||
| s18_rel | post_questionnaire | radio | "It matters for how studies of AI in the care of older people should be reported or appraised." | "1 | Strongly disagree | 2 | Disagree | 3 | Neither agree nor disagree | 4 | Agree | 5 | Strongly agree | 9 | Cannot judge" | "[cons_participate] = '1'" | y | |||||||
| s18_comment | post_questionnaire | notes | "Optional: comment or better wording" | "[cons_participate] = '1'" | |||||||||||||||
| post_add | post_questionnaire | "Final comments" | notes | "Having seen the discussion and the statements: is there anything you would like to add?" | "[cons_participate] = '1'" |