TY  - JOUR
AU  - Jovičić, Snežana
AU  - Siodmiak, Joanna
AU  - Alcorta, Marta Duque
AU  - Kittel, Maximillian
AU  - Oosterhuis, Wytze
AU  - Aakre, Kristin Moberg
AU  - Jørgensen, Per
AU  - Palicka, Vladimir
AU  - Kutt, Marge
AU  - Anttonen, Mikko
AU  - Georgieva Velizarova, Mileva
AU  - Marc, Jania
PY  - 2021
UR  - https://farfar.pharmacy.bg.ac.rs/handle/123456789/3789
AB  - There are many mobile health applications (apps) now available and some that use in some way laboratory medicine data. Among them, patient-oriented are of the lowest content quality. The aim of this study was to compare the opinions of non-laboratory medicine professionals (NLMP) with those of laboratory medicine specialists (LMS) and define the benchmarks for quality assessment of laboratory medicine apps. Twenty-five volunteers from six European countries evaluated 16 selected patient-oriented apps. Participants were 20-60 years old, 44% were females, with different educational degrees, and no professional involvement in laboratory medicine. Each participant completed a questionnaire based on the Mobile Application Rating Scale (MARS) and the System Usability Scale, as previously used for rating the app quality by LMS. The responses from the two groups were compared using the Mann-Whitney U test and Spearman correlation. The median total score of NLMP app evaluation was 2.73 out of 5 (IQR 0.95) compared to 3.78 (IQR 1.05) by the LMS. All scores were statistically significantly lower in the NLMP group (p<0.05), except for the item Information quality (p=0.1631). The suggested benchmarks for a useful appear: increasing awareness of the importance and delivering an understanding of persons' own laboratory test results; understandable terminology; easy to use; appropriate graphic design, and trustworthy information. NLMP' evaluation confirmed the low utility of currently available laboratory medicine apps. A reliable app should contain trustworthy and understandable information. The appearance of an app should be fit for purpose and easy to use.
PB  - De Gruyter Open Ltd
T2  - Clinical Chemistry and Laboratory Medicine
T1  - Quality benchmarking of smartphone laboratory medicine applications: Comparison of laboratory medicine specialists' and non-laboratory medicine professionals' evaluation
DO  - 10.1515/cclm-2020-0869
ER  - 

@article{
author = "Jovičić, Snežana and Siodmiak, Joanna and Alcorta, Marta Duque and Kittel, Maximillian and Oosterhuis, Wytze and Aakre, Kristin Moberg and Jørgensen, Per and Palicka, Vladimir and Kutt, Marge and Anttonen, Mikko and Georgieva Velizarova, Mileva and Marc, Jania",
year = "2021",
abstract = "There are many mobile health applications (apps) now available and some that use in some way laboratory medicine data. Among them, patient-oriented are of the lowest content quality. The aim of this study was to compare the opinions of non-laboratory medicine professionals (NLMP) with those of laboratory medicine specialists (LMS) and define the benchmarks for quality assessment of laboratory medicine apps. Twenty-five volunteers from six European countries evaluated 16 selected patient-oriented apps. Participants were 20-60 years old, 44% were females, with different educational degrees, and no professional involvement in laboratory medicine. Each participant completed a questionnaire based on the Mobile Application Rating Scale (MARS) and the System Usability Scale, as previously used for rating the app quality by LMS. The responses from the two groups were compared using the Mann-Whitney U test and Spearman correlation. The median total score of NLMP app evaluation was 2.73 out of 5 (IQR 0.95) compared to 3.78 (IQR 1.05) by the LMS. All scores were statistically significantly lower in the NLMP group (p<0.05), except for the item Information quality (p=0.1631). The suggested benchmarks for a useful appear: increasing awareness of the importance and delivering an understanding of persons' own laboratory test results; understandable terminology; easy to use; appropriate graphic design, and trustworthy information. NLMP' evaluation confirmed the low utility of currently available laboratory medicine apps. A reliable app should contain trustworthy and understandable information. The appearance of an app should be fit for purpose and easy to use.",
publisher = "De Gruyter Open Ltd",
journal = "Clinical Chemistry and Laboratory Medicine",
title = "Quality benchmarking of smartphone laboratory medicine applications: Comparison of laboratory medicine specialists' and non-laboratory medicine professionals' evaluation",
doi = "10.1515/cclm-2020-0869"
}

Jovičić, S., Siodmiak, J., Alcorta, M. D., Kittel, M., Oosterhuis, W., Aakre, K. M., Jørgensen, P., Palicka, V., Kutt, M., Anttonen, M., Georgieva Velizarova, M.,& Marc, J.. (2021). Quality benchmarking of smartphone laboratory medicine applications: Comparison of laboratory medicine specialists' and non-laboratory medicine professionals' evaluation. in Clinical Chemistry and Laboratory Medicine
De Gruyter Open Ltd..
https://doi.org/10.1515/cclm-2020-0869

Jovičić S, Siodmiak J, Alcorta MD, Kittel M, Oosterhuis W, Aakre KM, Jørgensen P, Palicka V, Kutt M, Anttonen M, Georgieva Velizarova M, Marc J. Quality benchmarking of smartphone laboratory medicine applications: Comparison of laboratory medicine specialists' and non-laboratory medicine professionals' evaluation. in Clinical Chemistry and Laboratory Medicine. 2021;.
doi:10.1515/cclm-2020-0869 .

Jovičić, Snežana, Siodmiak, Joanna, Alcorta, Marta Duque, Kittel, Maximillian, Oosterhuis, Wytze, Aakre, Kristin Moberg, Jørgensen, Per, Palicka, Vladimir, Kutt, Marge, Anttonen, Mikko, Georgieva Velizarova, Mileva, Marc, Jania, "Quality benchmarking of smartphone laboratory medicine applications: Comparison of laboratory medicine specialists' and non-laboratory medicine professionals' evaluation" in Clinical Chemistry and Laboratory Medicine (2021),
https://doi.org/10.1515/cclm-2020-0869 . .

TY  - JOUR
AU  - Jovičić, Snežana
AU  - Siodmiak, Joanna
AU  - Watson, Ian D.
PY  - 2019
UR  - https://farfar.pharmacy.bg.ac.rs/handle/123456789/3307
AB  - Background: Many of the mobile applications (apps) used for delivering health interventions involve laboratory medicine data. This survey was conducted to search the online market for health apps that manage laboratory medicine data. The aim was to review them and perform a quality evaluation. Methods: Apps search criteria were "Lab results blood work", "Lab results", and "Health apps". After the stepwise exclusion process, 52 selected apps were downloaded and analyzed. For review and content analysis of the apps, a multidimensional tool for classifying and rating the quality of mobile health apps - Mobile App Rating Scale (MARS), was used. Results: Selected apps were classified into five categories according to their intended use by patients or physicians, and the type of data engaged. Spearman's correlation analysis found significant correlations between MARS individual scoring items, as with the subjective quality and number of technical aspects. Kruskal-Wallis analysis showed a significant difference in the number of technical aspects employed, MARS engagement and informational quality score items, total score, and subjective quality. The lowest values for all of these items were in the category of apps designed for patients, and the post hoc test showed that the difference was statistically significant between this and the values in all other categories. Conclusions: Apps designed for patients, are of the poorest quality, considering the total quality of the content and information they provide, estimated using the MARS tool. This estimation needs to be validated for laboratory medicine apps, and eventually modified after consideration of specific quality benchmarks.
PB  - Walter de Gruyter Gmbh, Berlin
T2  - Clinical Chemistry and Laboratory Medicine
T1  - Quality evaluation of smartphone applications for laboratory medicine
VL  - 57
IS  - 3
SP  - 388
EP  - 397
DO  - 10.1515/cclm-2018-0710
ER  - 

@article{
author = "Jovičić, Snežana and Siodmiak, Joanna and Watson, Ian D.",
year = "2019",
abstract = "Background: Many of the mobile applications (apps) used for delivering health interventions involve laboratory medicine data. This survey was conducted to search the online market for health apps that manage laboratory medicine data. The aim was to review them and perform a quality evaluation. Methods: Apps search criteria were "Lab results blood work", "Lab results", and "Health apps". After the stepwise exclusion process, 52 selected apps were downloaded and analyzed. For review and content analysis of the apps, a multidimensional tool for classifying and rating the quality of mobile health apps - Mobile App Rating Scale (MARS), was used. Results: Selected apps were classified into five categories according to their intended use by patients or physicians, and the type of data engaged. Spearman's correlation analysis found significant correlations between MARS individual scoring items, as with the subjective quality and number of technical aspects. Kruskal-Wallis analysis showed a significant difference in the number of technical aspects employed, MARS engagement and informational quality score items, total score, and subjective quality. The lowest values for all of these items were in the category of apps designed for patients, and the post hoc test showed that the difference was statistically significant between this and the values in all other categories. Conclusions: Apps designed for patients, are of the poorest quality, considering the total quality of the content and information they provide, estimated using the MARS tool. This estimation needs to be validated for laboratory medicine apps, and eventually modified after consideration of specific quality benchmarks.",
publisher = "Walter de Gruyter Gmbh, Berlin",
journal = "Clinical Chemistry and Laboratory Medicine",
title = "Quality evaluation of smartphone applications for laboratory medicine",
volume = "57",
number = "3",
pages = "388-397",
doi = "10.1515/cclm-2018-0710"
}

Jovičić, S., Siodmiak, J.,& Watson, I. D.. (2019). Quality evaluation of smartphone applications for laboratory medicine. in Clinical Chemistry and Laboratory Medicine
Walter de Gruyter Gmbh, Berlin., 57(3), 388-397.
https://doi.org/10.1515/cclm-2018-0710

Jovičić S, Siodmiak J, Watson ID. Quality evaluation of smartphone applications for laboratory medicine. in Clinical Chemistry and Laboratory Medicine. 2019;57(3):388-397.
doi:10.1515/cclm-2018-0710 .

Jovičić, Snežana, Siodmiak, Joanna, Watson, Ian D., "Quality evaluation of smartphone applications for laboratory medicine" in Clinical Chemistry and Laboratory Medicine, 57, no. 3 (2019):388-397,
https://doi.org/10.1515/cclm-2018-0710 . .

TY  - JOUR
AU  - Watson, Ian D.
AU  - Oosterhuis, Wytze P.
AU  - Jorgensen, Per E.
AU  - Dikmen, Zeliha Gunnur
AU  - Siodmiak, Joanna
AU  - Jovičić, Snežana
AU  - Aakre, Kristin M.
AU  - Palicka, Vladimir
AU  - Kutt, Marge
PY  - 2017
UR  - https://farfar.pharmacy.bg.ac.rs/handle/123456789/2816
AB  - Background: There is increasing interest in direct patient engagement including receiving their laboratory medicine results. We previously established an appetite for Specialists in Laboratory Medicine to support patients in understanding results. The aim of this study was to establish whether patients agreed with such an approach, determined through surveying views in eight European countries. Methods: A standardized five-question survey was administered across eight European countries to a total of 1084 individuals attending medical outpatient clinics, with 100 patients each in Poland, Serbia, Netherlands, Turkey and Czech Republic, 101 in Estonia, 116 in Denmark and 367 in Norway. The responses across countries were compared using the chi-square test (p lt 0.05). Results: Patients wanting their results ranged from 50% to 94% (mean 65%) of those responding positively, a mean of 72% wanted additional information with their results; direct receipt was preferred over referral to a website. Specialists in Laboratory Medicine providing such information were acceptable to a mean of 62% of those respondents wishing their results; in countries where payment was possible, there was little interest in making additional payment for such a service. Conclusions: A clear proportion of patients are interested in receiving their laboratory medicine results, the majority with explanatory notes; a role for Specialists in Laboratory Medicine is acceptable and raises the potential for direct engagement by such specialists with patients offering a new paradigm for the provision of laboratory medicine activities.
PB  - Walter de Gruyter Gmbh, Berlin
T2  - Clinical Chemistry and Laboratory Medicine
T1  - A survey of patients' views from eight European countries of interpretive support from Specialists in Laboratory Medicine
VL  - 55
IS  - 10
SP  - 1496
EP  - 1500
DO  - 10.1515/cclm-2017-0080
ER  - 

@article{
author = "Watson, Ian D. and Oosterhuis, Wytze P. and Jorgensen, Per E. and Dikmen, Zeliha Gunnur and Siodmiak, Joanna and Jovičić, Snežana and Aakre, Kristin M. and Palicka, Vladimir and Kutt, Marge",
year = "2017",
abstract = "Background: There is increasing interest in direct patient engagement including receiving their laboratory medicine results. We previously established an appetite for Specialists in Laboratory Medicine to support patients in understanding results. The aim of this study was to establish whether patients agreed with such an approach, determined through surveying views in eight European countries. Methods: A standardized five-question survey was administered across eight European countries to a total of 1084 individuals attending medical outpatient clinics, with 100 patients each in Poland, Serbia, Netherlands, Turkey and Czech Republic, 101 in Estonia, 116 in Denmark and 367 in Norway. The responses across countries were compared using the chi-square test (p lt 0.05). Results: Patients wanting their results ranged from 50% to 94% (mean 65%) of those responding positively, a mean of 72% wanted additional information with their results; direct receipt was preferred over referral to a website. Specialists in Laboratory Medicine providing such information were acceptable to a mean of 62% of those respondents wishing their results; in countries where payment was possible, there was little interest in making additional payment for such a service. Conclusions: A clear proportion of patients are interested in receiving their laboratory medicine results, the majority with explanatory notes; a role for Specialists in Laboratory Medicine is acceptable and raises the potential for direct engagement by such specialists with patients offering a new paradigm for the provision of laboratory medicine activities.",
publisher = "Walter de Gruyter Gmbh, Berlin",
journal = "Clinical Chemistry and Laboratory Medicine",
title = "A survey of patients' views from eight European countries of interpretive support from Specialists in Laboratory Medicine",
volume = "55",
number = "10",
pages = "1496-1500",
doi = "10.1515/cclm-2017-0080"
}

Watson, I. D., Oosterhuis, W. P., Jorgensen, P. E., Dikmen, Z. G., Siodmiak, J., Jovičić, S., Aakre, K. M., Palicka, V.,& Kutt, M.. (2017). A survey of patients' views from eight European countries of interpretive support from Specialists in Laboratory Medicine. in Clinical Chemistry and Laboratory Medicine
Walter de Gruyter Gmbh, Berlin., 55(10), 1496-1500.
https://doi.org/10.1515/cclm-2017-0080

Watson ID, Oosterhuis WP, Jorgensen PE, Dikmen ZG, Siodmiak J, Jovičić S, Aakre KM, Palicka V, Kutt M. A survey of patients' views from eight European countries of interpretive support from Specialists in Laboratory Medicine. in Clinical Chemistry and Laboratory Medicine. 2017;55(10):1496-1500.
doi:10.1515/cclm-2017-0080 .

Watson, Ian D., Oosterhuis, Wytze P., Jorgensen, Per E., Dikmen, Zeliha Gunnur, Siodmiak, Joanna, Jovičić, Snežana, Aakre, Kristin M., Palicka, Vladimir, Kutt, Marge, "A survey of patients' views from eight European countries of interpretive support from Specialists in Laboratory Medicine" in Clinical Chemistry and Laboratory Medicine, 55, no. 10 (2017):1496-1500,
https://doi.org/10.1515/cclm-2017-0080 . .

TY  - JOUR
AU  - Watson, Ian D.
AU  - Siodmiak, Joanna
AU  - Oosterhuis, Wytze P.
AU  - Corberand, Joel
AU  - Jorgensen, Per E.
AU  - Dikmen, Zeliha Gunnur
AU  - Jovičić, Snežana
AU  - Theodorsson, Elvar
PY  - 2015
UR  - https://farfar.pharmacy.bg.ac.rs/handle/123456789/2302
AB  - Background: Medicine is a highly professionalized endeavour, by tradition centred on the authority of physicians. Better education and the advent of the information age cater for increased demands on society in general and on health care in particular to enable people to make informed decisions regarding themselves. Participation in medical decisions requires informed knowledge which is hard to obtain without substantial and time consuming professional help. Methods: We performed a survey amongst the member organizations of European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) in order to investigate the recognition and preparedness of providing help to patients in interpreting their laboratory results. Results: Out of 40 EFLM Member Societies, 27 sent their responses to the survey. In most cases the first line delivery of laboratory results to physicians is by computer link (63%). Patients receive their laboratory results on demand from their physician in 60% of cases. However, 34% of laboratory specialists showed a negative attitude for delivering laboratory results to patients. Yet, in 48% of countries 1-5 patients per day ask a laboratory specialist about the significance of laboratory results outside the reference range. When patients are informed about the purpose of laboratory testing, they seek information primarily from their physician, followed by the internet and the Specialist in Laboratory Medicine. Conclusions: Changing practices increasingly enabling patient access to their records are on the increase facilitated by recent innovations in information technologies. Successful transfer of some of the responsibilities of physicians, demands a mutual triangular dialogue between the patient, their physician and laboratory medicine.
PB  - Walter de Gruyter Gmbh, Berlin
T2  - Clinical Chemistry and Laboratory Medicine
T1  - European views on patients directly obtaining their laboratory test results
VL  - 53
IS  - 12
SP  - 1961
EP  - 1966
DO  - 10.1515/cclm-2015-0056
ER  - 

@article{
author = "Watson, Ian D. and Siodmiak, Joanna and Oosterhuis, Wytze P. and Corberand, Joel and Jorgensen, Per E. and Dikmen, Zeliha Gunnur and Jovičić, Snežana and Theodorsson, Elvar",
year = "2015",
abstract = "Background: Medicine is a highly professionalized endeavour, by tradition centred on the authority of physicians. Better education and the advent of the information age cater for increased demands on society in general and on health care in particular to enable people to make informed decisions regarding themselves. Participation in medical decisions requires informed knowledge which is hard to obtain without substantial and time consuming professional help. Methods: We performed a survey amongst the member organizations of European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) in order to investigate the recognition and preparedness of providing help to patients in interpreting their laboratory results. Results: Out of 40 EFLM Member Societies, 27 sent their responses to the survey. In most cases the first line delivery of laboratory results to physicians is by computer link (63%). Patients receive their laboratory results on demand from their physician in 60% of cases. However, 34% of laboratory specialists showed a negative attitude for delivering laboratory results to patients. Yet, in 48% of countries 1-5 patients per day ask a laboratory specialist about the significance of laboratory results outside the reference range. When patients are informed about the purpose of laboratory testing, they seek information primarily from their physician, followed by the internet and the Specialist in Laboratory Medicine. Conclusions: Changing practices increasingly enabling patient access to their records are on the increase facilitated by recent innovations in information technologies. Successful transfer of some of the responsibilities of physicians, demands a mutual triangular dialogue between the patient, their physician and laboratory medicine.",
publisher = "Walter de Gruyter Gmbh, Berlin",
journal = "Clinical Chemistry and Laboratory Medicine",
title = "European views on patients directly obtaining their laboratory test results",
volume = "53",
number = "12",
pages = "1961-1966",
doi = "10.1515/cclm-2015-0056"
}

Watson, I. D., Siodmiak, J., Oosterhuis, W. P., Corberand, J., Jorgensen, P. E., Dikmen, Z. G., Jovičić, S.,& Theodorsson, E.. (2015). European views on patients directly obtaining their laboratory test results. in Clinical Chemistry and Laboratory Medicine
Walter de Gruyter Gmbh, Berlin., 53(12), 1961-1966.
https://doi.org/10.1515/cclm-2015-0056

Watson ID, Siodmiak J, Oosterhuis WP, Corberand J, Jorgensen PE, Dikmen ZG, Jovičić S, Theodorsson E. European views on patients directly obtaining their laboratory test results. in Clinical Chemistry and Laboratory Medicine. 2015;53(12):1961-1966.
doi:10.1515/cclm-2015-0056 .

Watson, Ian D., Siodmiak, Joanna, Oosterhuis, Wytze P., Corberand, Joel, Jorgensen, Per E., Dikmen, Zeliha Gunnur, Jovičić, Snežana, Theodorsson, Elvar, "European views on patients directly obtaining their laboratory test results" in Clinical Chemistry and Laboratory Medicine, 53, no. 12 (2015):1961-1966,
https://doi.org/10.1515/cclm-2015-0056 . .