GET THE APP

Validation of a Smartphone Application for Assessment of the Risk
Journal of Hematology & Thromboembolic Diseases

Journal of Hematology & Thromboembolic Diseases
Open Access

ISSN: 2329-8790

+44 1478 350008

Research Article - (2016) Volume 4, Issue 4

Validation of a Smartphone Application for Assessment of the Risk of Venous Thromboembolism in Medical Patients

Galila Zaher1* and Soheir Adam1,2
1Department of Hematology, King Abdulaziz University, Jeddah, Saudi Arabia
2Department of Medicine, Division of Hematology Oncology, Duke University Medical Center, Durham, USA
*Corresponding Author: Galila Zaher, MD, FRCPath, Associate Professor in Hematology, King Abdulaziz University, Jeddah, Saudi Arabia, Tel: 00966543025300 Email:

Abstract

Objective: To validate a smartphone application-based clinical decision support system (CDSS) for risk assessment of venous thromboembolism (VTE) in hospitalized medical patients.

Setting: The medical department of a teaching hospital in Jeddah, Saudi Arabia. Participants: 97 patients, admitted to the medical ward during the month of December 2015.

Aim of the study: A smart phone application based CDSS was developed to assess the risk of VTE in medical patients. Patient data were collected and risk of VTE was calculated simultaneously by the application and by an expert hematologist. The aim of the study was to determine agreement between both sources.

Results: Ninety-seven patients, mean age 50 (19-92) and 51% (50) males were included. Forty-eight percent of patients were stratified as high-risk score based on CDSS compared to forty-seven percent based on expert opinion. There was a strong agreement between the CDSS and the expert hematologist opinion, on the indication and type of prophylaxis suggested for patients with a high-risk score (Chi square 86.7 and 155, p= 0.000, p=0.000, respectively). There was also an agreement with expert hematologist on the need for thromboprophylaxis as well as the type of prophylaxis (Chi square 86.7 and 1.55 respectively).

Conclusion: Smartphone application-based CDSS shows a strong agreement with expert opinion for determination of VTE risk score in medical patients. Thus, the smart-phone based CDSS application has the potential to improve physician compliance with guidelines and reduce inappropriate use of thromboprophylaxis, therefore improving clinical care.

Keywords: Venous thromboembolism; Thromboprophylaxis; Clinical decision support system; Smartphone application

Introduction

Hospitalization for medical illness accounts for 22% of venous thromboembolism (VTE) cases [1]. The incidence of deep vein thrombosis (DVT) in this population without thromboprophyalxis is 10.5-14.9% [2]. The use of appropriate thromboprophylaxis reduces the risk of DVT by 53%, the risk of pulmonary embolism (PE) by 57%, and fatal PE by 62% [2]. However, the utilization of thromboprophylaxis in a large cohort of 15,000 hospitalized patients was found to be 60% and 40% in another study [3,4]. Moreover, in a tertiary center in a developing country, the percentage of hospitalized medical patients on thromboprophylaxis was much lower at 12.5% [5].

Various interventions were studied to improve adherence to clinical guidelines for thromboprophylaxis in medical patients. A systematic review of available interventions found that education and alerts were effective in improving prescription of appropriate thromboprophylaxis in hospitalized patients [6].

Multifaceted interventions were significantly associated with better outcomes. Clinical Decision Support Systems (CDSS) can serve as handy tools that allow clinicians to access available evidence and help formulate clinical decisions. Adherence of healthcare providers to venous thromboembolism guidelines was previously shown to improve following the introduction of a CDSS to a tertiary Centre. Furthermore, there was a significant reduction of hospital acquired venous thromboembolism (VTE) [7].

This study aims to validate a CDSS developed at King Abdulaziz University hospital, for risk assessment of VTE and recommendation of thromboprophylaxis in patients admitted for medical care.

Participants and Methods

The study was conducted at King Abdulaziz University Hospital following approval of the hospital ethical committee.

Exclusion criteria

Patients admitted with a diagnosis of acute DVT and/or PE and patients with active cancer were excluded from the study. Ninety-seven consecutive patients admitted to the medical ward during December 2015 were included. We developed a Smartphone application-based clinical decision support system (CDSS), for assessment of the risk of VTE in medical patients. The application utilizes the Padua score for VTE risk stratification to calculate individual patient risk scores. The choice of thromboprophylaxis is determined based on the American College of Chest Physicians (ACCP) guidelines. Heparin contraindications and patients renal functions are taken into consideration.

Methodology

Medical students trained to use the application by one of the application developers entered individual risk factors for each participant in the CDSS application. Data collected from medical records includes; date of birth, age, recent surgery, immobility, history of active cancer, thrombophilia, cardiac and respiratory failure, acute myocardial infarction, acute infection, rheumatological disorder, hormonal treatment, prescribed pharmacological thromboprophylaxis, heparin contraindications and creatinine clearance (Figures 1-3). Thromboprophylaxis decision created by the CDSS application was compared to the decision of an independent expert hematologist. The expert was blinded to the results of the application.

haematology-thromboembolic-diseases-medical-patients

Figure 1: Risk assesment in medical patients.

haematology-thromboembolic-diseases-Heparin-exclusion

Figure 2: Heparin exclusion center.

haematology-thromboembolic-diseases-Total-score

Figure 3: Total score.

Main outcome measure

Agreement on clinical decision determined by the CDSS application, and the expert hematologist.

Statistical analysis

Analysis included all eligible patients. All statistical analyses were performed using SAS version 6.12 computer software (SAS Institute Inc, Cary, NC). When we examined the distribution we found that the data approached to normal distribution (symmetrical), therefore the chi-square test was used to study the agreement between results obtained by the CDSS application and the expert opinion. The percent correlation coefficient was used to study the strength and direction of the relation between both methods used. To calculate the statistical power of the study after it has been conducted, post hoc analysis was performed.

Results

Ninety-seven patients were included in the study. Age ranged between 15 and 92 years (mean age 50 years ± 17.7 years), 51.5% were males (Table 1). Forty-seven percent of patients were stratified as highrisk based on expert opinion and forty-eight percent of patients were stratified as high-risk score based on CDSS. There is a strong agreement between risk stratification based on CDSS and expert opinion (r=0.995=99.5%) (Table 1). Furthermore, thromboprophylaxis decision created by the CDSS application correlated well with to the decision made by an independent expert hematologist for both the indication and type of prophylaxis (Chi square 86.7 and 1.55 respectively) (Tables 2-3). The observed power was found to be 0.989 which means that there is no significant difference between smartphone application and expert opinion regarding the total score, furthermore, by using one-way anova and post hoc analysis the p-value is 0.778 which means no significant difference between smartphone application and expert opinion regarding the indication for treatment.

  Minimum Maximum Mean Std. Deviation  
Age 15 92 50 17.68  
Sex Frequency Percent      
Males 50 51.5      
Females 47 48.5      
  Smartphone   Expert   Pearson Chi-Square
  Number Percent Number Percent 86.728a
 High Score 47 48.40% 46 47.40% Asymp. Sig. (2-sided)
 Low Score 50 51.50% 51 52.50% .000

Table 1: Demographic data and number of patients classified as high and low score (high score is=or> 4).

  Expert Pearson Chi-Square
    Indicated Not Indicated 86.728a
Smartphone Indicated 39 0 Asymp. Sig. (2-sided)
  Not Indicated 0 58 0
  Total 39 58  

Table 2: Indication for prophylaxis by Smartphone and expert.

   Expert Pearson Chi-Square
Smartphone UFH LMWH None Total 155.3
UFH 25 1 0 26 Asymp. Sig. (2-sided)
LMWH 0 9 0 9 0
None 6 0 56 62  
Total 31 10 56 97  

Table 3: Type for prophylaxis by Smartphone and expert (UFH: Unfractionated Heparins, LMWH: low molecular weight Heparins).

Discussion

Venous thromboembolism (VTE) is a significant problem for hospitalized medical patients leading to the possibility of PE and risk of death [8]. The prevalence of autopsy-proven pulmonary embolism in hospitalized medical patients is 2.5% [9]. The risk of thrombosis in a hospital patient depends on individual patient risk factors including acute clinical presentation. Accurate estimation of the risk of thrombosis by health care providers without the aid of risk assessment tools is not easy [10]. The Paudua scoring system helps to classify patients into low or high risk for developing VTE [11]. A number of clear evidence-based guidelines (EBG), are available for thromboprophylaxis in medical patients [12,13].

There is growing awareness of the risk of VTE among hospitalized medical patients and the critically ill, and the use of thromboprophylaxis in this population is increasing [14,15]. Despite the availability of EBG for thromboprophylaxis, evidence suggests that these guidelines are underutilized [16,17]. Causes for under-utilization include variability in clinician knowledge of risk assessment and appropriate prophylaxis and lack of motivation regarding the need for prophylaxis [18]. Ageno et al. documented relatively poor prophylaxis practice for medical patients in 2 Italian hospitals where despite passive dissemination of guidelines only 46% of medical patients received appropriate prophylaxis [18]. A combination of multiple active compliance strategies are likely to be more effective for implementation than a single active strategy [19-21].

Computer-based clinical decision support systems (CDSSs) are defined as any software designed to directly help in clinical decisionmaking [22]. Patients characteristics are matched to a computerized knowledge for the purpose of generating patient-specific real-time recommendations [22]. It can perform complex evaluations and has the advantage of providing active reminders to the clinician and can also help minimize errors made by clinicians. Moreover, it can provide a method of continuing medical education and help improve physician compliance with the guidelines [23]. The first prominent computerbased clinical consultation system was MYCIN, which was designed to function as an aid for infectious disease diagnosis and therapy selection [24]. A critical area relevant to all medical CDSS is validation and evaluation. Accuracy of the clinical decision is the most important element to be evaluated [24]. Therefore CDSSs should be evaluated before widespread use in clinical practice. The Food and Drug Administration (FDA) issued guidance for the validation of medical device software to ensure accuracy, reliability, and consistent intended performance and it should be conducted using an independent expert opinion [25].

The aim of developing this CDSS application is to guide physicians through the systematic assessment of the risk of VTE in individual patients. Consequently, the application will determine the total score and prescribe the appropriate thromboprophylaxis in a few seconds. The CDSS application decision is based on the Padua VTE risk scoring system. Data is fed to the application in the form of yes or no responses, entered by pressing radio buttons in each group of questions. In order for the total score to be calculated, all questions must be answered. Following that, the choice of thromboprophylaxis will be determined based on the answers to a list of yes or no questions including the patient’s most recent creatinine clearance. Thus, the application recommends the type of thromboprophylaxis whether mechanical or pharmacological, based on individual patient data. If pharmacological thromboprophylaxis is recommended, details including class of medication, dose, frequency, mode of administration are provided. Results indicate that the risk score, indication and type of thromboprophylaxis derived from the CDSS application agreed well with the expert hematologist’s opinion. By using Chi square we can't reject the null hypothesis by Alpha=0.05. The correlation between the expert opinion and the application there is a strong positive correlation of 99.5%. Tooher et al. assessed the effectiveness of different strategies for improving the uptake of prophylaxis for VTE in hospitalized patients [19]. A number of active strategies were evaluated including computer-based. While all strategies resulted in improvement of the thromboprophylaxis practice, the most effective strategy for increasing adherence to guidelines appeared to be the CDSS. Implementation of clinical guidelines for venous thromboembolism prophylaxis through a CDSS used in an orthopedic surgery department was found to change physician attitudes and improve compliance with guidelines [26]. Fagot et al. reported that the provision of a patient-specific prescription order improved compliance with guidelines and the accuracy of prescription for VTE prophylaxis [26].

Leonardo’s project utilized a software for data collection and clinical decision making based on implemented guidelines and recommendations aimed to improve patient health outcomes and promote appropriate resource utilization. It provided automatic alerts and reminders regarding the health status of individual patients, and summary reports that could facilitate specialist visits. An initial assessment is conducted by the care manager to gather information from the patient to develop an individualized care plan. The specialist would review the patient’s system-generated decision and validate it. The project tried to highlight the importance of new professional care figures able to fill the great deficiency in the health care system. It demonstrated the feasibility of incorporating care managers into the health care system to support specialists in the management of patients [27].

In general, it would appear that CDSS are among the most effective strategies for improving prescription practices, which may be due to accessibility and the availability of automated reminders. CDSS applications guide clinicians to prescribe the appropriate thromboprophylaxis and minimize errors made by clinicians with variable experience, knowledge, and motivation for VTE prevention.

It can help to fill the great deficiency in specialized health care providers and help to minimize the gap between the release of the guidelines and its proper dissemination and utilization.

Study Limitations

This study included 97 patients and was limited to a single center, thus our experience may not be generalized to other centers. However, once the CDSS is available for download, it could serve a larger patient population, in diverse settings throughout the entire health care system. Recommendation for follow up studies: post implementation outcome studies are recommended.

Acknowledgment

Special thanks for Dr. Grigoris Gerotziafas, Department of Haemostasis, Hôpital Tenon, France for reviewing this article.

References

  1. Heit JA, O'Fallon WM, Petterson TM, Lohse CM, Silverstein MD, et al. (2002) Relative impact of risk factors for deep vein thrombosis and pulmonary embolism: a population-based study. Arch Intern Med 162:1245-1248.
  2. Douketis JD (2008) Prevention of venous thromboembolism in hospitalized medical patients: addressing some practical questions. CurrOpinPulm Med 14:381-388.
  3. Tapson VF, Decousus H, Pini M, Chong BH, Froehlich JB, et al. (2007) Venous thromboembolism prophylaxis in acutely ill hospitalized medical patients: findings from the International Medical Prevention Registry on Venous Thromboembolism. Chest 132: 936-945.
  4. Cohen AT, Tapson VF, Bergmann JF, Goldhaber SZ, Kakkar AK, et al. (2008) Venous thromboembolism risk and prophylaxis in the acute hospital care setting (ENDORSE study): a multinational cross-sectional study. Lancet 371: 387-394.
  5. Pandey A, Patni N, Singh M, Guleria R (2009) Assessment of risk and prophylaxis for deep vein thrombosis and pulmonary embolism in medically ill patients during their early days of hospital stay at a tertiary care center in a developing country. Vasc Health Risk Manag 5: 643-648.
  6. Kahn SR, Morrison DR, Cohen JM, Emed J, Tagalakis V, et al. (2013) Interventions for implementation of thromboprophylaxis in hospitalized medical and surgical patients at risk for venous thromboembolism. Cochrane Database Syst Rev : CD008201.
  7. Nazarenko GI, Kleymenova EB, Payushik SA, Otdelenov VA, Sychev DA, et al. (2015) Decision support systems in clinical practice: The case of venous thromboembolism prevention. Int J Risk Saf Med 27 Suppl 1: 104-105.
  8. Anderson FA Jr., Wheeler HB, Goldberg RJ, Hosmer DW, Patwardhan NA, et al. (1991) A population-based perspective of the hospital incidence and case-fatality rates of deep vein thrombosis and pulmonary embolism. The Worcester DVT Study. Arch Intern Med 151: 933-938.
  9. Baglin TP, White K, Charles A (1997) Fatal pulmonary embolism in hospitalised medical patients. J ClinPathol 50: 609-610.
  10. Montgomery AA, Fahey T, Peters TJ, MacIntosh C, Sharp DJ (2000) Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial. BMJ 320:686-690.
  11. Barbar S, Noventa F, Rossetto V, Ferrari A, Brandolin B, et al.(2010) A risk assessment model for the identification of hospitalized medical patients at risk for venous thromboembolism: the Padua Prediction Score. J ThrombHaemost 8:2450-2457.
  12. Nicolaides AN, Breddin HK, Fareed J, Goldhaber S, Haas S, et al. (2001)Prevention of venous thromboembolism. International Consensus Statement. Guidelines compiled in accordance with the scientific evidence. IntAngiol 20:1-37
  13. Lowe GDO, Greer IA, Cooke TG, Dewar EP, Evans MJ, et al. (1992) Risk of and prophylaxis for venous thromboembolism in hospital patients. Thromboembolic Risk Factors (THRIFT) Consensus Group. BMJ 305: 567- 574.
  14. Samama MM, Cohen AT, Darmon JY, Desjardins L, Eldor A, et al. (1999)  A comparison of enoxaparin with placebo for the prevention of venous thromboembolism in acutely ill medical patients. Prophylaxis in Medical Patients with Enoxaparin Study Group. N Engl J Med 341:793-800.
  15. Fraisse F, Holzapfel L, Couland JM, Simonneau G, Bedock B, et al. ( 2000) Nadroparin in the prevention of deep vein thrombosis in acute decompensated COPD. The Association of Non-University Affiliated Intensive Care Specialist Physicians of France. Am J RespirCrit Care Med 161:1109-1114.
  16. Yu HT, Dylan ML, Lin J, Dubois RW (2007) Hospitals' compliance with prophylaxis guidelines for venous thromboembolism. Am J Health Syst Pharm 64:69-76.
  17. Walker A, Campbell S, Grimshaw J (1999) Implementation of a national guideline on prophylaxis of venous thromboembolism: a survey of acute services in Scotland.Thromboembolism Prevention Evaluation Study Group. Health Bull (Edinb) 57:141-147.
  18. Ageno W, Squizzato A, Ambrosini F, Dentali F, Marchesi C, et al. (2002) Thrombosis prophylaxis in medical patients: a retrospective review of clinical practice patterns. Haematologica 87:746-750
  19. Tooher R, Middleton P, Pham C, Fitridge R, Rowe S, et al. (2005) A systematic review of strategies to improve prophylaxis for venous thromboembolism in hospitals. Ann Surg 241: 397-415.
  20. Kakkar AK, Davidson BL, Haas SK Investigators Against Thromboembolism Core G(2004) Compliance with recommended prophylaxis for venous thromboembolism: improving the use and rate of uptake of clinical practice guidelines. J ThrombHaemost 2:221-227.
  21. Byrne GJ, McCarthy MJ, Silverman SH (1996) Improving uptake of prophylaxis for venous thromboembolism in general surgical patients using prospective audit. BMJ 313: 917.
  22. Berners-Lee T, Hendler J (2001) Publishing on the semantic web. Nature. 410:1023-1024
  23. Hunt DL, Haynes RB, Hanna SE, Smith K (1998) Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 280: 1339-1346.
  24. Yu VL, Buchanan BG, Shortliffe EH, Wraith SM, Davis R, et al. (1979) Evaluating the performance of a computer-based consultant. Comput Programs Biomed 9:95-102.
  25. Keatley KL (1999) A review of the FDA draft guidance document for software validation: guidance for industry. QualAssur 7:49-55.
  26. Fagot JP, Flahault A, Kanfer A, Benoit G, Bellanger A, et al. (2000) Prevention of venous thromboembolism in a non-surgical medical ward. Proposed indications for low molecular weight heparin.  Presse Med 29:4-10.
  27. Ciccone MM, Aquilino A, Cortese F, Scicchitano P, Sassara M, et al. (2010) Feasibility and effectiveness of a disease and care management model in the primary health care system for patients with heart failure and diabetes (Project Leonardo). Vascular Health and Risk Management 6: 297-305.
Citation: Zaher G, Adam S (2016) Validation of a Smartphone Application for Assessment of the Risk of Venous Thromboembolism in Medical Patients. J Hematol Thrombo Dis 4:251.

Copyright: © 2016 Zaher G, et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Top