Article Text
PDF
Abstract
Introduction We aimed to develop a prediction model for foot ulcer recurrence in people with diabetes using easy-to-obtain clinical variables and to validate its predictive performance in order to help risk assessment in this high-risk group.
Research design and methods We used data from a prospective analysis of 304 people with foot ulcer history who had 18-month follow-up for ulcer outcome. Demographic, disease-related and organization-of-care variables were included as potential predictors. Two logistic regression prediction models were created: model 1 for all recurrent foot ulcers (n=126 events) and model 2 for recurrent plantar foot ulcers (n=70 events). We used 10-fold cross-validation, each including five multiple imputation sets for internal validation. Performance was assessed in terms of discrimination using area under the receiver operating characteristic curve (AUC) (0–1, 1=perfect discrimination), and calibration with the Brier Score (0–1, 0=complete concordance predicted vs observed values) and calibration graphs.
Results Predictors in model 1 were: a younger age, more severe peripheral sensory neuropathy, fewer months since healing of previous ulcer, presence of a minor lesion, use of a walking aid and not monitoring foot temperatures at home. Mean AUC for model 1 was 0.69 (2SD 0.040) and mean Brier Score was 0.22 (2SD 0.011). Predictors in model 2 were: a younger age, plantar location of previous ulcer, fewer months since healing of previous ulcer, presence of a minor lesion, consumption of alcohol, use of a walking aid, and foot care received in a university medical center. Mean AUC for model 2 was 0.66 (2SD 0.023) and mean Brier Score was 0.16 (2SD 0.0048).
Conclusions These internally validated prediction models predict with reasonable to good calibration and fair discrimination who is at highest risk of ulcer recurrence. The people at highest risk should be monitored more carefully and treated more intensively than others.
Trial registration number NTR5403.
- diabetic foot
- foot ulcer
- models
- statistical
Data availability statement
Data are available upon reasonable request.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Significance of this study
What is already known about this subject?
People with diabetes, neuropathy and foot ulcer history are in all ulcer risk classification systems stratified as those at highest risk; however, disease severity and ulcer risk vary substantially within this stratum. To provide appropriate preventative treatment and adequately allocate limited recourses, further differentiation for ulcer risk using easy-to-obtain clinical variables in this stratum is necessary.
What are the new findings?
Predictors for foot ulcer recurrence were: a younger age, more severe peripheral sensory neuropathy, fewer months since healing of the previous ulcer, presence of a minor lesion, use of a walking aid and not monitoring foot temperature at home.
Predictors for plantar foot ulcer recurrence were: a younger age, plantar location of the previous ulcer, fewer months since healing of the previous ulcer, presence of a minor lesion, consumption of alcohol, use of a walking aid, and foot care received in a university medical center.
All predictors found can be easily obtained by healthcare professionals when screening people with diabetes and foot ulcer history.
How might these results change the focus of research or clinical practice?
Clinical practice may use these prediction models to better determine which high-risk people with diabetes should be monitored more carefully and treated more intensively.
Introduction
A foot ulcer is a feared and common complication in people with diabetes mellitus. The presence of a foot ulcer has a major impact on an individual’s quality of life and places a large burden on both healthcare systems and society.1–3 The annual incidence of a foot ulcer in people with diabetes is approximately 2%,4 while recently the global prevalence was estimated at 18.6 million (4.8% of all people with diabetes).5 Approximately 40% of the patients who heal from an ulcer develop another one within the first 12 months, and 60% within 3 years.6 Because of the high incidence of recurrence and subsequent risk of infection, hospital admission and amputation,7 prevention of ulcer recurrence is paramount.
In (inter)national guidelines and in current clinical practice, treatment to help prevent a foot ulcer starts with the determination of someone’s risk of developing one.8–10 Various systems have been developed and validated to stratify people with diabetes according to their risk for ulceration.11–13 Guidelines, such as those from the American Diabetes Association,9 or the International Working Group on the Diabetic Foot (IWGDF),10 recommend that people should be screened more frequently when their risk for ulceration increases. In all systems, people with neuropathy and a foot ulcer history are stratified as those at highest risk. However, within this risk group, disease severity and ulcer risk vary substantially.14–19 To provide appropriate preventative treatment strategies and to adequately allocate limited recourses, it is important to further differentiate for foot ulcer risk within those people in the highest risk stratum.
Risk factor models can be used for this purpose. Armstrong and colleagues reviewed studies reporting risk factor models for ulcer recurrence,6 and found a vibration perception threshold >25 V,20 a minor lesion,15 a previous ulcer at the plantar foot surface,14 21 and peripheral artery disease14 to be the most important independent risk factors. However, the risk models used in these studies are incomplete and inconsistent in description and interpretation and often lack validation. Also, these studies aimed to explain whether foot ulcer recurrence can reliably be attributed to a risk factor, after adjusting for confounders, in a multivariate analysis, that is, a search for causality. In contrast, prediction models use multiple variables to predict, as accurately as possible, the risk of a future outcome, regardless of causality.22 All causal factors are predictors, but not every predictor is a cause. Therefore, more and often easier to obtain variables can be considered in a prediction model than an etiological (causal) model, making prediction models more suitable in daily practice to timely identify people at high risk of ulcer recurrence.
Crawford and colleagues were the first to develop and externally validated a prediction model for people with diabetes at low to high risk of ulceration, and identified as predictors a history of ulceration, inability to feel a 10 g monofilament and absence of at least one pedal pulse.23 These are easy-to-obtain variables in every clinical setting, which facilitates implementation. However, this model does not distinguish between the ulcer risk of people who are stratified as high risk (IWGDF grade 3). The only prediction model developed for high-risk people is our own, on data from 171 people with a recently healed plantar foot ulcer who participated in a trial on efficacy of custom-made footwear.24 This model included quantitative biomechanical parameters that are not available in every clinical setting. Furthermore, this model focused on plantar foot ulcer recurrence only, while at least half of all foot ulcers develop at other anatomical locations.7 It also used a selected group of high-risk people who all wore custom-made footwear and had their previous foot ulcer healed within 18 months of study entry, limiting its generalizability and implementation. We therefore aimed to develop a prediction model for foot ulcer recurrence using a variety of more easy-to-obtain clinical variables in a diverse group of high-risk people with diabetes (all IWGDF risk 3), and to validate its predictive performance, so to help risk assessment and preventative treatment in this high-risk group.
Methods
Population
We used data from a multicenter randomized controlled trial (RCT) on the effectiveness of at-home monitoring of foot temperatures to prevent foot ulcer recurrence in diabetes.25 In this trial, we recruited participants between 2015 and 2018 from multidisciplinary outpatient diabetic foot clinics of three university medical centers and four community hospitals, and several affiliated professional podiatry practices, all from various regions across the Netherlands. The participants received their primary foot care in the centers where they were recruited. From a total of 1411 people screened for eligibility, 304 participants with diabetes, loss of protective sensation (LOPS) and a history of foot ulceration (<48 months prior to enrollment) or a history of Charcot neuro-osteoarthropathy were included in this study. LOPS was assessed using a 10 g Semmes-Weinstein monofilament and a 128 Hz tuning fork.10 We defined a Charcot neuro-osteoarthropathy as a non-infectious destruction of bone and joint(s) associated with neuropathy, in the acute (active) phase associated with signs of inflammation such as edema, erythema and skin temperature changes.26 27 After consolidation and in the absence of clinical signs the episode of active Charcot neuro-osteoarthropathy was considered to be resolved.26 27 We excluded individuals if they had a foot ulcer, a foot infection, an active Charcot neuro-osteoarthropathy, chronic limb-threatening ischemia (ie, grade 3 Perfusion Extent Depth Infection Sensation (PEDIS) classification),28 bilateral amputation proximal to the tarsometatarsal (Lisfranc) joint, an estimated survival less than 18 months, or if they already used at-home foot temperature monitoring. Participants were randomly assigned to usual care or enhanced care that in addition to usual care included at-home daily measurement of foot temperature at six to eight predefined locations on the foot using infrared thermometry.25 Follow-up time was 18 months. This study was registered on the Netherlands Trial Register.
Primary outcome
The primary outcome was foot ulcer recurrence during the 18 months of follow-up. A foot ulcer was defined as a full-thickness lesion of the skin of the foot, irrespective of duration.27 If the participant or treating healthcare professional identified an ulcer during follow-up, the professional was instructed to complete a foot ulcer form, take photographs of the ulcer, and send all materials to the study team. During three monthly follow-up calls, participants were asked about any lesion that had occurred, and we checked the electronic patient files for any unreported ulcer. Three independent diabetic foot experts assessed ulcer forms and photographs to determine the ulcer outcome. If not unanimous, two other experts were consulted and a majority vote determined the outcome.
Potential predictors
We included demographic, disease-related, and organization-of-care variables as potential predictors of foot ulcer recurrence. These potential predictors were collected at baseline through anamnesis, physical examination or questionnaires, and are listed in table 1.
Characteristics of the 304 study participants
We classified the consumption of alcohol as none versus ≥1 unit/week and employment as none versus any (retirement was considered as unemployed). If participants were treated by a nephrologist or ophthalmologist, they were considered to have diabetic nephropathy or diabetic retinopathy, respectively. Peripheral neuropathy was assessed by measuring the LOPS by using the 10 g (5.07) Semmes-Weinstein monofilament at the plantar surface of the hallux and the first and fifth metatarsal heads of both feet.10 LOPS was present when the monofilament was not felt on two or more locations. If the monofilament was felt on two or more locations, a 128 Hz tuning fork was used to assess loss of vibratory sensation. The tuning fork was held on the apex of the great toe and loss of vibratory sensation was present when the participant indicated not to feel the vibration.10 We defined severity of peripheral neuropathy as mild when participants were able to sense the 10 g monofilament, but not the 128 Hz tuning fork, and as severe when they were unable to sense both. Peripheral artery disease was defined as grade 1 or 2.28 We classified foot deformity as absent, mild, moderate or severe.15 29 A minor lesion was defined as a non-ulcerative lesion of the skin on the foot, that is, abundant callus, hemorrhage, or blister.15
We asked participants seven questions regarding their self-care behavior in ulcer prevention (eg, ‘do you walk barefoot at home?’, see online supplemental table 1), and scored their adherence to self-care from 0 (worst) to 7 (best). We obtained health-related quality of life on eight domains of the RAND 36-Item Short Form Health Survey (SF-36) (version 1.0)30 and the EuroQol visual analog scale (EQ VAS).31 SF-36 scores were recoded and combined and ranged from 0 (worst) to 100 (best). The EQ VAS score also ranged from 0 (worst imaginable health) to 100 (best imaginable health). We assessed the socioeconomic status (SES) per participant as per postal code, provided by the Netherlands Institute for Social Research (outcome ranges from −5 for lowest possible SES to +5 for highest possible SES).
Supplemental material
There were no potential predictors that showed to be strongly correlated with each other (ie, correlation coefficient >0.5) and therefore we considered all the above-mentioned potential predictors as variables in the model.
No variable had more than 25% of missing data (table 1). We used five multivariate imputations for all variables with missing values by applying the chained equations approach.32 This provided multiple imputations for multivariate missing data for any variable type, where each incomplete variable was imputed by a separate model (fully conditional specification method).
Model development
We developed two logistic regression models to predict foot ulcer recurrence: one for any ulcer recurrence (model 1), and one for plantar foot ulcer recurrence (model 2). We adhered to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis statement.33
We considered all potential predictors as variables for the models based on clinical reasoning, knowledge from peer-reviewed literature, and availability in everyday clinical practice.
Model fitting and validation
Model development was conformed to previous strategies,24 and went through four stages: (1) the creation of five data sets without missing values using multiple imputations; (2) selection of potential predictors selected in the majority of the imputed data sets; (3) fitting a logistic regression model on each of the five imputed data sets to predict ulcer outcome based on these variables; and (4) pooling the coefficients of the separate five models to obtain the final prediction model. The final logistic regression model was represented by its linear predictor. Predicted probabilities were calculated using the linear predictor in the formula: 1/(1+e-linear predictor).
In each imputation data set we used backward variable selection based on the Akaike information criterion (AIC) to find the optimal set of predictors.34 By giving a penalty for model complexity (in terms of the number of included variables), the AIC strikes a good balance between the likelihood of the model (which always increases with the number of included variables) and its complexity (the more complex the model, the more likely it overfits the data).
We used 10-fold cross-validation to internally validate our prediction model. This means that the entire model development strategy (including the five multiple imputation data sets and the variable selection process) was repeated in each of the 10-folds on the training set (90% of the data) and tested on the 10% held-out data set of that fold.
Because our RCT may show that at-home foot temperature monitoring reduces risk of ulcer recurrence, this intervention may predict outcome in one or both models. We therefore developed the model both including and excluding this intervention, as foot temperature monitoring is not yet standard of practice, and other predictors may enter the model if the intervention is not considered.
Model performance
We assessed model performance in terms of discrimination and calibration.35 Discrimination refers to the ability of a model to give a higher probability of the event (ie, ulcer recurrence) to those participants with the event than those without. We measured discrimination for the final prediction model by the area under the receiver operating characteristic curve (AUC) using the mean and two times the SD (2SD).36 The AUC ranges from 0 to 1, with 1 representing perfect discrimination. Furthermore, we presented the AUC plots of the final models. Calibration refers to the closeness of the predicted values to the observed ones. We assessed the calibration using calibration graphs. The Brier Score, which combines both discrimination and calibration, was also assessed for all five pooled models and the final prediction model (mean, 2SD). The Brier Score is the mean squared error of a prediction and ranges from 0 to 1, with 0 representing perfect concordance between predicted and observed values.37
We performed descriptive statistics using SPSS V.26.0 (SPSS) and all model analyses in the R statistical environment (R Foundation for Statistical Computing V4.0.2 for Windows (http://www.R-project.org)),38 with the mice V.3.11.0 and bootStepAIC V.1.2-0 packages (both available on https://cran.r-project.org/ at the time of publication).
Results
Baseline participant characteristics are presented in table 1. Of a total 304 participants, 220 were male and the mean age was 64.6 years. Demographic data corresponded with previous studies.7 29 Foot ulcer recurrence in 18 months occurred in 126 participants (41.4%), with a mean time to ulceration of 212 days (SD: 154, range 5–532). Plantar foot ulcer recurrence occurred in 70 participants (23.0%), with a mean time to plantar ulceration of 206 days (SD: 159, range 15–532). During 18 months of follow-up there were no participants lost to follow-up, while eight participants died during follow-up. Table 2 provides the univariate analyses of all potential predictors with both outcomes.
Univariate analyses for potential predictors associated with outcome 1 (all recurrent foot ulcers) and outcome 2 (all recurrent plantar foot ulcers)
Model 1: ulcer recurrence at any foot site
This model contained six predictors (table 3): a younger age, more severe peripheral sensory neuropathy, fewer months since healing of the previous ulcer, presence of a minor lesion, and the use of a walking aid were positive predictors for ulcer recurrence and at-home foot temperature monitoring was a negative predictor for ulcer recurrence. The linear predictor was: 0.284–0.0299*age in years+1.57*more severe peripheral sensory neuropathy–0.0486*months since last healed ulcer+0.704*minor lesion present+0.800*use of walking aid–0.503*use of at-home foot temperature monitoring. When model 1 was rerun excluding foot temperature monitoring as intervention, the model contained the same predictors (results not shown).
Predictors for model 1 (all recurrent foot ulcers) and model 2 (all recurrent plantar foot ulcers)
Based on the average predictions per participant of the final model in the five imputed data sets, the predicted probability of foot ulcer recurrence and the observed number of recurrent foot ulcers agreed over almost the whole range of probabilities (figure 1). When the predicted probability was >0.70 the model slightly underestimated the proportion of observed ulcers. The mean AUC of the model was 0.69 (2SD 0.040) (figure 2). The mean Brier Score was 0.22 (2SD 0.011).
Calibration graphs for model 1 (all recurrent foot ulcers) and model 2 (all recurrent plantar foot ulcers). In each graph, the black lines show the observed proportion of the event versus the probability of the event as predicted by the model. Ideally, all the points fall on the diagonal red line.
Area under the receiver operating characteristic curve (AUC) for model 1 (all recurrent foot ulcers) and model 2 (all recurrent plantar foot ulcers).
Model 2: plantar foot ulcer recurrence
This model contained seven predictors (table 3): a younger age, plantar location of the previous ulcer, fewer months since healing of the previous ulcer, presence of a minor lesion, use of a walking aid, consumption of alcohol and foot care received in a university medical center. The linear predictor was: –0.129–0.0313*age in years+0.921*plantar location of the previous ulcer–0.0379*months since last healed ulcer+0.777*minor lesion present+0.828*use of walking aid+0.966*consumption of alcohol–(0.554*foot care received in a community hospital|–0.917*foot care received in a podiatry practice). For this equation, foot care received in a university medical center was the reference category.
Based on the average predictions per participant of the final model in the five imputed data sets, the predicted probability of foot ulcer recurrence and the observed number of recurrent foot ulcers agreed over almost the whole range of probabilities (figure 1). The predicted probability underestimated the observed ulcer recurrences when around 0.30 and slightly overestimated when >0.50 (figure 1). The mean AUC of the model was 0.66 (2SD 0.023) (figure 2). The mean Brier Score was 0.16 (2SD 0.0048).
Table 4 provides the predicted probabilities including the 95% CIs for two characteristic persons with diabetes using synthesized data.
The predicted probability of ulcer recurrence within 18 months using model 1 (all recurrent foot ulcers) and model 2 (all recurrent plantar foot ulcers) for two characteristic persons with diabetes using synthesized data
Discussion
We used data from the largest two-arm trial on foot ulcer recurrence in diabetes to date, including a representative and demographically and disease-related diverse group of people all at high risk of diabetic foot ulceration (IWGDF risk 3).10 In this group we found six predictors of foot ulcer recurrence. These predictors are all easy to obtain in clinical practice, and together capable of predicting ulcer recurrence with good calibration and fair discrimination. We found seven predictors of plantar foot ulcer recurrence, also all easy-to-obtain variables, together predicting with reasonable calibration and fair discrimination. These prediction models can help in risk assessment and in reallocating resources for ulcer prevention treatment in this high-risk group of people with diabetes.
Four predictors were identified in both models: younger age, use of a walking aid, presence of a minor lesion, and fewer months since last healed ulcer. A younger age has previously also been associated with a higher risk of ulcer development.2 39–41 Use of a walking aid was not previously considered as potential predictor in studies and subsequently never associated with ulcer recurrence. Use of a walking aid may represent more disease severity (eg, neuropathy, peripheral artery disease, foot deformity) or more frailty, affecting one’s ability to walk without additional support, and thus increasing risk of trauma and recurrence. Both of these variables are easy to obtain in clinical practice.
A minor lesion is a well-known risk factor of plantar foot ulcer recurrence, as previous studies have shown.15 24 Our findings confirm these results and extend them to any foot ulcer recurrence. The presence of a minor lesion should therefore warn healthcare professionals that immediate treatment is needed, such as through callus removal or offloading the minor lesion, and that patients should be seen more frequently until the minor lesion has been resolved.13 42 Fewer months since the last ulcer healed is likely a predictor because skin and underlying tissue are still regaining strength and remain vulnerable for breakdown in the first months after epithelization. Our models confirm earlier reports of a higher risk when time since last ulcer healed is shorter.6 This suggests that extra attention to offloading and more frequent foot care should be given in the first months after healing.
Peripheral sensory neuropathy and at-home monitoring foot temperature were specific predictors for ulcer recurrence at any foot site. Peripheral sensory neuropathy has been studied extensively in ulcer risk estimation in populations with and without ulcer history.23 43 44 Few studies found it to be associated with ulcer recurrence,20 40 presumably because most high-risk people have neuropathy, limiting its differential effect in risk analyses. However, peripheral sensory neuropathy advances progressively,45 46 where inability to perceive vibration from a tuning fork is a sign of an earlier stage of neuropathy, while inability to perceive pressure of a monofilament is a later stage sign.45 46 This may explain our finding that more severe peripheral sensory neuropathy (ie, lack of perception of both the vibration from the tuning fork and pressure from the monofilament) predicted ulcer recurrence (in comparison to only not sensing the vibration from the tuning fork).
These prediction models were based on data from an RCT explaining that the intervention of at-home monitoring of foot temperature was one of the potential predictors and turned out to be a predictor of ulcer recurrence in the study. Despite evidence from two meta-analyses,47 48 and recommendations for its use included in international guidelines,13 at-home monitoring of foot temperatures is not standard in clinical practice. We therefore ran the prediction model with and without this intervention and found the same predictors of ulcer recurrence regardless of its inclusion, indicating that these predictors are important, independent of this intervention, in foot ulcer recurrence.
Specific predictors for ulcer recurrence on the plantar foot were a plantar location of the previous ulcer, consumption of alcohol and foot care received in a university medical center. The first may be understandable from the more biomechanical etiology of plantar versus non-plantar foot ulcers, with plantar ulcers more likely to recur at the same site.6 15 Increased attention to offloading these high-risk plantar areas is needed.29 42 Only one previous study associated more alcohol consumption with ulcer recurrence.19 While moderate use of alcohol is acceptable in people with diabetes, a potential explanation could be the effect of alcohol on a person’s health in general and specifically on blood glucose regulation, which may in turn increase ulcer risk.49 Unfortunately, detailed information on the use of alcohol was not available in our study, and more research on this association is needed.
Foot care in a university medical center represents tertiary foot care as proposed in the IWGDF guidelines, and is therefore probably a marker for more disease severity.10 Furthermore, since it is only a predictor for plantar foot ulcer recurrence, it most likely reflects the more advanced biomechanical burden in these people treated in tertiary care. This larger burden might be explained by the wider availability of biomechanical assessment tools in university medical centers and subsequent referral from secondary to tertiary care of patients requiring such assessment.
Because data were obtained from a large multicenter trial in diabetic foot disease, our prediction models are limited to high-risk people with diabetes that match the inclusion criteria for the trial. While external validation is needed to determine generalizability of the models, the only trial-specific criteria concerned excluding participants with bilateral amputation proximal to the Lisfranc joint and expected survival <18 months. Future external validation may show differences in the performance due to potential selection bias in our trial compared with the situation were a prospective observational cohort analysis would have been conducted. Furthermore, with 126 and 70 ulcer events in the first and second models, respectively, we were limited by the number of predictors to select for the final model to avoid overfitting. Despite considering multiple potential predictors, our models had only fair discriminating performance. To increase performance, one likely needs to include more complex behavioral (eg, therapy adherence,29 stride count measures15 24 50), social-economic,51 or biomechanical (eg, barefoot or in-shoe plantar pressures15 24) variables. However, that would jeopardize clinical utility as these variables are hard to obtain in everyday clinical practice. Another limitation is the interobserver variability in assessing some foot-related parameters by different investigators, such as foot deformity, peripheral sensory neuropathy, peripheral artery disease and minor lesions. To improve on the latter, two independent observers assessed the photographs of the feet for presence of foot deformity and minor lesions and they reached consensus on the outcome.
All predictors found can be easily obtained by healthcare professionals when screening people at high risk, and thus the prediction models can be readily applied in everyday clinical practice. Using the linear predictor from both models, a healthcare provider can determine someone’s risk of ulcer recurrence. When doing so, it is important to know that predictors should not be interpreted individually, but only as a combination of variables that together may determine the risk of ulceration. To illustrate the potential use of the prediction models in clinical practice, we used synthesized data of two characteristic persons with diabetes and estimated the probability for ulcer recurrence (table 4). Person A has a high probability of developing a recurrent ulcer within 18 months, while person B has a low probability of developing a recurrent ulcer within 18 months. The combination of non-modifiable and modifiable predictors may help healthcare providers to better determine the frequency of foot screening and care, while the modifiable predictors (ie, minor lesions, use of at-home foot temperature monitoring, alcohol use) may suggest potential preventative treatment that aims to mitigate the risk for recurrence. Because of the high risk of ulcer recurrence, person A might, for example, be monitored carefully and treated for minor lesions. However, we emphasize that to understand the effect on ulcer recurrence risk of interventions targeting these modifiable predictors, adequately powered trials or etiological analyses are needed. On a more macroscopic level, our prediction models may help national health authorities and healthcare insurance companies in health policy so to better allocate the limited resources for foot care for people with diabetes who are at risk of foot ulceration.
Conclusion
These internally validated prediction models contain easy-to-obtain modifiable and non-modifiable variables and are built from a representative and diverse group of people with diabetes, neuropathy and foot ulcer history. These models better stratify people at high risk of foot ulceration and help determine who should be monitored more carefully and treated more intensively with the aim to improve on the prevention of foot ulcer recurrence in people with diabetes.
Data availability statement
Data are available upon reasonable request.
Ethics statements
Ethics approval
This study was approved by the research ethics committees of all seven participating centers (approval ID 2015_105 from the ethics committee of the main study site, Amsterdam UMC–Location AMC). We obtained written informed consent prior to inclusion from all participants.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Contributors SAB conceived and designed the original trial from which the data were used. WBAdS, AAH and SAB conceived the plan for this study. WBAdS, JJvN and SAB collected the data. MCS, AAH and WBAdS ran the prediction models and performed the statistical analysis. WBAdS wrote the manuscript. MCS, AAH, JJvN, JGvB and SAB critically reviewed and edited the manuscript. All authors read and approved the final manuscript.
Funding The DIATEMP trial was funded by the Netherlands Organization for Health Research and Development (ZonMw, project number 837002508), with 10% matching funded by the Dutch Society for Podiatrists (NVvP) and Dutch Branch Organization for Pedicures (ProVoet).
Disclaimer The funders had no influence on study design, data collection, management, analysis, and interpretation, the writing of the report, or the decision to submit for publication, and had no authority over any of these activities.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.