To introduce the Emory 10-element Complex Figure (CF) scoring system and recognition task. We evaluated the relationship between Emory CF scoring and traditional Osterrieth CF scoring approach in cognitively healthy volunteers. Additionally, a cohort of patients undergoing deep brain stimulation (DBS) evaluation was assessed to compare the scoring methods in a clinical population.

The study included 315 volunteers from the Emory Healthy Brain Study (EHBS) with Montreal Cognitive Assessment (MoCA) scores of 24/30 or higher. The clinical group consisted of 84 DBS candidates. Scoring time differences were analyzed in a subset of 48 DBS candidates.

High correlations between scoring methods were present for non-recognition components in both cohorts (EHBS: Copy r = 0.76, Immediate r = 0.86, Delayed r = 0.85, Recognition r = 47; DBS: Copy r = 0.80, Immediate r = 0.84, Delayed Recall r = 0.85, Recognition r = 0.37). Emory CF scoring times were significantly shorter than Osterrieth times across non-recognition conditions (all p < 0.00001, individual Cohen’s d: 1.4–2.4), resulting in an average time savings of 57%. DBS patients scored lower than EHBS participants across CF memory measures, with larger effect sizes for Emory CF scoring (Cohen’s d range = 1.0–1.2). Emory CF scoring demonstrated better group classification in logistic regression models, improving DBS candidate classification from 16.7% to 32.1% compared to Osterrieth scoring.

Emory CF scoring yields results that are highly correlated with traditional Osterrieth scoring, significantly reduces scoring time burden, and demonstrates greater sensitivity to memory decline in DBS candidates. Its efficiency and sensitivity make Emory CF scoring well-suited for broader implementation in clinical research.

Many triage algorithms exist for use in mass-casualty incidents (MCIs) involving pediatric patients. Most of these algorithms have not been validated for reliability across users.

Investigators sought to compare inter-rater reliability (IRR) and agreement among five MCI algorithms used in the pediatric population.

A dataset of 253 pediatric (<14 years of age) trauma activations from a Level I trauma center was used to obtain prehospital information and demographics. Three raters were trained on five MCI triage algorithms: Simple Triage and Rapid Treatment (START) and JumpSTART, as appropriate for age (combined as J-START); Sort Assess Life-Saving Intervention Treatment (SALT); Pediatric Triage Tape (PTT); CareFlight (CF); and Sacco Triage Method (STM). Patient outcomes were collected but not available to raters. Each rater triaged the full set of patients into Green, Yellow, Red, or Black categories with each of the five MCI algorithms. The IRR was reported as weighted kappa scores with 95% confidence intervals (CI). Descriptive statistics were used to describe inter-rater and inter-MCI algorithm agreement.

Of the 253 patients, 247 had complete triage assignments among the five algorithms and were included in the study. The IRR was excellent for a majority of the algorithms; however, J-START and CF had the highest reliability with a kappa 0.94 or higher (0.9-1.0, 95% CI for overall weighted kappa). The greatest variability was in SALT among Green and Yellow patients. Overall, J-START and CF had the highest inter-rater and inter-MCI algorithm agreements.

The IRR was excellent for a majority of the algorithms. The SALT algorithm, which contains subjective components, had the lowest IRR when applied to this dataset of pediatric trauma patients. Both J-START and CF demonstrated the best overall reliability and agreement.

To develop and validate a web-based self-diagnostic questionnaire on school food service offer aimed at food service managers (FSM) by: (i) identifying relevant indicators of school food offer, developing a questionnaire and validating the concept using an expert panel; (ii) validating the questions by comparing the FSM’s responses with observations by dietitians and (iii) undergoing a qualitative evaluation of the tool through direct observation and short interviews.

Mixed methods.

Quebec, Canada.

Nine experts validated the theoretical constructs and indicators on which the questionnaire was based. Inter-rater reliability tests were conducted with thirty-nine FSM, who then participated in interviews about platform functionality satisfaction. Twenty school stakeholders participated in the survey pertaining to their use of the personalised report.

The questionnaire focused on the main school food service’s lunchtime offer and comprised twenty-six questions. The overall strength of agreement was good, and all questions’ strengths of agreement were fair to excellent except for one question. Qualitative data reached saturation and showed that navigation through the questionnaire was fluid. Improvements were suggested to increase user-friendliness and simplicity of both the platform and questionnaire. Results from the survey showed that all respondents were either satisfied or very satisfied with their personalised report.

We successfully developed and validated a web-based self-diagnostic questionnaire. The final version facilitates knowledge mobilisation with school stakeholders and offers a new opportunity for the assessment and surveillance of school food offer.

Despite the efforts of the European Union (EU) to promote voluntary cooperation among Health Technology Assessment (HTA) agencies, different reimbursement decisions for the same drug are made across European countries. The aim of this paper is to compare the agreement of cancer drug reimbursement decisions using inter-rater reliability measures.

This study is based on primary data on 161 cancer drug reimbursement decisions from nine European countries from 2002 to 2014. To achieve our goal, we use two measures to analyze agreement, in other words, congruency: (i) percentage of agreement and (ii) the κ score.

One main conclusion can be drawn from the analysis. There is a weak to medium agreement among cancer drug decisions in the European countries analyzed (based on the percentage of agreement and the κ score). England and Scotland show the highest consistency between the two measures, showing a medium agreement. These results are in line with previous literature on the congruency of HTA decisions.

This paper contributes to the HTA literature, by highlighting the extent of weak to medium agreement among cancer decisions in Europe.

The Sort, Access, Life-saving interventions, Treatment and/or Triage (SALT) mass-casualty incident (MCI) algorithm is unique in that it includes two subjective questions during the triage process: “Is the victim likely to survive given the resources?” and “Is the injury minor?”

Given this subjectivity, it was hypothesized that as casualties increase, the inter-rater reliability (IRR) of the tool would decline, due to an increase in the number of patients triaged as Minor and Expectant.

A pre-collected dataset of pediatric trauma patients age <14 years from a single Level 1 trauma center was used to generate “patients.” Three trained raters triaged each patient using SALT as if they were in each of the following scenarios: 10, 100, and 1,000 victim MCIs. Cohen’s kappa test was used to evaluate IRR between the raters in each of the scenarios.

A total of 247 patients were available for triage. The kappas were consistently “poor” to “fair:” 0.37 to 0.59 in the 10-victim scenario; 0.13 to 0.36 in the 100-victim scenario; and 0.05 to 0.36 in the 1,000-victim scenario. There was an increasing percentage of subjects triaged Minor as the number of estimated victims increased: 27.8% increase from 10- to 100-victim scenario and 7.0% increase from 100- to 1,000-victim scenario. Expectant triage categorization of patients remained stable as victim numbers increased.

Overall, SALT demonstrated poor IRR in this study of increasing casualty counts while triaging pediatric patients. Increased casualty counts in the scenarios did lead to increased Minor but not Expectant categorizations.

Sudden unexpected infant death is the leading cause of infant mortality with black: white infant mortality remaining at 2:1 for the last decade. Smartphone technology provides a convenient and accessible tool for injury prevention anticipatory guidance among at-risk communities.

A convenience sample of pregnant teen mothers who own a smartphone. During a 1-month postnatal home visit, a safe sleep environment survey was administered, infant sleep practices were observed, and mothers trained to take and submit standard infants’ sleep environment photographs. Photographs were independently assessed for inter-rater reliability (IRR) across five sleep safety domains (primary outcome): sleep location, surface, position, presence of soft items, and hazards near the sleep area. Expert and novice coders IRR was measured using Cohen’s kappa coefficient (K). Sleep safety correlation between photographs and observation, and parent report and observation was determined.

Sixteen (57.1%) mothers completed the home visit. Most parents reported infants sleeping supine (78.5) in parents’ bedroom (85.9%). Photographs demonstrated sleep position, soft items without the baby present, and hanging toys had perfect agreement across all three coder pairs. Safe sleep experts’ IRR demonstrated perfect agreement for sleep location, position, and soft items. While 83.8% of parents were observed putting their infants down to sleep on their back, 78.5% of parents reported doing the same and 82.4% of the photographs demonstrated supine infant sleep position.

Using photographs, coders can reliably categorize some key infant sleep safety aspects, and photograph sleep safety is comparable to parent report and direct observation.