Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT): report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force

AbstractIntroductionA Task Force was commissioned jointly by the European Academy of Allergy and Clinical Immunology (EAACI) and the Respiratory Effectiveness Group (REG) to develop a quality assessment tool for real-life observational research to identify high-quality real-life asthma studies that could be considered within future guideline development. MethodsThe resulting REal Life EVidence AssessmeNt Tool (RELEVANT) was achieved through an extensive analysis of existing initiatives in this area. The first version was piloted among 9 raters across 6 articles; the revised, interim, version underwent extensive testing by 22 reviewers from the EAACI membership and REG collaborator group, leading to further revisions and tool finalisation. RELEVANT was validated through an analysis of real-life effectiveness studies identified via systematic review of Medline and Embase databases and relating to topics for which real-life studies may offer valuable evidence complementary to that from randomised controlled trials. The topics were selected through a vote among Task Force members and related to the influence of adherence, smoking, inhaler device and particle size on asthma treatment effectiveness. ResultsAlthough highlighting a general lack of high-quality real-life effectiveness observational research on these clinically important topics, the analysis provided insights into how identified observational studies might inform asthma guidelines developers and clinicians. Overall, RELEVANT appeared reliable and easy to use by expert reviewers.ConclusionsUsing such quality appraisal tools is mandatory to assess whether specific observational real-life effectiveness studies can be used to inform guideline development and/or decision-making in clinical practice.

• Publication year

  2019

• Venue

  Clinical and Translational Allergy

• Publication date

  2019-03-27

• Fields of study

  Medicine

• Identifiers
  DOI 10.1186/s13601-019-0255-xPMID 30962875PMCID 6436229
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• The REal Life EVidence AssessmeNt Tool (RELEVANT): development of a novel quality assurance asset to rate observational comparative effectiveness research studies

  2019cited by this paper
• Extrafine Versus Fine Inhaled Corticosteroids in Relation to Asthma Control: A Systematic Review and Meta-Analysis of Observational Real-Life Studies.

  2017cited by this paper
• Chronic obstructive pulmonary disease exacerbation and inhaler device handling: real-life assessment of 2935 patients

  2017cited by this paper
• Patient Focus and Regulatory Considerations for Inhalation Device Design: Report from the 2015 IPAC-RS/ISAM Workshop

  2017cited by this paper
• Interventions to improve inhaler technique for people with asthma.

  2017cited by this paper
• Inhaled corticosteroids for asthma : impact of practice level device switching on asthma control

  2016cited by this paper
• Are pharmacological randomised controlled clinical trials relevant to real-life asthma populations? A protocol for an UNLOCK study from the IPCRG

  2016cited by this paper
• Systematic Review of Errors in Inhaler Use: Has Patient Technique Improved Over Time?

  2016cited by this paper
• Small-particle Inhaled Corticosteroid as First-line or Step-up Controller Therapy in Childhood Asthma.

  2015cited by this paper
• Long-term adherence to inhaled corticosteroids in children with asthma: Observational study.

  2015cited by this paper
• Differential effects of inhaled corticosteroids in smokers/ex-smokers and nonsmokers with asthma.

  2015cited by this paper
• Increased Dose of Inhaled Corticosteroid versus Add-On Long-acting β-Agonist for Step-Up Therapy in Asthma.

  2015cited by this paper
• Asthma drug ratios and exacerbations: claims data from universal health coverage systems

  2014cited by this paper
• Quality standards for real-world research. Focus on observational database studies of comparative effectiveness.

  2014cited by this paper
• Relative exposure to controller therapy and asthma exacerbations: a validation study in community pharmacies

  2014cited by this paper
• Mechanisms of glucocorticoid action and insensitivity in airways disease.

  2014cited by this paper
• Switching patients from other inhaled corticosteroid devices to the Easyhaler®: historical, matched-cohort study of real-life asthma patients

  2014cited by this paper
• Complementing the randomized controlled trial evidence base. Evolution not revolution.

  2014cited by this paper
• Cost-effectiveness of initiating extrafine- or standard size-particle inhaled corticosteroid for asthma in two health-care systems: a retrospective matched cohort study

  2014cited by this paper
• Impact of changes to reimbursement of fixed combinations of inhaled corticosteroids and long-acting β2-agonists in obstructive lung diseases: a population-based, observational study

  2014cited by this paper
• Risk Factors for Asthma-Related Healthcare Use: Longitudinal Analysis Using the NHI Claims Database in a Korean Asthma Cohort

  2014cited by this paper
• A questionnaire to assess the relevance and credibility of observational studies to inform health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report.

  2014cited by this paper
• Inflammation and corticosteroid responsiveness in ex-, current- and never-smoking asthmatics

  2013cited by this paper
• Dispensation of long-acting β agonists with or without inhaled corticosteroids, and risk of asthma-related hospitalisation: a population-based study

  2013cited by this paper
• It’s the adherence, stupid (that determines asthma control in preschool children)!

  2013cited by this paper
• Effect of Inhaled Corticosteroid Therapy Step-Down and Dosing Regimen on Measures of Asthma Control

  2013cited by this paper
• Asthma outcomes and costs of therapy with extrafine beclomethasone and fluticasone.

  2013cited by this paper
• Comparison of inhaled corticosteroids and leukotriene receptor antagonists in adolescents and adults with mild to moderate asthma: a meta‐analysis

  2013cited by this paper
• Stepping down from high dose fluticasone/salmeterol to extrafine BDP/F in asthma is cost-effective.

  2013cited by this paper
• Real life clinical study design supporting the effectiveness of extra-fine inhaled beclomethasone/formoterol at the level of small airways of asthmatics.

  2013cited by this paper
• Real-life comparison of beclometasone dipropionate as an extrafine- or larger-particle formulation for asthma.

  2013cited by this paper
• An official American Thoracic Society research statement: comparative effectiveness research in pulmonary, critical care, and sleep medicine.

  2013cited by this paper
• Stakeholder priorities for comparative effectiveness research in chronic obstructive pulmonary disease: a workshop report.

  2013cited by this paper
• Prescription of inhalers in asthma and COPD: towards a rational, rapid and effective approach.

  2013cited by this paper
• Adherence to inhaled corticosteroids by asthmatic patients: measurement and modelling

  2013cited by this paper
• Clinical and cost effectiveness of switching asthma patients from fluticasone-salmeterol to extra-fine particle beclometasone-formoterol: a retrospective matched observational study of real-world patients

  2013cited by this paper
• Integrating real-life studies in the global therapeutic research framework.

  2013cited by this paper
• Inhaled corticosteroid adherence and emergency department utilization among Medicaid-enrolled children with asthma

  2013cited by this paper
• SPIRIT 2013: new guidance for content of clinical trial protocols.

  2013cited by this paper
• Real-life prospective study on asthma control in Italy: cross-sectional phase results.

  2012cited by this paper
• Moving from evidence to developing recommendations in guidelines: article 11 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report.

  2012cited by this paper
• 1-year prospective real life monitoring of asthma control and quality of life in Italy

  2012cited by this paper
• Real-life effectiveness of extrafine beclometasone dipropionate/formoterol in adults with persistent asthma according to smoking status.

  2012cited by this paper
• Adequate Levels of Adherence with Controller Medication Is Associated with Increased Use of Rescue Medication in Asthmatic Children

  2012cited by this paper
• Effectiveness of Same Versus Mixed Asthma Inhaler Devices: A Retrospective Observational Study in Primary Care

  2012cited by this paper
• Synthesis, grading, and presentation of evidence in guidelines: article 7 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report.

  2012cited by this paper
• A retrospective database analysis on persistence with inhaled corticosteroid therapy: comparison of two dry powder inhalers during asthma treatment in Germany.

  2012cited by this paper
• CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials.

  2012cited by this paper
• Erratum to: “CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials” [J Clin Epidemiol 2010;63(8):e1–37]

  2012cited by this paper
• Anti-Inflammatory Medication Adherence, Healthcare Utilization and Expenditures among Medicaid and Children’s Health Insurance Program Enrollees with Asthma

  2012cited by this paper
• Impact of a short-term educational intervention on adherence to asthma treatment and on asthma control.

  2011cited by this paper
• Reassessing the Evidence Hierarchy in Asthma: Evaluating Comparative Effectiveness

  2011cited by this paper
• The European Network of Centres for Pharmacoepidemiology and Pharmacovigilance (ENCePP) Guide on Methodological Standards in Pharmacoepidemiology

  2011cited by this paper
• A call for action: Comparative effectiveness research in asthma.

  2011cited by this paper
• Device type and real-world effectiveness of asthma combination therapy: an observational study.

  2011cited by this paper
• Leukotriene antagonists as first-line or add-on asthma-controller therapy.

  2011cited by this paper
• Inhaler technique and asthma: feasability and acceptability of training by pharmacists.

  2011cited by this paper
• Increasing pharmaceutical copayments: impact on asthma medication utilization and outcomes.

  2011cited by this paper
• Asthma control with extrafine‐particle hydrofluoroalkane–beclometasone vs. large‐particle chlorofluorocarbon–beclometasone: a real‐world observational study

  2011cited by this paper
• Adherence and asthma control with mometasone furoate versus fluticasone propionate in adolescents and young adults with mild asthma

  2010cited by this paper
• UNLOCK: Uncovering and Noting Long-term Outcomes in COPD to enhance knowledge.

  2010cited by this paper
• Patterns of inhaled corticosteroid use and asthma control in the Childhood Asthma Management Program Continuation Study.

  2010cited by this paper
• Pharmaceutical care for patients with persistent asthma: assessment of treatment compliance and use of inhaled medications.

  2010cited by this paper
• Prescribing practices and asthma control with hydrofluoroalkane-beclomethasone and fluticasone: a real-world observational study.

  2010cited by this paper
• A pragmatic–explanatory continuum indicator summary (PRECIS): a tool to help trial designers

  2009cited by this paper
• From randomized controlled trials to observational studies.

  2009cited by this paper
• Good research practices for comparative effectiveness research: approaches to mitigate bias and confounding in the design of nonrandomized studies of treatment effects using secondary data sources: the International Society for Pharmacoeconomics and Outcomes Research Good Research Practices for Retr

  2009cited by this paper
• Adherence to inhaled therapy, mortality and hospital admission in COPD

  2009cited by this paper
• Adherence rate to inhaled corticosteroids and their impact on asthma control

  2009cited by this paper
• Impact of asthma controller medications on clinical, economic, and patient-reported outcomes.

  2009cited by this paper
• The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

  2009cited by this paper
• The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

  2009cited by this paper
• Predictors of asthma control in everyday clinical practice in Switzerland

  2009cited by this paper
• Good research practices for comparative effectiveness research: analytic methods to improve causal inference from nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report--Part III.

  2009cited by this paper
• Inhaled corticosteroids for asthma: impact of practice level device switching on asthma control

  2009cited by this paper
• [Asthma control in general practice: a cross-sectional survey of 16,580 patients].

  2008cited by this paper
• Preditores da adesão ao tratamento em pacientes com asma grave atendidos em um centro de referência na Bahia

  2008cited by this paper
• Predictors of adherence to treatment in patients with severe asthma treated at a referral center in Bahia, Brazil.

  2008cited by this paper
• Improving the reporting of pragmatic trials: an extension of the CONSORT statement

  2008cited by this paper
• Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration.

  2007cited by this paper
• Influence of body mass index on the response to asthma controller agents

  2007cited by this paper
• Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration

  2007cited by this paper
• Outcomes Among a Young Population of Pediatric Asthma Patients Using Controller Therapies: Results from a Retrospective Database Analysis

  2007cited by this paper
• Effect of montelukast on lung function in asthma patients with allergic rhinitis: analysis from the COMPACT trial

  2006cited by this paper
• Grading strength of recommendations and quality of evidence in clinical guidelines: report from an american college of chest physicians task force.

  2006cited by this paper
• External validity of randomised controlled trials in asthma: to whom do the results of the trials apply?

  2006cited by this paper
• Regional Lung Deposition and Bronchodilator Response as a Function of β2-Agonist Particle Size

  2005cited by this paper
• The role of pro- and anti-inflammatory responses in silica-induced lung fibrosis

  2005cited by this paper
• Regional lung deposition and bronchodilator response as a function of beta2-agonist particle size.

  2005cited by this paper
• ER’Asthme, contrôle de l’asthme chez 16580 patients suivis en médecine générale

  2005cited by this paper
• Switching asthma patients to a once-daily inhaled steroid improves compliance and reduces healthcare costs.

  2005cited by this paper
• Accepted after revision:

  2004cited by this paper
• Relationship between adherence to inhaled corticosteroids and poor outcomes among adults with asthma.

  2004cited by this paper
• Association between asthma control in children and loss of workdays by caregivers.

  2004cited by this paper
• Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice; Users' Guides to the Medical Literature: Essentials of Evidence-Based Clinical Practice

  2003cited by this paper
• Assessment of Handling of Inhaler Devices in Real Life: An Observational Study in 3811 Patients in Primary Care

  2003cited by this paper
• Misuse of corticosteroid metered-dose inhaler is associated with decreased asthma stability

  2002cited by this paper
• Influence of cigarette smoking on inhaled corticosteroid treatment in mild asthma

  2002cited by this paper
• The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration

  2001cited by this paper
• Cigarette smoking reduces histone deacetylase 2 expression, enhances cytokine expression, and inhibits glucocorticoid actions in alveolar macrophages

  2001cited by this paper

• Expert Perspectives on Next Generation Health Guidelines: How to Integrate RWE in EBM

  2025cites this paper
• Budesonide/Glycopyrrolate/Formoterol for the Management of COPD in a UK Primary Care Population: Real-World Use and Early Medication Success

  2024influential citation
• Real-world evidence of allergen immunotherapy

  2024cites this paper
• RIAIT (Italian Registry of Allergen Immunotherapy): Protocol for a New Tool in a New Vision of Disease-Modifying Therapy for Allergists

  2024cites this paper
• Comparison of evidence of treatment effects in randomized and nonrandomized studies on allergen immunotherapy

  2023cites this paper
• Tactical Considerations for Designing Real-World Studies: Fit-for-Purpose Designs That Bridge Research and Practice

  2023cites this paper
• A network meta-analysis of the association between patient traits and response to regular dosing with ICS/long-acting β2-agonist plus short-acting β2 agonist reliever or maintenance and reliever therapy for asthma.

  2023cites this paper
• Moving forward with allergen immunotherapy: the significance of real-world studies.

  2023cites this paper
• Real-Life Effectiveness of Subcutaneous Immune Therapy with Carbamylated Monomeric Allergoids on Mite, Grass, and Pellitory Respiratory Allergy: A Retrospective Study

  2022cites this paper
• Allergen immunotherapy: The growing role of observational and randomized trial “Real‐World Evidence”

  2021cites this paper
• Perspectives on decisions for treatment and care in severe asthma

  2021cites this paper
• Allergen immunotherapy for respiratory allergy: Quality appraisal of observational comparative effectiveness studies using the REal Life Evidence AssessmeNt Tool. An EAACI methodology committee analysis

  2021cites this paper
• Towards Optimum Reporting of Pulmonary Effectiveness Databases and Outcomes (TORPEDO): identifying a core dataset for asthma and COPD studies

  2021cites this paper
• Real-world evidence: Methods for assessing long term health and effectiveness of allergy immunotherapy.

  2021cites this paper
• Effect of nasal irrigation on allergic rhinitis control in children; complementarity between CARAT and MASK outcomes

  2020cites this paper
• ‘Real-world’ effectiveness of omalizumab in adults with severe allergic asthma: a meta-analysis

  2020cites this paper
• Adequacy of Therapy for People with Both COPD and Heart Failure in the UK: Historical Cohort Study

  2020cites this paper
• Highlights and recent developments in allergic diseases in EAACI journals (2019)

  2020cites this paper
• Evaluating the real-life effect of MP-AzeFlu on asthma outcomes in patients with allergic rhinitis and asthma in UK primary care

  2020cites this paper
• Adequacy of Therapy for People with Both COPD and Heart Failure in the UK: Historical Cohort Study

  2020cites this paper
• Placebo effects in allergen immunotherapy—An EAACI Task Force Position Paper

  2020cites this paper
• Evidence-Based Medicine and Real-World Data in Allergen Immunotherapy Today and in the Future: Quality or Quantity?

  2019cites this paper
• The importance of real-life research in respiratory medicine: manifesto of the Respiratory Effectiveness Group

  2019cites this paper
• The REal Life EVidence AssessmeNt Tool (RELEVANT): development of a novel quality assurance asset to rate observational comparative effectiveness research studies

  2019influential citation
• A Critique of Pharmacokinetic Calculators for Drug Dosing Individualization

  2019cites this paper
• Highlights and recent developments in airway diseases in EAACI journals (2017)

  2018cites this paper