Join Us in Our 50th Anniversary Celebration!

Celebrating 50 years at OHEThis year, the Office of Health Economics is celebrating its 50th anniversary.  Founded in 1962, at the time when international emphasis on prescription medicine efficacy and safety was just beginning, OHE has made significant contributions in several fields since that time.

We have a range of events and activities planned throughout the year. Click here for more detail.

OHE Has an Opening for a Health Economist

OHE is seeking a highly motivated and energetic economist to contribute to its  research and consultancy activities. Our work covers a broad range of analyses into the economics and policy of: (1) health care systems, (2) pharmaceutical and other life sciences industries, and (3) health technology assessment.

The economist will be expected to undertake and present quantitative and/or qualitative analyses of topics in the areas of health systems, the pharmaceutical industry and health technology assessment, in the UK and outside.   The position involves working with OHE colleagues, clients’ staff at all levels, and external stakeholders.

Candidates should have:

  • a good first degree, majoring in economics
  • a postgraduate qualification and/or practical consulting experience in economics
  • interest in, and understanding of, policy related to health care systems and/or the life sciences sector
  • demonstrated ability to research, write and present clearly argued analyses within tight deadlines

Applications must be received by Monday, 25 June 2012.  Interviews for shortlisted candidates will be held in London on Thursday, 5 July 2012.

For further details please click here.

Time Trends in NICE HTA Decision Making: Setting the Record Straight

The Daily Mail front page article of 16 May 2012, ‘New cancer drugs held up by the NHS for nine years’ purports to draw, as its source, from a report by the Office of Health Economics. The Daily Mail article is misleading and inaccurate in several key respects, and misrepresents the purpose and results of our study.

Our report, Time Trends in NICE HTA Decisions, was published in January 2012. The study is not about cancer medicines; nor is it specifically about new medicines (since NICE’s work is not restricted to that). Nowhere in our report do we suggest that new medicines are being delayed by up to nine years as a result of NICE’s decision making process.

We looked at completed appraisals between March 2000 and December 2010. The key findings from our report, with respect to the speed with which NICE makes its recommendations, were that:

  • The average time taken from the start of the HTA process to publication of guidance to the NHS is 1.73 years.
  • For Multiple Technology Appraisals (MTAs) the average time is 1.97 years and for Single Technology Appraisals (STAs) it is 0.96 years.
  • For MTAs, 19% are assessed within the target time of 1.15 years set out in NICE’s 2009 Guide to the MTA; for STAs, 23% are assessed within the target time of 0.83 years set out in NICE’s 2009 Guide to the STA.
  • Neither the MTA nor STA process showed marked changes in time taken over the period observed.
  • Certain factors appeared to be associated with longer decision processes: for example, if the decision is to restrict or not recommend a medicine (rather than recommending it); whether there is an appeal; and, for STAs, whether the sponsor company had applied for a patient access scheme to be considered.

We also analysed the time elapsed between the launch of a medicine and the publication of NICE guidance.  Our finding was that, of those medicines considered since NICE was established, the median time from launch to publication is 5.0 years (5.5 years for MTAs and 2.6 for STAs).  These figures are of interest to patients and to companies as positive NICE guidance means funding must be made available. They cannot be interpreted as a failure by NICE because:

  • NICE does not have a remit to appraise all medicines when they are launched (in comparison to the Scottish Medicines Consortium, for example). Instead, the medicines that  NICE considers are chosen by the Department of Health via a ‘topic selection process’ – not by NICE.
  • Further, as we emphasised in our report, the figures include the fact that NICE is often asked to assess medicines that were launched prior to 1999, when it was established.  Consequently, the descriptive statistics for time from launch date for all medicines appraised need to be interpreted with care.

There are differences, however, between our findings with respect the time taken in HTA processes, and NICE’s own assessment of this.  NICE has a number of process indicators, that provide an insight into NICE’s own benchmarking of its HTA process.  These focus on the aspects of the process over which NICE has most control.

Differences between OHE’s assessment of the timeliness of NICE processes and NICE’s own benchmarking of its performance arise from the fact that we each are measuring different things in different ways.  The key differences are most easily understood in the context of two questions.

Which medicines are included in the analysis?

  • OHE’s report included all medicines that NICE has assessed between March 2000 and December 2010.
  • NICE’s indicators focus specifically on new medicines.

How is the start and finish of NICE’s process measured?

  • OHE’s report measures the time taken in NICE’s decision process as the time between the publication by NICE of the scoping document for the appraisal and the publication of NICE guidance.
  • NICE’s own benchmarking of its decision process measures the time taken between NICE inviting a manufacturer’s submission after the publication of the scoping document and the first decision output of the committee (either an ACD or FAD). This is a subset of the time considered by the OHE report, focussing on those parts of the process that NICE can most directly control.

Each represents a different, but legitimate and useful way, of measuring the time taken in HTA. For further comment on time trends in NICE HTA decision making, see NICE’s comments from Andrew Dillon.

For Your Information: Cookies Opt-In Coming in Late May 2012

Visitors to the main OHE website, ohe.org, and the archived publications site, ohematerials.org, will experience something new beginning on or about 25 May 2012.  Under EU/UK regulations, all websites based in the UK now must ask visitors to agree to accept cookies.  A box that allows visitors to agree or disagree will appear on the first visit to the website. Not agreeing to use cookies may mean that access to all or some of the website will not be possible. This is because of the way websites are built, not because OHE wishes to force users to accept cookies.

Over 90% of websites currently place cookies on the computers of visitors.  The ones on OHE websites are harmless small files that allow the website to work properly and also allow OHE to monitor and improve use of its websites. OHE’s website and privacy policies are set out in its Terms and Conditions, which will be updated with additional cookie information when the cookies programme begins.

We apologise for any inconvenience or confusion this may create for our users.

Can and Should Value Based Pricing Be Applied to Molecular Diagnostics?

Martina Garau

Just out is an OHE Research Paper that examines the issues.  The authors note that diagnostics not only facilitate health gain and cost savings, but also provide information to inform patients’ decisions on interventions and to clarify how their behaviour may affect their health in future.  Current pricing and reimbursement systems for diagnostics, however, are not efficient and provide poor incentives for new diagnostic approaches.  Prices often are driven by administrative practice and expected production cost, rather than assessments of value.

The paper discusses how a value based pricing (VBP) framework for efficient use and pricing of medicines also might be applied to diagnostics. The authors recommend a two-part approach. First, in the case of companion diagnostics introduced at the launch of a drug, the process would follow the new drug assessment processes.  It would consider a broad range of value elements and be based on a balanced analysis of diagnostic impact. Second, for diagnostics not paired specifically with a drug at launch, review would be by a diagnostics-dedicated committee using VBP principles.

Download Garau, M., Towse, A., Garrison, L., Housman L. and Ossa, D. Can and should value based pricing be applied to molecular diagnostics? Research Paper 12/03. London: Office of Health Economics.

New Research on VBP: Disease Severity and Unmet Need in the UK

Koonal Shah

Koonal Shah

The UK Department of Health’s value based pricing (VBP) Consultation Document proposes a process whereby higher prices would be granted to medicines that tackle diseases that produce the greatest burdens of illness – i.e. those diseases that are most severe or are associated with the greatest unmet need.  This suggests combining severity of disease and unmet need into a single metric.  A literature review reveals that this approach has not been studied adequately (or perhaps at all) to date, either in the UK or elsewhere.

The Department of Health’s Policy Research Unit in Economic Evaluation of Health and Care Interventions (EEPRU) was asked by the Department to conduct an empirical study of society’s resource allocation preferences to obtain weights for burden of illness, therapeutic improvement and end-of-life.  The objective would be to apply these, under the coming VBP system, to assessments of both new technologies and displaced activities.

The EEPRU study defines burden of illness as distance from “normal” health; the measure combines health status with the effects of existing standard therapy on both length and quality of life.  The value of existing therapy, then, is in its contribution to the degree of burden.  Not considered explicitly in the EEPRU study are issues raised by the definition of unmet need implied in the VBP Consultation Document – i.e. that “unmet need” means that no treatment is available at all.

Data collection for the EEPRU study is being conducted online, using discrete choice experiments to elicit preferences.  Stakeholders have expressed concern about the limited scope of the EEPRU study in that it does not examine whether people have preferences about the availability of alternative treatments.

To address some of these issues, OHE currently is performing a small study, funded by an unrestricted research grant from the ABPI.  Based on interviews with members of the general public, it is intended to develop a more nuanced understanding of the extent of societal support for basing health care resource priorities on disease severity and unmet need.

The OHE survey will be administered in face-to-face interviews conducted by trained interviewers with experience in conducting health care preference studies.  Questions will be designed to identify respondents’ levels of support for policies that give greater weight to treatments that address disease severity and unmet medical need than to those that do not.  The research also will address whether, controlling for disease severity, unmet need per se affects societal preferences regarding priorities for treatment.  In this study, respondents also will be asked probing follow-up questions intended to elicit qualitative information about the thinking behind their choices.

This study will provide important, preliminary information about how disease severity and unmet need should be measured and how best to capture societal preferences.  The main points we expect the research to address include the following:

  1. Whether members of the public would support a policy that uses combined disease severity and unmet need as a criterion for priority setting
  2. What societal preferences about disease severity and unmet need can be observed
  3. Whether preferences regarding unmet need depend at least in part on disease severity
  4. The likely reasons for the preferences observed
  5. The strength of the preferences observed

The OHE study, then, will both complement the EEPRU study by exploring additional possible attributes and provide additional evidence about whether preferences regarding unmet need depend on disease severity.  It can help define what further research is essential to produce valid measures.

The OHE research team for the project is Koonal Shah and Nancy DevlinResults are anticipated in summer 2012 and will be published as an OHE Research Paper.

The Tougher the Better: The Effect of GP Performance Thresholds in Scotland

Yan Feng

Yan Feng

General Practitioners (GPs) in the NHS are paid based on a mix of factors, including a pay-for-performance element, the Quality and Outcomes Framework (QOF), which was introduced in 2004.  QOF rewards GPs based on performance on specific indicators. Although participation in the QOF is voluntary, it represents a key source of potential income for GPs and nearly all participate. The QOF has been criticised, however, for having produced little or no improvement in GP performance; some studies have claimed that the QOF achievement has had a negligible impact on health outcomes.

The OHE’s Yan Feng and her colleagues take a closer look at the effect of changes in the QOF in Scotland in April 2006. They state that “the principal aim of this paper is to evaluate the effect of an increase in the maximum performance threshold in the QOF scheme on the performance of GPs in Scotland.”  The paper also examines whether GPs responded to the incentives differently according to the level of their performance before the change.

Under the QOF, GP practices are paid according to a linear schedule between a lower and upper threshold, which varies across indicators. The indicator set was revised in 2006; new indicators were introduced, some were retired and others revised.  Moreover, minimum performance thresholds were raised from 25% to 40% for all indicators. Maximum thresholds were raised for nine clinical indicators and left unchanged for 25 other indicators for which definitions also were unchanged.  This selective change provides a unique opportunity to analyse the response of GPs by comparing the performance on indicators with an increased threshold to performance on indicators that remained the same.

“The changes in the payment threshold under the QOF scheme may have differential effects on different groups of GPs”, the authors note. The research examines whether GP practices that had initially higher and initially lower performance responded differently.  The financial incentives for low-performing GPs were strongest: unless their performance improved, the amount of potential income foregone would be even greater than before the change.  High-performing GPs would have the least incentive to change.  The study also looks at a middle group.

Data used in the analysis were provided by the Scottish government’s Information Services Division and included financial years 2005/6 and 2006/7.  In total, the data include 40,704 observations across 24 indicators.

“The principal finding of this paper,” the authors state, “is that the increased maximum performance threshold under the QOF scheme in 2006 was differentially effective in improving GPs’ performance. Overall, the effect of the policy change in 2006 improved the performance of GPs in Scotland.” The research also bears out the hypothesis that incentives produced greater change among lower-performing GPs.

Download: Feng, Y., Ma, A., Farrar, S. and Sutton, M. (2012) The tougher the better: The effect of an increased performance threshold on the performance of general practitioners. Research Paper 12/02. London: Office of Health Economics.

New: Assessing the Performance of the EQ-VAS in the NHS PROMS Programme

Assessing the Performance of the EQ-VAS in the NHS PROMs ProgrammeThe NHS Patient Reported Outcome Measures (PROMs) programme, introduced in April 2009, is a significant development in the routine collection and use of patient reported outcome data.  Currently, data are collected from patients both before and after surgery for four elective surgical procedures in the NHS, with plans to expand the practice.  (The procedures are hip and knee replacement, groin hernia repair and varicose vein repair.)

Results from the PROMs data collected already are being used in a broad range of decision making contexts[1].  For example, comparisons of the changes in patient health before and after surgery are being used as one indicator of hospital performance[2].  Commissioners also are using the findings in evaluating the effectiveness and cost effectiveness of a range of services.  Ensuring that the data are as accurate and reliable as possible, then, is crucial.

The EQ-5D, used to collect the PROMs data, has two parts. The first, the EQ-5D profile, asks patients to classify their health based on self-assessed levels of problems (“no”, “some”,” extreme”).  The second is the EQ-VAS, which asks patients to indicate their overall health on a vertical visual analogue scale, ranging from “worst possible” to “best possible” health.  Historically, the EQ-VAS was a warm-up exercise for VAS valuations of EQ-5D, but it has evolved into an integral part of the measure.  This paper focuses on two concerns about the EQ-VAS: (1) difficulties with the data because patients may fail to respond to it as the instructions require and (2) substantial differences between patient responses on the EQ-VAS versus the EQ-5D profile and condition specific instruments.  According to the authors, these issues raise fundamental questions about the role and use of EQ-VAS in the EQ-5D instrument.

In particular, the paper analyses:

  1. The different ways in which patients complete the EQ-VAS and how their characteristics affect this
  2. How the different ways of completing the EQ-VAS currently are handled in coding the data and the effect this may have on data interpretation and analysis
  3. The relationship between the EQ-VAS, the EQ-5D profile and other summary score data in the NHS PROMs programme

Analyses to address the first two points — potential issues with patient responses and how to handle them – are based on matched before-and-after anonymised EQ-VAS responses from 200 patients across all four elective procedures.  The data included background characteristics, namely age, sex, and type of surgery.  The third set of analyses, comparing EQ-VAS data to index weighted measures, were based on patient-level NHS PROMs programme data linked to Hospital Episode Statistics.  The 331,951 anonymised patient records covered all four elective procedures from 1 April 2009 through 28 February 2011.

The authors’ findings suggest ways for improving EQ-VAS by improving both data collection and coding procedures.  They note, for example, that although 95% of patients completed the EQ-VAS in an unambiguous way, fewer than 50% completed it in the way that the instructions intend.  Moreover, the guidance provided by the EuroQol Group on coding the imperfect responses is insufficient.  The authors note that this potentially can result in unnecessary data wastage or variations across users in interpreting and coding that, in turn, may make data less comparable.  “All of these issues,” they note, “could be addressed by providing improved guidance on coding EQ-VAS data or revisiting the instructions for the EQ-VAS”.

The third set of analyses presented in the paper addressed whether and how patient reported outcomes vary using EQ-VAS versus EQ-5D or condition specific instruments.  The authors note that “Concern had emerged from the NHS PROMs programme that the EQ-VAS was not adequately reflecting the health gain for patients resulting from surgery, and was therefore a less useful and appropriate measure of health change than the EQ-5D profile or condition specific instruments.”  Their findings suggest that this is not the case; the relationship between the EQ-VAS and the EQ-5D profile are predictable and consistent. Moreover, some of the differences between the two are attributable to the characteristics of the particular weightings within the EQ-5D index.

Nevertheless, the results of analyses do confirm the observation of PROMs reports that there are clear differences between the EQ-VAS and index weighted EQ-5D and condition specific profiles.  Presumably, patients are freer to consider all components of “health” using the VAS than they are when restricted to “tick boxes” with the EQ-5D profile.  “In essence,” the authors state, ”the EQ-VAS is measuring a broader underlying construct than the EQ-5D profile or the condition specific instruments. This does not mean that the data it produces are less meaningful or useful. Indeed, in applications where the patients’ view of their overall health is the measurement goal, the EQ-VAS is prima facie more appropriate than the use of EQ-5D profile data weighted by general public preferences.”

In closing, the authors note that no discoverable research has been done on how patients or members of the general public interpret the upper and lower endpoints of the EQ-VAS – “best” and “worst” possible health.  Given the importance of the EQ-VAS, they urge that a better understanding be developed of differences in interpretation, the bases for these, and whether they may change with expectations, health or social circumstances.

Download Feng, Y., Parkin, D. and Devlin, N.J. (2012) Assessing the performance of the EQ-VAS in the NHS PROMs Programme. Research Paper 12/01. London: Office of Health Economics.



[1] See Devlin, N.J. and Appley, J. (2010) Getting the most out of PROMs: Putting health outcomes at the heart of NHS decision making. London: Office of Health Economics.

[2] See our recent blog on new research on analysing hospital variation with EQ-5D. 

Join OHE for Its 50th Anniversary Annual Lecture with Sir Michael Rawlins

Sir Michael Rawlins

Sir Michael Rawlins

Every year, OHE sponsors a lecture by an eminent economist or clinician that addresses an important current issue. This year we are pleased to welcome Prof. Sir Michael Rawlins, who argues against  reliance on randomized clinical trials as the “gold standard”, instead urging a more pragmatic approach.

Sir Michael’s experience — as a clinician, chair of the Committee on Safety of Medicines, and chair of NICE — uniquely qualifies him to address these issues.

When: 6:00 PM, Monday, 18 June, 2012. The lecture will be followed by a drinks reception.

Where: The Royal College of Physicians, 11 St Andrews Place, Regent’s Park, London

For additional detail, click here.

9 May 2012 editor’s note: This event now is fully booked and no more registrations are being accepted.


New: 50 Years of OHE Publications Are Available Online

All 50 years of OHE publications now are available onlineToday we celebrate OHE’s 2 April 1962 founding with the launch of our new archival website, ohematerials.org. This site contains OHE’s publications from 1962-2002. The most recent ten years of publications can be found on our main site, ohe.org.

1962 was an important year in health care in the UK. Two key changes were underway that would dramatically affect the pharmaceutical industry for decades to come. Just five years earlier, in 1957, the first Voluntary Price Regulation Scheme (now the PPRS) was adopted, setting the tone for pricing for the next fifty years. In 1962, the Committee on the Safety of Drugs (CSD) was formed in the wake of the thalidomide tragedy. Its objective was to advise, on the basis of safety and efficacy, whether a new drug should be made available on the market. The CSD was replaced when the 1968 Medicines Act made prior approval mandatory and created the Committee on the Safety of Medicines.

1962 also was the year that Sir James Black discovered the first clinically significant use of beta blockers, with propranolol and pronethalol, revolutionising the treatment of angina pectoris. That same year, the oral polio vaccine was introduced in the UK and a new routine immunisation programme was begun. Other long-time scourges were nearly gone – tuberculosis killed 3,000 in England and Wales in 1962, down from over 48,000 per year in the late 1940s. OHE’s first publication examined the economic and social gains from drugs that battle tuberculosis.

Extensive changes were taking place in the NHS in 1962. An ambitious hospital plan was launched to replace seriously outdated infrastructure and create district general hospitals. General practitioners were increasingly upset about pay structures and published the Porritt Report, which criticised the rigid separation of the NHS into hospitals, general practice and local authorities. The report called for unification of the three, sparking a lasting debate on the structure of the NHS.

The changes since 1962, of course, have been extensive in all areas of medicine and in the NHS. Perusing the fifty years of OHE publications, however, show that some issues are perennial. Persistent themes, for example, include the cost of the NHS, how best to organise the NHS and the effects of change in the NHS on both the quality and cost of care. Since the early days of the OHE, another key issue has been how best to define, encourage and evaluate innovation in medicine and medicines. Although perspectives and approaches have evolved, the basic questions have changed very little.

Particularly important changes that have occurred over the fifty years include, for example, the appearance and now-routine use of health economics and health technology assessment methods; the first OHE publications on these topics appeared in the mid 1980s. Attitudes towards ‘the patient’ have changed markedly, too, from being well-meaning but paternalistic, to understanding that the active involvement of patients is crucial both to the success of treatment and to defining the value of care.

During the rest of the year, we will be looking at some of these themes in this blog, using OHE’s publications to track perspectives and policies. We hope that this extensive catalogue will be useful to others who wish to understand better how issues in health care have evolved over the past fifty years and what may be in store in the future.

Overview of the Economics of the Market for Medicines in the UK

OHE’s Dr Jorge Mestre-Ferrandiz is a visiting lecturer in the Department of Economics at City University London. As part of his 2012 activities, he recently gave a comprehensive lecture on the economics of the market for medicines in the UK. His presentation covers the key issues, from drug development through health technology assessment and market access.