RMA Publications

RMA - Repatriation Medical Authority









 

The Expectations from Health Studies

Summary of presentation by:
Professor Ken Donald, RMA Chairman

Paper prepared from edited transcripts of the RMA Forum
March 2004

The Expectations from Health Studies

This talk is about health studies and the way in which they may or may not be of use to the RMA and the SOP system. The first thing to note is that the compensation system in Australia depends upon causes of diseases as defined by exposures. It does not depend upon classes of veterans. In fact, factors in SOPs made on classes of veterans are not covered by the legislation.

The RMA has had a lot of requests over the years to make factors for groups of veterans, everything from groups down to less than a dozen men, through to whole theatres. If we did go down that path, we would actually finish up with hundreds of factors based around increasingly smaller and smaller groups, and that's not what the parliament, to this point in time, has decided.

One example is provided by the Korean War veterans' cancer study, which showed an excess of smoking related cancers. Although there is no factor for Korean War veterans, they can make claims under the SOP system. Korean Veterans who have lung cancer can claim under a number of factors that already exist in lung cancer - smoking, diesel fumes - just to name a couple. If they have cirrhosis of the liver, they can claim under the alcohol factor.

It comes back to the point that not all people in a deployment have the same exposures. There is a tendency for a health study to assume that a particular group of soldiers, whether they be Korean veterans or whether they be a smaller group, have all had the same exposures when in fact they haven't.

Furthermore, it is sometimes quite difficult to sort out even what the exposures were 50 years ago, or 20 years ago, let alone which individuals were exposed to which particular exposures. It has been our experience that quite often health studies have raised expectations that the RMA is in no position, legally, to meet. The current F-111 deseal/reseal study brings up - from looking at what we have received so far- it brings up another issue about exposures. For a significant proportion of the chemicals that appear to have been part of the exposure, there is no sound medical-scientific evidence, no published literature, about what the effects of those chemicals might be. Again, for the RMA, that's a blind alley because we can't guess at what might be the effects of a chemical. Occasionally, if a chemical were very closely related to a molecule that has been extensively investigated, we might be able to draw some conclusions about potential effects.

Another issue that has come up in the Gulf War 1 study, is that the outcomes measured by the study don't fit the definition of "disease" in the legislation or, for that matter, don't fit the definition of "disease" in the standard medical text books. The Gulf War study turned up a constellation of symptoms but no specific identifiable disease. And looking at the F-111 study, it's clear that people have a lot of symptoms and they also sometimes appear to have signs, but unless there is a definable disease, legally we have no starting point.

Those are two of the problems with retrospective health studies, the problem of measuring exposures and the problem of the sorts of outcomes that health studies sometimes produce. Retrospective studies depend to a significant extent on people's recall and there is really very little opportunity to measure exposures. It is not that the health studies are not as well done as possible, it is that the retrospectivity and the nature of the data preclude some of the outcomes that you would get from a hypothesis driven prospective study. The general principle is that retrospective studies often only really raise problems, they don't solve them.

Another problem with health studies is the finding of many different symptoms, which could just be a chance finding or a finding of unknown significance. If you look at the general practices around Australia on any particular day, there's a percentage of Australians who go to see their GP, say 5%. Now, that 5% who go to see their GP on any one day, bring with them about a dozen different symptoms and many of them never get a diagnosis specifically attached to them. On that same day, 20% of the community had those same symptoms and did not go to a doctor. If you go to the next day, 5% go to their GP again, but it's a different 5%. When you're dealing with human beings and their symptoms, the facts of the matter are that many of the symptoms that human beings have mean nothing, because the next day they're gone and another group of people have got the same symptom. It raises a lot of false alarms, particularly if people have got a heightened susceptibility to observing their own symptoms.

There can even be problems with abnormalities detected by laboratory tests. It is well-known that if you do blood tests on everybody in the room here, you find abnormalities by chance, and if you do that same level of blood tests a week or a month later, you get false positive results on a different group of the population. An enormous amount of health resources in this country is wasted following false trails of what are chance laboratory findings in somebody who has got absolutely nothing wrong with them. Laboratories in general have got a false positive rate, so by definition, some of the results you get out of a laboratory are going to be wrong. Some of the ones that are wrong are going to be high, by chance.

These are the sorts of background issues that impact upon retrospective non-hypothesis driven studies. They raise problems that actually don't exist, and you finish up with these constellations of symptoms which often don't add up to anything more than what's going on in the average community, day in and day out. It is hard to untangle when you've got something real, and when you've got something that is just one of these false positives.

In retrospective studies exposure to risks from medical interventions are often studied. In every situation in treating a patient, or deciding on a vaccination regime for children or soldiers or anybody else, you are balancing the risks against the benefits. All immunisation has a complication rate. Aspirin has a complication rate- if you take aspirin, you're more likely to die of haemorrhagic stroke than you are if you don't take aspirin. There is no medical intervention that does not have a risk. The safest and most cost effective medical intervention ever invented is still aspirin, in economic terms, but it still has a down side. It is important to compare the risk of intervention with what would have happened if there had been no intervention. Because the risks occurred a long time ago they can be difficult to assess.

Many retrospective health studies - not just retrospective studies in veterans, but retrospective studies in general - are often under-powered. What happens is that even if you start with a large number, by the time you get down to specific disease entities, or specific findings, or specific syndromes, the number of people left in that category do not give you the statistical power to calculate a statistically significant outcome.

When studying small groups another danger is that when the number of cases of a particular disease is measured, instead of finding three cases of cancer X, they find seven. That is two and a half times what is expected and it looks like something is really going on. What you don't know is that in the next 500 people, there are going to be no cases because the statistics will catch up and the rate will balance out over time. The lack of statistical power means that the results are unreliable, and could be purely due to chance.

Some ethics committees actually view a study that has small sample size and therefore has low power as being unethical in its own right. They might produce a non-finding and create more questions than you actually answer. That is considered by some ethics committees who do their homework to actually be an unethical thing to ask people to approve.

One of the other problems of health studies is that they aren't that, they are actually sickness studies. They ignore the fact that, quite often the group that is being studied has a number of things that positively affect their health. One of the concerns of public health practitioners about these sorts of studies is they have a great propensity to make a group of people who are well become sick, because they overlook the positive effects of whatever the exposures might have been.

Those are the main issues that impact upon the RMA's ability to use retrospective studies, whether they be retrospective health studies of veterans; or whether they be retrospective studies of bus drivers in Denmark; or occupational studies of lead workers in factories. That is not to say that retrospective health studies are not capable of providing key information. A lot of the RMA's findings in health have come from retrospective studies when there has been no other option. The limitations- small sample sizes, poor exposure documentation and lack of a predefined hypothesis- restrict their usefulness.

Certainly, retrospective studies will be the only way you're going to get efficient collection of information about rare forms of cancer or motor neurone disease or other diseases that don't occur very much. On the other hand, prospective studies give you the opportunity to study the symptomatology that you see in a reasonably short amount of time after deployment.

The RMA is very pleased that Defence is moving towards being able to prospectively look at exposures of troops in the field. Some of our allies appear to be far ahead of us in doing it, and are actually plotting where each individual soldier was and his or her particular exposures. I think in the future, those sorts of prospective studies will actually be able to produce some outcomes which may well be more useful to the RMA than the retrospective studies have tended to be.

Soldiers will be prospectively tagged for their exposures, not necessarily their deployments. That will mean that a soldier over a lifetime, or over his/her period of service, will build up an exposure profile which may not necessarily reflect the deployment arrangements. Scientifically that is a more powerful tool than trying to measure diseases by deployments because not every soldier on the same deployment has the same exposures. Also, soldiers in the current Defence Force will go on many deployments. I think when you look at exposures rather than geographic parts of the world or different particular conflicts, there are going to be a whole different set of questions and a whole different set of outcomes that potentially might be more useful in the future.

Prospective studies can give us, in an evolving way, responsiveness to a whole different set of needs and ways of doing more. It is only through those types of studies that we will be able to discover the evolution of problems, whether they start as constellations of symptoms or whatever, and know if there is going to be a progression to illness and have the opportunity to influence that course in a more positive way.

We also shouldn't forget that the most powerful use of this research is not looking at health effects or claims for compensation, but the question of duty of care to make sure that people are not exposed unnecessarily to harmful things during deployments.


Previous | Contents | Next

This page last updated 22 March 2005.

     
 © 2004 Repatriation Medical Authority | Legal | Comments to the Webmaster