How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data
Daniele Fanelli*
INNOGEN and ISSTI-Institute for the Study of Science, Technology & Innovation, The University of Edinburgh, Edinburgh, United Kingdom
Abstract Top
The frequency with which scientists fabricate and falsify data, or commit other forms of scientific misconduct is a matter of controversy. Many surveys have asked scientists directly whether they have committed or know of a colleague who committed research misconduct, but their results appeared difficult to compare and synthesize. This is the first meta-analysis of these surveys.
To standardize outcomes, the number of respondents who recalled at least one incident of misconduct was calculated for each question, and the analysis was limited to behaviours that distort scientific knowledge: fabrication, falsification, “cooking” of data, etc… Survey questions on plagiarism and other forms of professional misconduct were excluded. The final sample consisted of 21 surveys that were included in the systematic review, and 18 in the meta-analysis.
A pooled weighted average of 1.97% (N = 7, 95%CI: 0.86–4.45) of scientists admitted to have fabricated, falsified or modified data or results at least once –a serious form of misconduct by any standard– and up to 33.7% admitted other questionable research practices. In surveys asking about the behaviour of colleagues, admission rates were 14.12% (N = 12, 95% CI: 9.91–19.72) for falsification, and up to 72% for other questionable research practices. Meta-regression showed that self reports surveys, surveys using the words “falsification” or “fabrication”, and mailed surveys yielded lower percentages of misconduct. When these factors were controlled for, misconduct was reported more frequently by medical/pharmacological researchers than others.
Considering that these surveys ask sensitive questions and have other limitations, it appears likely that this is a conservative estimate of the true prevalence of scientific misconduct.
Citation: Fanelli D (2009) How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data. PLoS ONE 4(5): e5738. doi:10.1371/journal.pone.0005738
Editor: Tom Tregenza, University of Exeter, United Kingdom
Received: January 6, 2009; Accepted: April 19, 2009; Published: May 29, 2009
Copyright: © 2009 Fanelli. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The author is supported by a Marie Curie Intra European Fellowship (Grant Agreement Number PIEF-GA-2008-221441). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The author has declared that no competing interests exist.
* E-mail: dfanelli@staffmail.ed.ac.uk
Introduction Top
The image of scientists as objective seekers of truth is periodically jeopardized by the discovery of a major scientific fraud. Recent scandals like Hwang Woo-Suk's fake stem-cell lines [1] or Jan Hendrik Schön's duplicated graphs [2] showed how easy it can be for a scientist to publish fabricated data in the most prestigious journals, and how this can cause a waste of financial and human resources and might pose a risk to human health. How frequent are scientific frauds? The question is obviously crucial, yet the answer is a matter of great debate [3], [4].
A popular view propagated by the media [5] and by many scientists (e.g. [6]) sees fraudsters as just a “few bad apples” [7]. This pristine image of science is based on the theory that the scientific community is guided by norms including disinterestedness and organized scepticism, which are incompatible with misconduct [8], [9]. Increasing evidence, however, suggests that known frauds are just the “tip of the iceberg”, and that many cases are never discovered. The debate, therefore, has moved on to defining the forms, causes and frequency of scientific misconduct [4].
What constitutes scientific misconduct? Different definitions are adopted by different institutions, but they all agree that fabrication (invention of data or cases), falsification (wilful distortion of data or results) and plagiarism (copying of ideas, data, or words without attribution) are serious forms of scientific misconduct [7], [10]. Plagiarism is qualitatively different from the other two because it does not distort scientific knowledge, although it has important consequences for the careers of the people involved, and thus for the whole scientific enterprise [11].
There can be little doubt about the fraudulent nature of fabrication, but falsification is a more problematic category. Scientific results can be distorted in several ways, which can often be very subtle and/or elude researchers' conscious control. Data, for example, can be “cooked” (a process which mathematician Charles Babbage in 1830 defined as “an art of various forms, the object of which is to give to ordinary observations the appearance and character of those of the highest degree of accuracy”[12]); it can be “mined” to find a statistically significant relationship that is then presented as the original target of the study; it can be selectively published only when it supports one's expectations; it can conceal conflicts of interest, etc… [10], [11], [13], [14], [15]. Depending on factors specific to each case, these misbehaviours lie somewhere on a continuum between scientific fraud, bias, and simple carelessness, so their direct inclusion in the “falsification” category is debatable, although their negative impact on research can be dramatic [11], [14], [16]. Henceforth, these misbehaviours will be indicated as “questionable research practices” (QRP, but for a technical definition of the term see [11]).
Ultimately, it is impossible to draw clear boundaries for scientific misconduct, just as it is impossible to give a universal definition of professional malpractice [10]. However, the intention to deceive is a key element. Unwilling errors or honest differences in designing or interpreting a research are currently not considered scientific misconduct [10].
To measure the frequency of misconduct, different approaches have been employed, and they have produced a corresponding variety of estimates. Based on the number of government confirmed cases in the US, fraud is documented in about 1 every 100.000 scientists [11], or 1 every 10.000 according to a different counting [3]. Paper retractions from the PubMed library due to misconduct, on the other hand, have a frequency of 0.02%, which led to speculation that between 0.02 and 0.2% of papers in the literature are fraudulent [17]. Eight out of 800 papers submitted to The Journal of Cell Biology had digital images that had been improperly manipulated, suggesting a 1% frequency [11]. Finally, routine data audits conducted by the US Food and Drug Administration between 1977 and 1990 found deficiencies and flaws in 10–20% of studies, and led to 2% of clinical investigators being judged guilty of serious scientific misconduct [18].
All the above estimates are calculated on the number of frauds that have been discovered and have reached the public domain. This significantly underestimates the real frequency of misconduct, because data fabrication and falsification are rarely reported by whistleblowers (see Results), and are very hard to detect in the data [10]. Even when detected, misconduct is hard to prove, because the accused scientists could claim to have committed an innocent mistake. Distinguishing intentional bias from error is obviously difficult, particularly when the falsification has been subtle, or the original data destroyed. In many cases, therefore, only researchers know if they or their colleagues have wilfully distorted their data.
Over the years, a number of surveys have asked scientists directly about their behaviour. However, these studies have used different methods and asked different questions, so their results have been deemed inconclusive and/or difficult to compare (e.g. [19], [20]). A non-systematic review based on survey and non-survey data led to estimate that the frequency of “serious misconduct”, including plagiarism, is near 1% [11].
This study provides the first systematic review and meta-analysis of survey data on scientific misconduct. Direct comparison between studies was made possible by calculating, for each survey question, the percentage of respondents that admitted or observed misconduct at least once, and by limiting the analysis to qualitatively similar forms of misconduct -specifically on fabrication, falsification and any behaviour that can distort scientific data. Meta-analysis yielded mean pooled estimates that are higher than most previous estimates. Meta-regression analysis identified key methodological variables that might affect the accuracy of results, and suggests that misconduct is reported more frequently in medical research.
(...)
Discussion Top
This is the first meta-analysis of surveys asking scientists about their experiences of misconduct. It found that, on average, about 2% of scientists admitted to have fabricated, falsified or modified data or results at least once –a serious form of misconduct my any standard [10], [36], [37]– and up to one third admitted a variety of other questionable research practices including “dropping data points based on a gut feeling”, and “changing the design, methodology or results of a study in response to pressures from a funding source”. In surveys asking about the behaviour of colleagues, fabrication, falsification and modification had been observed, on average, by over 14% of respondents, and other questionable practices by up to 72%. Over the years, the rate of admissions declined significantly in self-reports, but not in non-self-reports.
A large portion of the between-studies variance in effect size was explained by three basic methodological factors: whether the survey asked about self or not, whether it was mailed or handed out to respondents, and whether it explicitly used the words “fabrication” and “falsification”. Once these factors were controlled for, surveys conducted among clinical, medical and pharmacological researchers appeared to yield higher rates of misconduct than surveys in other fields or in mixed samples.
All the above results were robust with respect to inclusion or exclusion of any particular study, with perhaps one exception: Martinson et al. (2005) [19], which is one of the largest and most frequently cited surveys on misconduct published to date. This study appears to be rather conservative, because without it the pooled average frequency with which scientists admit they have committed misconduct would jump to nearly 3%.
How reliable are these numbers? And what can they tell us on the actual frequency of research misconduct? Below it will be argued that, while surveys asking about colleagues are hard to interpret conclusively, self-reports systematically underestimate the real frequency of scientific misconduct. Therefore, it can be safely concluded that data fabrication and falsification –let alone other questionable research practices- are more prevalent than most previous estimates have suggested.
The procedure adopted to standardize data in the review clearly has limitations that affect the interpretation of results. In particular, the percentage of respondents that recall at least one incident of misconduct is a very rough measure of the frequency of misconduct, because some of the respondents might have committed several frauds, but others might have “sinned” only once. In this latter case, the frequencies reported in surveys would tend to overestimate the prevalence of biased or falsified data in the literature. The history of science, however, shows that those responsible of misconduct have usually committed it more than once [38], [39], so the latter case might not be as likely as the former. In any case, many of the included studies asked to recall at least one incident, so this limitation is intrinsic to large part of the raw data.
The distinction made in this review between “fabrication, falsification and alteration” of results and QRP is somewhat arbitrary. Not all alterations of data are acts of falsification, while “dropping data points based on a gut feeling” or “failing to publish data that contradicts one's previous research” (e.g. [19]) might often be. As explained in the introduction, any boundary defining misconduct will be arbitrary, but intention to deceive is the key aspect. Scientists who answered “yes” to questions asking if they ever fabricated or falsified data are clearly admitting their intention to misrepresent results. Questions about altering and modifying data “to improve the outcome” might be more ambiguously interpreted, which might explain why these questions yield higher admission rates. However, even if we limited the meta-analysis to the most restrictive types of questions in self-reports, we would still have an average admission rate above 1%, which is higher than previous estimates (e.g. [11]).
The accuracy of self-reports on scientific misconduct might be biased by the effect of social expectations. In self-reports on criminal behaviour, social expectations make many respondents less likely to admit a crime they committed (typically, females and older people) and make others likely to report a crime they have not really committed (typically, young males) [40]. In the case of scientists, however, social expectations should always lead to underreporting, because a reputation of honesty and objectivity is fundamental in any stage of a scientific career. Anyone who has ever falsified research is probably unwilling to reveal it and/or to respond to the survey despite all guarantees of anonymity [41]. The opposite (scientists admitting misconduct they didn't do) appears very unlikely. Indeed, there seems to be a large discrepancy between what researchers are willing to do and what they admit in a survey. In a sample of postdoctoral fellows at the University of California San Francisco, USA, only 3.4% said they had modified data in the past, but 17% said they were “willing to select or omit data to improve their results” [42]. Among research trainees in biomedical sciences at the University of California San Diego, 4.9% said they had modified research results in the past, but 81% were “willing to select, omit or fabricate data to win a grant or publish a paper” [35].
Mailed surveys yielded lower frequencies of misconduct than handed out surveys. Which of the two is more accurate? Mailed surveys were often combined with follow-up letters and other means of encouraging responses, which ensured higher response rates. However, the accuracy of responses to sensitive questions is often independent of response rates, and depends strongly on respondents' perception of anonymity and confidentiality [43], [44]. Questionnaires that are handed to, and returned directly by respondents might better entrust anonymity than surveys that need to be mailed or emailed. Therefore, we cannot rule out the possibility that handed out surveys are more accurate despite the lower response rates. This latter interpretation would be supported by one of the included studies: a handed out survey that attempted to measure non-response bias using a Random-Response (RR) technique on part of its sample [28]. Differently from the usual Direct Response technique, in RR, respondents toss coins to determine whether they will respond to the question or just mark “yes”. This still allows admission rates to be calculated, yet it guarantees full anonymity to respondents because no one can tell whether an individual respondent answered “yes” to the question or because of chance. Contrary to author's expectations, response and admission rates were not higher with RR compared to DR, suggesting that in this handed out survey non-response bias was absent.
The effect of social expectations in surveys asking about colleagues is less clear, and could depend on the particular interests of respondents. In general, scientists might tend to protect the reputation of their field, by minimizing their knowledge of misconduct [27]. On the other hand, certain categories of respondents (e.g. participants at a Conference on Research Policies and Quality Assurance [30]) might have particular experience with misconduct and might be very motivated to report it.
Surveys on colleagues' behaviour might tend to inflate estimates of misconduct also because the same incident might be reported by many respondents. One study controlled for this factor by asking only one researcher per department to recall cases that he had observed in that department in the past three years [31]. It found that falsification and fabrication had been observed by 5.2% of respondents, which is lower than all previous non-self reports. However, since one individual will not be aware of all cases occurring around him/her, this is a conservative estimate [31]. In the sensitivity analysis run on the regression model, exclusion of this study caused the single largest increase in explained variance, which further suggests that findings of this study are unusual.
Another critical factor in interpreting survey results is the respondents' perception of what does and does not constitute research misconduct. As mentioned before, scientists were less likely to reply affirmatively to questions using the words “fabrication” and “falsification” rather than “alteration” or “modification”. Moreover, three surveys found that scientists admitted more frequently to have “modified” or “altered” research to “improve the outcome” than to have reported results they “knew to be untrue”. In other words, many did not think that the data they “improved” were falsified. To some extent, they were arguably right. But the fuzzy boundary between removing noise from results and biasing them towards a desired outcome might be unknowingly crossed by many researchers [10], [14], [45]. In a sample of biostatisticians, who are particularly well trained to see this boundary, more than half said they had personally witnessed false or deceptive research in the preceding 10 years [46].
The grey area between licit, questionable, and fraudulent practices is fertile ground for the “Mohammed Ali effect”, in which people perceive themselves as more honest than their peers. This effect was empirically proven in academic economists [28] and in a large sample of biomedical researchers (in a survey assessing their adherence to Mertonian norms [47]), and may help to explain the lower frequency with which misconduct is admitted in self-reports: researchers might be overindulgent with their behaviour and overzealous in judging their colleagues. In support of this, one study found that 24% of cases observed by respondents did not meet the US federal definition of research misconduct [31].
The decrease in admission rates observed over the years in self-reports but not in non-self-reports could be explained by a combination of the Mohammed Ali effect and social expectations. The level and quality of research and training in scientific integrity has expanded in the last decades, raising awareness among scientists and the public [11]. However, there is little evidence that researchers trained in recognizing and dealing with scientific misconduct have a lower propensity to commit it [47], [48], [49]. Therefore, these trends might suggest that scientists are no less likely to commit misconduct or to report what they see their colleagues doing, but have become less likely to admit it for themselves.
Once methodological differences were controlled for, cross-study comparisons indicated that samples drawn exclusively from medical (including clinical and pharmacological) research reported misconduct more frequently than respondents in other fields or in mixed samples. To the author's knowledge, this is the first cross-disciplinary evidence of this kind, and it suggests that misconduct in clinical, pharmacological and medical research is more widespread than in other fields. This would support growing fears that the large financial interests that often drive medical research are severely biasing it [50], [51], [52]. However, as all survey-based data, this finding is open to the alternative interpretation that respondents in the medical profession are simply more aware of the problem and more willing to report it. This could indeed be the case, because medical research is a preferred target of research and training programs in scientific integrity, and because the severe social and legal consequences of misconduct in medical research might motivate respondents to report it. However, the effect of this parameter was not robust to one of the sensitivity analyses, so it would need to be confirmed by independent studies before being conclusively accepted.
The lack of statistical significance for the effect of country, professional position and other sample characteristics is not strong evidence against their relevance, because the high between-study variance caused by methodological factors limited the power of the analysis (the regression had to control for three methodological factors before testing any other effect). However, it suggests that such differences need to be explored at the study level, with large surveys designed specifically to compare groups. A few of the included studies had done so and found, for example, that admission rates tend to be higher in males compared to females [42] and in mid-career compared to early career scientists [19], and that they tend to differ between disciplines [41], [53]. If more studies attempted to replicate these results, possibly using standardized methodologies, then a meta-analysis could reveal important correlates of scientific misconduct.
In conclusion, several surveys asking scientists about misconduct have been conducted to date, and the differences in their results are largely due to differences in methods. Only by controlling for these latter can the effects of country, discipline, and other demographic characteristics be studied in detail. Therefore, there appears to be little scope for conducting more small descriptive surveys, unless they adopted standard methodologies. On the other hand, there is ample scope for surveys aimed at identifying sociological factors associated with scientific misconduct. Overall, admission rates are consistent with the highest estimates of misconduct obtained using other sources of data, in particular FDA data audits [11], [18]. However, it is likely that, if on average 2% of scientists admit to have falsified research at least once and up to 34% admit other questionable research practices, the actual frequencies of misconduct could be higher than this.(...)
References Top
1. Saunders R, Savulescu J (2008) Research ethics and lessons from Hwanggate: what can we learn from the Korean cloning fraud? Journal of Medical Ethics 34: 214–221. Find this article online
2. Service RF (2003) Scientific misconduct - More of Bell Labs physicist's papers retracted. Science 299: 31–31. Find this article online
3. Marshall E (2000) Scientific misconduct - How prevalent is fraud? That's a million-dollar question. Science 290: 1662–1663. Find this article online
4. Sovacool BK (2008) Exploring scientific misconduct: isolated individuals, impure institutions, or an inevitable idiom of modern science? Journal of Bioethical Inquiry 5: 271–282. Find this article online
5. Bogner A, Menz W (2006) Science crime: the Korean cloning scandal and the role of ethics. Science & Public Policy 33: 601–612. Find this article online
6. Koshland DE (1987) Fraud in Science. Science 235: 141. Find this article online
7. La Follette MC (2000) The evolution of the “scientific misconduct” issues: an historical overview. Procedings of the Society for Experimental Biology and Medicine 224: 211–215. Find this article online
8. Merton RK (1942) The normative structure of science. In: Merton RK, editor. The Sociology of Science: Theoretical and Empirical Investigations. Chicago, IL: University of Chicago Press.
9. Sismondo S (2004) An introduction to science and technology studies. Malden, Mass.: Blackwell.
10. Smith R (2000) What is research misconduct?. The COPE Report 2000: the Committee on Publication Ethics.
11. Steneck NH (2006) Fostering integrity in research: definitions, current knowledge, and future directions. Science and Engineering Ethics 12: 53–74. Find this article online
12. Babbage C (1830) Reflections on the decline of science in England and on some of its causes. In: Campbell-Kelly M, editor. The Works of Charles Babbage. London Pickering:
13. Krimsky S (2007) When conflict-of-interest is a factor in scientific misconduct. Medicine and Law 26: 447–463. Find this article online
14. De Vries R, Anderson MS, Martinson BC (2006) Normal misbehaviour: scientists talk about the ethics of research. Journal of Empirical Research on Human Research Ethics 1: 43–50. Find this article online
15. Guston DH (1999) Changing explanatory frameworks in the US government's attempt to define research misconduct. Science and Engineering Ethics 5: 137–154. Find this article online
16. Steneck NH (2003) The role of professional societies in promoting integrity in research. American Journal of Health Behaviour 27: S239–S247. Find this article online
17. Claxton LD (2005) Scientific authorship Part 1. A window into scientific fraud? Mutation Research-Reviews in Mutation Research 589: 17–30. Find this article online
18. Glick JL (1992) Scientific data audit -a key management tool. Accountability in Research 2: 153–168. Find this article online
19. Martinson BC, Anderson MS, de Vries R (2005) Scientists behaving badly. Nature 435: 737–738. Find this article online
20. Greenberg M, Goldberg L (1994) Ethical challenges to risk scientists: an exploratory analysis of survey data. Science, Technology, and Human Values 19: 223–241. Find this article online
21. Greenland S (1994) Quality scores are useless and potentially misleading - Reply to Re - a Critical-Look at Some Popular Analytic Methods. American Journal of Epidemiology 140: 300–301. Find this article online
22. Juni P, Witschi A, Bloch R, Egger M (1999) The hazards of scoring the quality of clinical trials for meta-analysis. Jama-Journal of the American Medical Association 282: 1054–1060. Find this article online
23. Lipsey M, Wilson DB (2001) Practical meta-analysis. California: Sage Publications.
24. Wilson DB (2005) SPSS Macros for Meta-analysis, Available at: http://mason.gmu.edu/~dwilsonb/ma.html.
25. Terrin N, Schmid CH, Lau J, Olkin I (2003) Adjusting for publication bias in the presence of heterogeneity. Statistics in Medicine 22: 2113–2126. Find this article online
26. Macaskill P, Walter SD, Irwig L (2001) A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine 20: 641–654. Find this article online
27. Gardner W, Lidz CW, Hartwig KC (2005) Authors' reports about research integrity problems in clinical trials. Contemporary Clinical Trials 26: 244–251. Find this article online
28. List JA, et al. (2001) Academic economists behaving badly? A survey on three areas of unethical behaviour. Economic Inquiry 39: 162–170. Find this article online
29. Lock S (1988) Misconduct in medical research: does it exist in Britain? British Medical Journal 297: 1531–1535. Find this article online
30. Glick LJ, Shamoo AE (1994) Results of a survey on research practices, completed by attendees at the third conference on research policies and quality assurance. Accountability in Research 3: 275–280. Find this article online
31. Titus SL, Wells JA, Rhoades LJ (2008) Repairing research integrity. Nature 453: 980–982. Find this article online
32. Tangney JP (1987) Fraud will out ? Or will it? New Scientist 115: 62–63. Find this article online
33. Bebeau MJ, Davis EL (1996) Survey of ethical issues in dental research. Journal of Dental Research 75: 845–855. Find this article online
34. May C, Campbell S, Doyle H (1998) Research misconduct: A pilot study of British addiction researchers. Addiction Research 6: 371–373. Find this article online
35. Kalichman MW, Friedman PJ (1992) A pilot study of biomedical trainees' perceptions concerning research ethics. Academic Medicine 67: 769–775. Find this article online
36. COPE (2000) The COPE report 2000. Committee on Publication Ethics.
37. Berk RA, Korenman SG, Wenger NS (2000) Measuring consensus about scientific research norms. Science and Engineering Ethics 6: 315–340. Find this article online
38. Judson HF (2004) The Great Betrayal: Fraud in Science. Orlando, Florida: Harcourt.
39. Grant J (2007) Corrupted Science: Fraud, Ideology and Politics in Science. Wisley, UK: Facts, Figures and Fun (AAPPL).
40. Farrington DP (2003) What has been learned from self-reports about criminal careers and the causes of offending. London: Home Office.
41. Martinson BC, Anderson MS, Crain LA, De Vries R (2006) Scientists' perceptions of organizational justice and self-reported misbehaviours. Journal of Empirical Research on Human Research Ethics 1: 51–66. Find this article online
42. Eastwood S, Derish P, Leash E, Ordway S (1996) Ethical issues in biomedical research: Perceptions and practices of postdoctoral research fellows responding to a survey. Science and Engineering Ethics 2: 89–114. Find this article online
43. Tourangeau R, Smith TW (1996) Asking sensitive questions - The impact of data collection mode, question format, and question context. Public Opinion Quarterly 60: 275–304. Find this article online
44. Bates SC, Cox JM (2008) The impact of computer versus paper-pencil survey, and individual versus group administration, on self-reports of sensitive behaviours. Computers in Human Behaviour 24: 903–916. Find this article online
45. Lynöe N, Jacobsson L, Lundgren E (1999) Fraud, misconduct or normal science in medical research - an empirical study of demarcation. Journal of Medical Ethics 25: 501–506. Find this article online
46. Ranstam J, Buyse M, George SL, Evans S, Geller NL, et al. (2000) Fraud in medical research: An international survey of biostatisticians. Controlled Clinical Trials 21: 415–427. Find this article online
47. Anderson MS, Martinson BC, De Vries R (2007) Normative dissonance in science: results from a national survey of US scientists. Journal of Empirical Research on Human Research Ethics 2: 3–14. Find this article online
48. Plemmons DK, Brody SA, Kalichman MW (2006) Student perceptions of the effectiveness of education in the responsible conduct of research. Science and Engineering Ethics 12: 571–582. Find this article online
49. Turrens JF (2005) Teaching research integrity and bioethics to science undergraduates. Cell Biol Educ 4: 330–334. Find this article online
50. Angell M (2000) Is academic medicine for sale? New England Journal of Medicine 342: 1516–1518. Find this article online
51. Bekelman JE, Li Y, Gross CP (2003) Scope and impact of financial conflicts of interest in biomedical research - A systematic review. Jama-Journal of the American Medical Association 289: 454–465. Find this article online
52. Sismondo S (2008) Pharmaceutical company funding and its consequences: a qualitative systematic review. Contemporary Clinical Trials 29: 109–113. Find this article online
53. Swazey J, Anderson M, Karen L (1993) Ethical problems in academic research. American Scientist 81: 542–553. Find this article online
54. Simmons RL, Polk HCJ, Williams B, Mavroudis C (1991) Misconduct and fraud in research: social and legislative issues symposium of the Society of University Surgeons. Surgery 110: 1–7. Find this article online
55. Glick JL (1993) Perceptions concerning research integrity and the practice of data audit in the biotechnology industry. Account Res 3: 187–195. Find this article online
56. Eastwood S, Derish P, Leash E, Ordway S (1996) Ethical issues in biomedical research: perceptions and practices of postdoctoral research fellows responding to a survey. Science and Engineering Ethics 2: 89–114. Find this article online
57. Rankin M, Esteves MD (1997) Perceptions of scientific misconduct in nursing. Nursing Research 46: 270–276. Find this article online
58. Geggie D (2001) A survey of newly appointed consultants' attitudes towards research fraud. Journal of Medical Ethics 27: 344–346. Find this article online
59. Meyer MJ, McMahon D (2004) An examination of ethical research conduct by experienced and novice accounting academics. Issues in Accounting Education 19: 413–442. Find this article online
60. Henry DA, Kerridge IH, Hill SR, McNeill PM, Doran E, et al. (2005) Medical specialists and pharmaceutical industry-sponsored research: a survey of the Australian experience. Medical Journal of Australia 182: 557–560. Find this article online
61. Kattenbraker MS (2007) Health education research and publication: ethical considerations and the response of health educators. Carbondale: Southern Illinois University.Doctoral dissertation.