Skip to Main Content

Research Methods & Studies

What are Research Methods?

Research methods are a set of standardized processes on how to conduct research. Though more common within the sciences, research methods are also utilized within other fields such as business, healthcare services, and education. The type of research method chosen is typically dependent on a number of factors, such as:

  • The nature of the problem being addressed
  • The theoretical stance and preferred methods of the researcher or research team
  • The time and money available
  • The type of research and evidence that most likely meets the preferences of and make the most impact with the research's sponsors or audience

In turn, the type of method chosen will determine whether the research will have an inductive or deductive approach. An inductive approach to research focuses on observing phenomena and then arriving at a theoretical explanation for that behavior. A deductive approach works in reverse, beginning first with a theory and then working to find evidence that either supports or refutes it. That said, some research methods can make use of both approaches.

There are two major types of empirical research study (i.e. research based on data of an observed or measured phenomena): qualitative and quantitative

 

Importance of Critical Appraisal

Critical appraisal is a systematic process used to identify the strengths and weaknesses of a research article in order to assess the usefulness and validity of research findings.

The most important components of a critical appraisal are an evaluation of the appropriateness of the study design for the research question. 

Clinical Appraisal of Clinical Research. 

Bias

Bias can be defined as: ‘a systematic error, or deviation from the truth, in results or inferences’

Publication Bias - Studies with positive results (or drastic results) are greatly more represented & published in literature than studies with negative results, producing so-called publication bias. Underreporting of negative results introduces bias into meta-analysis (data with negative/results that don’t support the initial hypothesis often remain unpublished and therefore excluded from meta-analysis & larger scope of research).

  • Pharmaceutical companies often do not have the incentive to publish negative results of drug investigations. It is estimated that 60% of clinical trials with findings of inadequate drug efficacy or safety concerns remained unpublished.
  • Publication bias may lead to overestimating the effect of the intervention being examined in the meta-analysis. In order to ensure the reliability of a meta-analysis, one must systematically search for negative trials for inclusion.

Retrieval Bias - This bias refers to a potential distortion of the findings of a meta-analysis due to the overlooking or exclusion of relevant studies that merit inclusion. It is critically important to search a variety of different databases.

  • Researchers should be particularly attentive to carefully choosing search terms. The appropriate use of Subject Headings,  keywords and Boolean search strings can help maximize the retrieval of relevant articles.

Language Bias - Language bias is closely related with retrieval bias. It refers to a potential distortion of the results of a meta-analysis due to a failure to identify relevant study findings published in languages other than English.

Heterogeneity/Homogeneity - refers to the variation in study outcomes between studies. Heterogeneity refers to multiple studies have too great a variation in their results and makes it difficult to compare & analyze the studies and draw any useful conclusions; performing analyses may not be feasible. Homogeneity refers to have multiple studies with similar results.

Funding Bias - Investigators with a financial interest in showing that a particular drug works may exclude participants who did not respond favorably to the drug from the analysis, or fail to report unfavorable results of the drug in a manuscript. Financial conflicts of interest involve both financial interests related to a specific trial (for example, a company funding a trial of a drug produced by the same company) and financial interests related to the authors of a trial report (for example, authors’ ownership of stocks or employment by a drug company).

Location Bias - The publication of research findings in journals with different ease of access or levels of indexing in standard databases, depending on the nature and direction of results.

Time-lag Bias - The rapid or delayed publication of research findings, depending on the nature and direction of the results. The length of time between completion of a study and publication of its results can be influenced by the nature and direction of the study results (‘time-lag bias’). Several studies suggest that randomized trials with results that favor the experimental intervention are published in journals about one year earlier on average than trials with unfavorable results

Citation Bias - The number of times a study report is cited appears to be influenced by the nature and direction of its results. It was observed that articles with statistically significant results were cited 1.57 times the rate of articles with non-significant results. They also found that articles with results in a positive direction (regardless of their statistical significance) were cited at 2.14 times the rate of articles with results in a negative direction. It was found that the number of citations received by a study was positively correlated with the magnitude of effects reported: If positive studies are more likely to be cited, they may be more likely to be located, and thus more likely to be included in a systematic review.

Multiple (duplicate) Publication Bias - Investigators may report the results of their study across multiple publications - Evidence suggests that studies with statistically significant results or larger treatment effects are more likely to lead to multiple publications (‘multiple (duplicate) publication bias’), which makes it more likely that they will be located and included in a meta-analysis.