Source Evaluation WRTG 316
Introduction
Many of us have grown up with trusted science sources, like the magnanimous Miss Frizzle from the Magic School Bus or the charismatic Bill Nye the Science Guy. As a researcher and writer, you will add many more trusted sources to your repertoire, including peer-reviewed articles, presentations, conference proceedings, patents, and reviews. Sharing findings and building on the studies of others is what makes up the information ecosystem. In scientific research, many minds are better than one.
A key part of collaboration in the sciences is verifying claims. This module will introduce you to the concepts of evaluating scientific sources so that you can discern who and what to trust.
Primary and Secondary Science Sources
In the sciences, primary sources report original research findings. Secondary sources provide context, identify trends, and connect research studies.
Sources such as pre-prints, open-source publications, sponsored research, and retractions are part of the academic publishing cycle. Their strengths and limitations will guide you in using the information wisely in your research.
| Pre-Print | A science preprint article is a scholarly manuscript shared publicly on a platform before or alongside the formal peer-review process. It's essentially a draft version of a research paper, made available online, allowing for immediate dissemination of findings and potentially soliciting feedback from the scientific community. Preprints differ from published articles in that they haven't undergone formal peer review by experts in the field.* |
| Open-Source Publications | A science open-source publication refers to scientific research (including publications, data, and code) that is freely available to the public without restrictions on access or reuse. It's a key part of the broader open science movement, aiming to increase transparency, collaboration, and reproducibility in research. Open-source publications are not behind paywalls, allowing anyone to read, download, and potentially modify the research.* |
| Sponsored Research | Sponsored scientific research refers to research activities that are funded by an external entity, such as a government agency, a private foundation, or a corporation. These projects typically involve a formal agreement or contract between the researcher's institution and the sponsoring organization, outlining the scope of work, budget, and reporting requirements.* |
| Retractions | Scientific retractions are official withdrawals of previously published research papers from the scientific literature. They occur when errors, misconduct, or other issues invalidate the findings, making the original publication unreliable. Retractions are a crucial mechanism for maintaining the integrity of the scientific record and correcting the published literature.* |
| Corrections/ Corrigendum | Corrections and corrigendum are official notices published to address errors or inaccuracies in a previously published work. They are issued by the author or journal to fix mistakes that do not invalidate the main findings. Major errors that affect conclusions would most likely lead to a retraction, not a correction. |
*Generated by Google AI, 8/18/25
Evaluating Sources of Information
When it comes to evaluating sources, it is helpful to know if a source has been peer-reviewed or undergone another form of professional evaluation. But even then, not all scientific studies are done well, and people can make mistakes or use flawed logic. You should evaluate the information itself before staking your professional reputation on a person or article.
These questions will help you interrogate the credibility of scientific studies:
Experimental replication
- Have the findings been replicated by other researchers?
- Is there enough explanation in the method section for another researcher to replicate it?
Methods of research
- Are the experimental methods appropriate for the research question?
- Have the researchers implemented appropriate controls?
- Is the sample size sufficient for the conclusions that are drawn?
- Is the statistical analysis accurate and representative of the findings?
Additional considerations
- What bias does the researcher have towards their study?
- Have studies been conducted more recently and/or in other disciplines that might impact these conclusions?
- Does the author make claims that are substantiated by the results?
Evaluating Data Sources
Data is another important component of scientific research as it comprises the results of the study. Pay careful attention to representations of data, like charts and graphs, where the researcher is telling a story about the results.
- What story is the chart or graph communicating?
- Is it an accurate representation of the study?
- If you are looking at a chart or graph within a secondary source, how was the data presented in its primary source?
Trustworthy Information Can Change Over Time
Fortunately, ethical researchers and trustworthy reporting outweigh deceptive practices in a professional or academic setting, which makes it easy to find credible sources for our research projects. Professionals bring their expertise, reputation, and integrity when sharing their research findings. Their reputations build our trust in their work.
However, we need to be careful to avoid becoming fixed in our understanding of a principle or concept. In the sciences, knowledge builds and changes as we conduct more studies, build new technologies, and test new theories. Being open to new knowledge and analyzing how it fits within our mental model of truth can help us adapt to information that may challenge current understanding. For example, gravity is a true principle but understanding how gravity works is something that continues to grow and develop. If Isaac Newton enrolled in a modern-day college physics class, he would have a lot of catching up to do. And knowing him, he would get right to it.