Evaluating Quantitative and Qualitative Research Articles.
VALUATING QUANTITATIVE AND QUALITATIVE RESEARCH ARTICLES
For this assignment, you will read two articles, one with a quantitative methodology and another with a qualitative methodology, answer a series of questions about them, and summarize your evaluations.
ASSIGNMENT INSTRUCTIONS
Read the sample qualitative and qualitative articles in the following reading list:
Unit 8: Evaluating Quantitative and Qualitative Research Articles.
Then open and complete the Evaluating Quantitative and Qualitative Research Articles Template [DOCX].
Note: You may want to refer to Dissecting Research Articles [PDF] as you work on this assignment.
Review the Evaluating Quantitative and Qualitative Research Articles Scoring Guide to learn about the criteria by which this assignment will be evaluated. When you have completed your assignment, submit it in the assignment area.
SUBMISSION REQUIREMENTS
Your assignment should meet the following requirements:
Written communication: Written communication must be grammatically correct and free of errors that detract from the overall message. Writing should be consistent with graduate-level scholarship.
Format: Submit the completed Evaluating Quantitative and Qualitative Research Articles Template as your assignment.
I will attach all of the parts. This assignment is submitting the Evaluating Quantitative and Qualitative Research Articles . Template [DOCX]. It will be labeled as to be comeplted.
Requirements: As described in the attached
Evaluating Quantitative and Qualitative
Research Articles
For this assignment, you will review two articles, one with a quantitative methodology and another with a qualitative methodology. Then you will use this template to reflect on the elements of each article, answer a series of questions, and summarize your evaluation.
Note: You may want to refer to Dissecting Research Articles (linked in the assignment instructions) as you complete this activity.
Part 1: Reviewing Quantitative Research
If you have not already done so, read the following sample quantitative research article. Then answer the questions about each section as directed.
Quantitative Research Article
Chang, X., Zhou, Y., Wang, C., & Heredero, C. d. P. (2017). . Frontiers of Business Research in China, 11(2), 242–268.
Section 1: Abstract, Introduction, Hypothesis, Research Question, and the Literature Review
The first step to dissecting and evaluating a research article is the review for clarity and consistency. The abstract, the introduction, the problem statement, and the research hypothesis or research question should be clearly stated and consistent. The reader should be able to understand the relationship between each component. These components set the stage for the rest of the document.
Question 1. “An abstract is a brief, comprehensive summary of the contents of the article; it allows the readers to survey the contents of an article quickly and, like a title, it enables the persons interested in the document to retrieve it from abstracting and indexing databases” (APA, 2010, p. 25).
The article’s abstract clearly and accurately summarizes the content of the study.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 2. The introduction describes the research topic and depicts the problem statement. The introduction should inform the reader regarding the potential of the research to provide important and relevant answers.
The article’s introduction explains why this problem is important and why this topic is worth researching.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 3. Leedy and Ormrod (2005) state that the research problem is the heart of the research process, “To see the problem with unwavering clarity and to state it in precise and unmistakable terms is the first requirement in the research process” (p. 43). The research problem clarifies the goals and the direction of the research.
The article’s problem statement is clearly articulated, specific, and comprehensive.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 4. The key terms should be defined so that the reader understands exactly what the writer is saying.
The article’s research questions are clearly stated and the key terms are defined.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 5. The literature review outlines the theory and past findings that are relevant to the research goals. The literature review should document the importance of the research problem.
The article’s literature review supports the necessity to study the specific research topic.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 6. The article’s introduction, statement of the problem, and literature review are appropriate and consistent with the research question.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 1.
Section 2: Methodology – Research Design, Methods and Procedures, and Sampling
The method section describes in detail how the study was conducted. The evaluation of the methodology consists of reviewing the research design, the recruitment of research participants, and the data collection procedures. Different research methodologies have different reporting requirements. The evaluation of a research article will vary somewhat depending on whether the research article is quantitative or qualitative.
According to Creswell (2003):
a quantitative approach is one in which the investigator primarily uses positivistic claims for developing knowledge (i.e., cause and effect thinking, reduction to specific variables and hypotheses and questions, use of measurement and observation, and the test of theories), employs strategies of inquiry such as experiments and surveys, and collects data on predetermined instruments that yield statistical data. The goal of quantitative research is to support or disprove the hypotheses. (p. 18)
Quantitative research designs attempt to find relationships between and among variables. The essence of quantitative research studies involves numbers and measurement; therefore, the data collected involves numbers and, ultimately, statistical procedures are used to analyze those numbers. Quantitative research is aimed at verification.
Examples of quantitative designs are:
Experiment—an attempt to determine a cause-and-effect relationship. It involves the manipulation of an independent variable and measures the effects on the dependent variables.
Quasi-experimental design—a research design used when participants cannot be randomly assigned to the groups, but the researcher does manipulate an independent variable and measures the effects on the dependent variables.
Non-experimental designs (most often, a correlational study)—determines the relationship between two or more variables.
Survey—obtains information from one or more groups of people about their characteristics, opinions, attitudes, or previous experiences and tabulates the information.
In order to dissect and evaluate research articles, there is a need to have knowledge of research methodology. The critique of a research study is not based on your personal beliefs or ideas, but on the scientific soundness of the study. As you progress through your graduate program, you will develop the skills necessary to critique a research article. As you continue to read research articles, the following questions will guide you in developing your skills for critically reading and evaluating research articles.
Question 7. The research design is stated and there is a detailed description of how the study will be conducted.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 8. The methods and procedures regarding how data will be collected are clearly described.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 9. The research design is suitable to answer the research questions.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 10. The instruments used to measure the outcomes are described, the reasons they were chosen are discussed, and the validity and reliability of the instruments was established.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
To evaluate the research evidence, it is important to know who the participants are and how they were chosen. The sampling strategy refers to the process of obtaining the research participants to be included in the study. The sampling section should clearly indicate the specific procedures used to recruit the participants. It should also indicate the sample size and the eligibility criteria.
Question 11. The participants were properly selected.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 12. The sampling strategy was clearly explained.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 2.
Section 3: Quantitative Methodology
The next section of a research article—or the next subsection of the method section—discusses the variables that were measured.
Introduction to Understanding Variables
Variables are found in quantitative studies, not in qualitative studies. Variables are specific concepts that are being studied. They vary along a continuum in terms of their characteristics (continuous variables) or they have at least two categories (categorical variables). For example, let us say the study is to examine gender differences in levels of morality.
Gender is one variable in the study, and the other variable is level of morality.
Gender has two categories: (1) male and (2) female.
Level of morality can vary along a continuum—let us say in this case, morality scores can range from 1–100 with higher scores being more morally sensitive.
Variables can be divided into two categories: independent and dependent variables. The independent variable causes or influences the change. The dependent variable is the outcome variable and must be measurable. You can use this formula to help you differentiate between the independent and dependent variable:
X → Y
X influences Y where X is the independent variable and Y is the dependent variable.
In the case above, gender is the independent variable and level of morality is the dependent variable.
Question 13. Identify the variables in the study. Which is the independent variable? Which is the dependent variable? (There may be more than one of each.)
a. Independent variable (or variables):
b. Dependent variable (or variables):
Question 14. An extraneous variable can create problems for the researcher. Extraneous variables are undesired variables that can influence the dependent variable and change or invalidate the results of an experiment.
Can you identify any extraneous variables in the sample quantitative article?
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 3.
Section 4: Analysis, Findings, Discussion
After authors of quantitative articles present the methods that they used and discuss their variables, they present the findings from their analysis of the data. When evaluating the research findings, first look for the scientific research evidence. Examples of nonscientific evidence are opinions, value judgments, personal experiences, unsupported assertions, and second-hand reports. If the results are based on nonscientific evidence, they should not be treated as reliable.
When you are dissecting the findings of the study or the researcher’s presentation and interpretation of results, how do you decide what evidence to believe? The following questions are helpful.
Where is the evidence?
How do you know that is true?
Why do you believe that?
Can you prove it?
Is the research evidence relevant to the key points?
Does the researcher draw the correct conclusion from the evidence?
Is information missing?
Researchers are susceptible to confirmation bias, meaning that there can be a tendency to confirm personal beliefs. When evaluating a research article, it is important to be aware of possible confirmation bias, and of your own personal beliefs, so that you can objectively decide whether the results have been reasonably presented and interpreted.
The results section must thoroughly explain how the data were collected and what statistics were used to analyze the data. The results must be described in enough detail in order to justify the conclusions.
Question 15. The results are presented in enough detail to allow the reader to evaluate the results.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 16. The conclusions and generalizations are valid and justified by the data analysis.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 17. The researcher has considered other possible interpretations of the results.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 18. The discussion is reasonable in view of the data collected and analyzed.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 19. The research questions were answered.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 4.
Section 5: Ethics and Implications of the Research Findings
Ethics in research is of particular importance. For the purposes of this exercise, some fundamental ethical concerns are listed here.
Informed consent should be in the form of a written statement that fully informs the participant of the nature of the research project and what is expected of participants. The researcher has the informed consent form signed by the participant.
Harm and loss of dignity refers to the right to self-esteem and protection from harm. Involvement in the study should not be physically or mentally harmful to the participants.
Privacy and confidentiality relates to procedures to ensure that information is stored in locked areas and no one outside of the researchers will have access to participants’ records. The researcher must protect the anonymity of the participants.
Participants should be informed that they have the right to decline or withdraw from the research at any time without consequences.
After presenting the results, the researcher interprets the implications of the research findings. This includes recommendations for further research and suggestions for relevant application of the research findings.
Question 20. There is no evidence of ethical violations in this research.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 21. The researcher clearly states the implications and applications of the research.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 22. This research has contributed relevant information to the field of study in your school.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 23. The researcher offers a reflection on the limitations of the study, including the research design.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Summarize your evaluation of this study, highlighting the strengths and weaknesses and proposing possible changes that might improve the study.
Part 2: Reviewing Qualitative Research
If you have not already done so, read the following sample qualitative research article. Then answer the questions about each section as directed.
Qualitative Research Article
Ruppel, C. P. (2013). Journal of Business and Technical Communication, 27(4), 436–471.
Section 1: Abstract, Introduction, Hypothesis, Research Question, and the Literature Review
As you will recall from the Dissecting Research Articles resource, the abstract and the introduction to the paper contain a number of important points. They are the same for a qualitative article as they are for quantitative articles.
After presenting the results, the researcher interprets the implications of the research findings. This includes recommendations for further research and suggestions for relevant application of the research findings.
Question 24. “An abstract is a brief, comprehensive summary of the contents of the article; it allows the readers to survey the contents of an article quickly and, like a title, it enables the persons interested in the document to retrieve it from abstracting and indexing databases” (APA, 2010, p. 25).
The article’s abstract clearly and accurately summarizes the content of the study.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 25. The introduction describes the research topic and depicts the problem statement. The introduction should inform the reader regarding the potential of the research to provide important and relevant answers.
The article’s introduction explains why this problem is important and why this topic is worth researching.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 26. Creswell (2007) asserts that in qualitative studies, the “need for the study” is a more appropriate terminology than the problem statement. “The intent of a research problem in qualitative research is to provide a rationale or need for studying a particular issue or problem” (Creswell, 2007, p. 102). Still, both methodologies must demonstrate a need for the study or a problem statement.
The researcher clearly describes the problem or the need for studying the topic under inquiry.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 27. Were the key terms defined? The reader needs to understand exactly what the writer is saying.
The article’s research question is clearly stated and the key terms are defined.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 28. The literature review outlines the theory and past findings that are relevant to the research goals. The literature review should document the importance of the research problem.
The article’s literature review supports the necessity to study the specific research question.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 29. The article’s introduction, statement of the problem, and literature review are appropriate and consistent with the research question.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 1.
Section 2: Methodology – Research Design, Methods and Procedures, and Sampling
Question 30. The research design is stated and there is a detailed description of how the study will be conducted.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 31. The methods and procedures for data collection are clearly described.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 32. The research design is compatible with the research question.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 33. The researcher clearly describes how participants were recruited and selected.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 34. The sampling strategy was clearly explained.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 2.
Section 3: Information Specific to Qualitative Methodology
Creswell (2003) described qualitative research as follows:
a qualitative approach is one in which the inquirer often makes knowledge claims based primarily on constructivist perspectives (i.e., the multiple meanings of individual experiences, meanings socially and historically constructed, with an intent of developing a theory or a pattern). . . . The researcher collects open-ended, emerging data with the primary intent of developing themes from the data. (p. 18)
Taylor and Bogdan (1998) noted that “qualitative methodology refers in the broadest sense to research that produces descriptive data—people’s own written or spoken words and observable behavior” (p. 7).
The goal of qualitative research is to gain an understanding of the experiences of the individuals who participate in the research study. Qualitative research is aimed at discovery, understanding, meaning, and developing knowledge from the perspective of first-person accounts of the experience under inquiry.
Examples of qualitative research methodologies are:
Phenomenology—the study of phenomena as experienced by the individual, with the emphasis on exactly how a phenomenon reveals itself to the experiencing person in all its specificity and concreteness. The participant experiencing a phenomenon is required to attend to it exactly as it appears in consciousness, without prejudgment, bias, or any predetermined set or orientation.
Grounded theory—a descriptive research approach that attempts to develop theories of understanding based on data from the real world. The ultimate goal of this approach is to derive theories that are grounded in the data collected.
Case study—an in-depth study of a single research subject (such as a program, an event, an activity, or a group of individuals).
Ethnography—a descriptive research approach that involves becoming a part of the culture you study. This model is based in the anthropological tradition of research. In this approach, the researcher would spend a long time becoming immersed in the culture of the population being studied.
Heuristics—a research model that places special emphasis on knowing through the self, by becoming one with the topic and experiencing it, as it exists in the world. Eric Craig (1978) defined heuristics in his work The Heart of the Teacher as “a private discovery oriented approach to understanding how individuals experience themselves and their world” (p. 22).
Generic or basic qualitative inquiry (or basic qualitative methodology)—an approach to eliciting opinions, attitudes, beliefs, or descriptions of experiences that is oriented toward issues external to the participants. An open-ended subjective opinion survey about people’s political beliefs would be an example.
To evaluate the research evidence, it is important to know who the participants are and how they were chosen. Sampling refers to the process of obtaining the research participants to be part of the study. The sampling section should clearly indicate the specific procedures used to recruit the participants. It should also indicate the sample size and the eligibility criteria.
In presenting the results of a qualitative research study, there needs to a clear and detailed description that includes direct quotes from data collected from the participants. One way in which the quality of the research results can be judged is by the reaction of the reader. Are the results believable? The reader should be able to say, “I understand” or “That makes perfect sense.” The presentation of the data should convince the reader of the credibility of the data analysis.
The results section of a qualitative study is a written presentation that includes the voices of the participants, the reflections of the researcher, and an interpretation of the answer to the research question and problem (Creswell, 2007). “A weak or unconvincing analysis can also stem from a failure to provide adequate examples from the data. . . . The researcher needs to make sure that their interpretations and analytic points are consistent with the data extracts” (Braun & Clarke, 2006, pp. 94–95).
Question 35. The presentation of the data permits the reader to understand how the results were interpreted.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 36. The direct quotes from the transcribed interviews support each category in the analysis.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflecting on the strengths and weaknesses of Section 3.
Section 4: Discussion and Analysis
When evaluating an article, look first for the scientific research evidence. Again, examples of nonscientific evidence are opinions, value judgments, personal experiences, unsupported assertions, and second-hand reports.
When you are dissecting the findings of the study or the researcher’s presentation and interpretation of results, certain questions can help with this evaluation. How do you decide what evidence to believe? The following questions will be helpful:
Where is the evidence (the words of the participants in qualitative research)?
How do I know that is true? Can I see it in the participants’ words?
Does the author support it with the participants’ words?
Is the research evidence relevant to the key issue being studied?
Does the researcher draw the correct conclusion form the evidence?
Is there information missing?
Researchers are susceptible to confirmation bias, meaning that there can be a tendency to confirm personal beliefs, and this is equally true in qualitative analysis. When evaluating a research article, it is important to be aware of possible confirmation bias, and of your own personal beliefs, so that you objectively review whether the results have been reasonably presented and interpreted. The results section must thoroughly explain how the data was collected and how the data was analyzed. The results must be described in detail in order to justify the conclusions or the interpretations of the data.
Question 37. The discussion and analysis are presented in enough detail to allow the reader to evaluate the results.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 38. The conclusions and generalizations are valid and justified by the data analysis.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 39. The researchers considered other possible interpretations of the results.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 40. The discussion is reasonable in view of the data presented.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Question 41. The research question was answered.
____ Strongly Agree ____ Agree ____ Neutral ____ Disagree ____ Strongly Disagree
Write one paragraph supporting your answers and reflec
Collepals.com Plagiarism Free Papers
Are you looking for custom essay writing service or even dissertation writing services? Just request for our write my paper service, and we'll match you with the best essay writer in your subject! With an exceptional team of professional academic experts in a wide range of subjects, we can guarantee you an unrivaled quality of custom-written papers.
Get ZERO PLAGIARISM, HUMAN WRITTEN ESSAYS
Why Hire Collepals.com writers to do your paper?
Quality- We are experienced and have access to ample research materials.
We write plagiarism Free Content
Confidential- We never share or sell your personal information to third parties.
Support-Chat with us today! We are always waiting to answer all your questions.
