Explain the value of conducting a pilot test and
Week 2 Assignment 2 Chapter 4
Explain the value of conducting a pilot test and the primary considerations for a research planning to use a pilot test.
Week 2 Assignment 2 Chapter 4
Explain the value of conducting a pilot test and the primary considerations for a research planning to use a pilot test.
,
THE RESEARCH PROCESS: AN OVERVIEW
Chapter 4
McGraw-Hill/Irwin
Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.
4-‹#›
1
This chapter provides an overview of the research process and sets the stage for coming chapters.
Learning Objectives
Understand …
That research is decision- and dilemma-centered.
That the clarified research question is the result of careful exploration and analysis and sets the direction for the research project.
4-‹#›
4-‹#›
2
Learning Objectives
Understand . . .
How value assessments and budgeting influence the process for proposing research, and ultimately, research design.
What is included in research design, data collection, and data analysis.
Research process problems to avoid.
4-‹#›
4-‹#›
3
Research Thought Leaders
“Listening is the front end of decision making. It’s the surest, most efficient route to informing the judgments we need to make.”
Bernard Ferrari, consultant,
Ferrari Consultancy, LLC,
and former director at McKinsey & Company
4-‹#›
4-‹#›
The Research Process
Stage 1: Clarifying the Research question
Stage 2: Proposing Research
Stage 3: Designing the Research
Stage 4: Data Collection & Preparation
Stage 5: Data Analysis & Interpretation
Stage 6: Reporting the Results
4-‹#›
4-‹#›
Stage 1: Clarifying the Research Question
Management-research question hierarchy process begins by identifying the management dilemma
4-‹#›
4-‹#›
6
Exhibit 4-1 illustrates the research process. This slide focuses on the first stage of the process, clarifying the research question.
A useful way to approach the research process is to state the basic dilemma that prompts the research and then try to develop other questions by progressively breaking down the original question into more specific ones. This process can be thought of as the management-research question hierarchy.
The process begins at the most general level with the management dilemma. This is usually a symptom of an actual problem, such as rising costs, declining sales, or a large number of defects.
This portion of the research process is the focus of chapter 5.
Key terms:
A management dilemma is an opportunity of problem that the manager has discovered because of one or more symptoms.
A management question is a restatement of the manager’s dilemma in question form.
A research question is the hypothesis that best states the objective of the research; the question that focuses the researcher’s attention.
An investigative question is the question the researcher must answer to satisfactorily answer the research question.
A measurement question is the question asked of the participant or the observations that must be recorded.
Stage 1: Clarifying the Research Question
Step 1: Discover the Management Dilemma
4-‹#›
4-‹#›
7
This portion of Exhibit 4-2 explores the management dilemma for the MindWriter CompleteCare vignette
A management dilemma is an opportunity or problem that the manager has discovered because of one or more symptoms.
Stage 1: Clarifying the Research Question
Step 2: Define the Management Question
4-‹#›
4-‹#›
8
This portion of Exhibit 4-2 explores the management question for the MindWriter CompleteCare vignette
A management question is a restatement of the manager’s dilemma in question form.
Stage 1: Clarifying the Research Question
Step 3: Define the Research Question
4-‹#›
4-‹#›
9
This portion of Exhibit 4-2 explores the research question for the MindWriter CompleteCare vignette
A research question is the hypothesis that best states the objective of the research; the question that focuses the researcher’s attention.
Evaluating the Value of Research
Option Analysis
Decision Theory
Prior or Interim Evaluation
Ex Post Facto Evaluation
4-‹#›
4-‹#›
10
Managers are increasingly asked to prove that research meets ROI objectives. Conceptually, the value of research is not difficult to determine. It may be judged in terms of the difference between the result of decisions made with the information and the result that would be made without it. This application cannot be measured, though.
Option analysis: Managers conduct formal analysis of each alternative research project judged in terms of estimated costs and associated benefits and with managerial judgment playing a major role.
Decision theory: The focus is on trying to assess the outcomes of each action. The manager chooses the action that affords the best outcome – the action criteria that meets or exceeds whatever criteria are established. Each criterion is a combination of a decision rule and a decision variable. The decision rule is a criterion for judging the attractiveness of two or more alternatives when using a decision variable. The decision variable is a quantifiable characteristic, attribute, or outcome on which a choice decision will be made. The evaluation of alternatives requires that
each alternative is explicitly stated,
a decision variable is defined by an outcome that may be measured, and
a decision rule is determined by which outcomes may be compared.
Prior or Interim Evaluation: In this case, managers decide to control the research expenditure risk by doing a study in stages. Costs are then reviewed at each stage.
Ex Post Facto Evaluation: This form occurs after the research is conducted but can be useful in guiding future decisions.
Stage 2: Proposing Research
Budget Types
Rule-of-thumb
Departmental
Task
4-‹#›
4-‹#›
11
From Appendix A.
Once the research is defined, the research must be proposed in order to allocate resources to the project. There are three types of budgets in organizations where research is purchased and cost containment is crucial.
Rule-of-thumb budgeting involves taking a fixed percentage of some criterion. For example, a percentage of the prior year’s sales revenues may be the basis for determining the business research budget for a manufacturer.
Departmental (functional area) budgeting allocates a portion of total expenditures in the unit to research activities. This allows units like human resources and marketing to have the authority to approve their own projects
Task budgeting selects specific research projects to support on an ad hoc basis. This is the least pro-active form but permits definitive cost-benefit analysis.
The Research Proposal
Delivery
Written
proposals
establish
Timing
Budgets
Extent
Legally-binding
contract
Obligations
Methods
Purpose
4-‹#›
4-‹#›
12
From Appendix A
A written proposal is often required and is desirable for establishing agreement on a number of issues. These issues are named in the slide.
A research proposal may also be oral. This is more likely when a manager directs his or her own research.
Students have an example of an external proposal on their text CD.
Stage 3: Designing the Research
4-‹#›
4-‹#›
Stage 3 encompasses the design of the research project. There are three components to this stage: research design, sampling design, and pilot testing.
Research design is the blueprint for fulfilling objectives and providing the insight to answer the management dilemma. There are many methods, techniques, procedures, and protocols possible.
Chapter 6 identifies various research designs and
Chapters 7-14 discuss specific methodologies.
Another step in planning the research project is to identify the target population and determine whether a sample or census is desired. A census is a count of all elements in a population. A sample is a group of cases, participants, events, or records that constitute a portion of the target population. The researcher must determine whether to choose a probability or nonprobability sample.
Types of samples, sample frames, how samples are drawn, and the determination of sample size are discussed in Chapters 15.
A pilot test is conducted to test weaknesses in the research methodology and the data collection instrument and to provide proxy data for selection of a probability sample.
Chapter 14 focuses on instrument development and pilot testing is discussed.
13
Stage 3: Designing the Research
The
Research
Project
Research
Design
Sampling
Design
Pilot Testing
4-‹#›
4-‹#›
14
Stage 3 encompasses the design of the research project. There are three components to this stage: research design, sampling design, and pilot testing.
Research design is the blueprint for fulfilling objectives and providing the insight to answer the management dilemma. There are many methods, techniques, procedures, and protocols possible.
Chapter 6 identifies various research designs and
Chapters 7-14 discuss specific methodologies.
Another step in planning the research project is to identify the target population and determine whether a sample or census is desired. A census is a count of all elements in a population. A sample is a group of cases, participants, events, or records that constitute a portion of the target population. The researcher must determine whether to choose a probability or nonprobability sample.
Types of samples, sample frames, how samples are drawn, and the determination of sample size are discussed in Chapters 15.
A pilot test is conducted to test weaknesses in the research methodology and the data collection instrument and to provide proxy data for selection of a probability sample.
Chapter 14 focuses on instrument development and pilot testing is discussed.
Stage 4: Data Collection
4-‹#›
4-‹#›
15
Data Characteristics
Abstractness
Verifiability
Elusiveness
Closeness
4-‹#›
4-‹#›
16
Stage 4 deals with data collection and preparation.
Data may be characterized by their abstractness, verifiability, elusiveness, and closeness to the phenomenon. As abstractions, data are more metaphorical than real.
For instance, the growth in GDP cannot be readily observed.
Second, data are processed by our senses. When sensory experiences consistently produce the same result, our data are said to be trustworthy.
Capturing data is elusive.
Secondary data are originally collected to address a problem other than the one which require the manager’s attention at the moment.
Primary data are data the research collects to address the specific problem at hand.
Collecting Sensitive Data Demands Safeguards
Scotts used a healthcare management company to collect sensitive wellness data during annual health assessments to preserve participant confidentiality.
4-‹#›
4-‹#›
17
Refer to the Snapshot in the teacher’s instruction manual: Scotts is Cultivating Lower Health Care Costs in the Instructor’s Manual.
Data Types
Primary
Secondary
4-‹#›
4-‹#›
18
Data is characterized as of two types.
Secondary data are originally collected to address a problem other than the one which require the manager’s attention at the moment.
Primary data are data the research collects to address the specific problem at hand.
Ask which students are seeing…immediate reaction is secondary data…but caution them. If a researcher is evaluating how individuals are using library assets in an observation study, primary data could be what they see in this picture.
Stage 5: Data Analysis &Interpretation
4-‹#›
4-‹#›
19
Steps in Data Analysis and Interpretation
Reduce data to manageable size
Develop summaries
Look for patterns
Apply statistical techniques
4-‹#›
4-‹#›
20
Data analysis usually involves these four actions. Researchers then interpret their findings in light of the research questions and hypotheses. The raw data alone cannot provide the insights necessary to improve decision-making.
Motorola and Rock the Vote teamed up during the 2004 presidential election to use cell phone surveys to track young voters’ changing perceptions during the campaign. The PicProfile on this research is on p. 88.
Stage 6: Reporting the Results
4-‹#›
4-‹#›
Parts of the Research Report
Research
Report
Executive
Summary
Research
Overview
Technical
Appendix
Implementation
Strategies
4-‹#›
4-‹#›
22
In reporting the results, the researcher should strive to provide insightful information adapted to the client’s needs and to choose words carefully when crafting interpretations, conclusions, and recommendations. The research report should include an executive summary, research overview, implementation strategies, and a technical appendix.
The executive summary consists of a synopsis of the problem, findings, and recommendations.
The overview of research explains the background, exploratory findings from secondary data, the research design and procedures, and the conclusions.
The implementation strategies section expands on recommendations.
A technical appendix contains all the materials necessary to replicate the project.
The Research Report Overview
Problem’s background
Summary of exploratory findings
Research design and procedures
Conclusions
4-‹#›
4-‹#›
23
This slide presents the components of the research overview section of a research report.
Research Process Problems to Avoid
Ill-defined management problem
Unresearchable questions
Politically-motivated research
4-‹#›
4-‹#›
24
Researchers must remain objective. The slide presents common problems in the research process.
Unresearchable questions: Not all management questions are researchable and not all research questions are answerable.
An ill-defined problem is one that addresses complex issues and cannot be expressed easily or completely.
Politically-Motivated Research: Sometimes a research study is intended to win approval for a pet idea or to protect a decision maker. In these cases, it may be more difficult to get support for the most appropriate research design.
Research Process Problems to Avoid
Company Database Strip-mining
Favored Techniques Syndrome
4-‹#›
4-‹#›
25
Researchers must remain objective. The slide presents common problems in the research process.
The favored-technique syndrome occurs when researchers are method-bound. They recast management questions so that it is amenable to their favorite method.
Company database strip-mining means that managers may feel that they do not want to collect more data until they have thoroughly evaluated all existing data. While data mining can be a good starting point, it will rarely address all questions related to a specific management dilemma.
Not all management questions are researchable and not all research questions are answerable.
An ill-defined problem is one that addresses complex issues and cannot be expressed easily or completely.
Sometimes a research study is intended to win approval for a pet idea or to protect a decision maker. In these cases, it may be more difficult to get support for the most appropriate research design.
Key Terms
Census
Data
Primary data
Secondary data
Data analysis
Decision rule
exploration
Investigative questions
Management dilemma
Management question
Management-research question hierarchy
Pilot test
Research design
Research process
Research questions
Sample
Target population
4-‹#›
4-‹#›
26
PicProfile: Emerging Research
4-‹#›
4-‹#›
PulsePoint: Research Revelations
49
The percent of hiring managers who discovered a lie on a résumé .
4-‹#›
4-‹#›
28
See the Instructors Manual (downloadable from the text website) for ideas for using this research-generated statistic.
Collepals.com Plagiarism Free Papers
Are you looking for custom essay writing service or even dissertation writing services? Just request for our write my paper service, and we'll match you with the best essay writer in your subject! With an exceptional team of professional academic experts in a wide range of subjects, we can guarantee you an unrivaled quality of custom-written papers.
Get ZERO PLAGIARISM, HUMAN WRITTEN ESSAYS
Why Hire Collepals.com writers to do your paper?
Quality- We are experienced and have access to ample research materials.
We write plagiarism Free Content
Confidential- We never share or sell your personal information to third parties.
Support-Chat with us today! We are always waiting to answer all your questions.
