Research Seminar II T.

de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Research Seminar II Introduction, methodology and theory

Thomas de Graaff
Department of Spatial Economics, Vrije Universiteit Amsterdam

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

February 3, 2014

Conclusion
Concluding remarks

What are we going to do . . .

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Introduction Positioning of the course Course outline Theory Why do we need theory? Methodology Methodology versus methods Workow Research paradigms Research Research methods for Operation Management Research in practice Conclusion Concluding remarks

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Research Seminar II & Thesis

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Course Objectives
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Upon completion of this course you are able to: distinguish between several research frameworks that can be developed in TSCM; reect on the question whether a specic research framework is suitable for a particular research question; set up your research to use each of the above mentioned research frameworks; apply the above mentioned research framework to (stylized) research projects; validate the results obtained; report on the use of the above mentioned research frameworks.

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Course outlinelectures
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Feb 3: Research design (de Graaff) Feb 6: Survey research (van Leeuwen) Feb 10 Statistical analysis (de Graaff) Feb 13: Case research (de Leeuw) Feb 17: Analytical quantitative research (Saputra)

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Course outlineLarge assignment

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Feb 20: Discussion research projects & feedback on assignments 1/2/3 Feb 27: Meeting 1 research project March 6: Meeting 2 research project & feedback assignments 4 March 13: Meeting 3 research project March 20: Deadline short research paper March 28(?): Poster presentations & drinks

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Do passengers prefer airports over airlines?

The London Paris Market

Mandy van Meurs & Daan Nederlof VU University Amsterdam 2010

1 The office

2 The feedback session 3 The feedback session

4 The weekend meeting

Email from Mandy to Daan

Subject: Applied model structure

Model 1 Airport
Model 1 Airport

Ticket Choice

London Heathrow

London Gatwick

London Luton

The method explanation

LHR-AF

LHR-BA

LHR-BD

LGW-BA

LTN-U2

Model 2 Airline

The method explanation

Model 2 Airline

Ticket choice

The consultancy hour

Airfrance

British Midland

British Airways

Easyjet

The emperical results

LHR-AF LHR-BD LHR-BA LGW-BA LTN-U2

10 The Conclusion

Legenda
Nested Logit Model: Is a model used to represent choice between two mutually exclusive options. The model allows the error terms of pairs or groups of alternatives to be correlated. Tau: is a performance measure that represents whether the unobserved factors of different options within the same nest actually correlate. Log Likelihood: provides an indication how well the data suits the model. Two model fits are compared. The higher the log likelihood indicator, the better the model suits the data. Predictors: both model 1 & 2 used the predictors: Road distance,
Frequency of airline service (logarithm version), Average fare and Checkin time. It was found that all predictors in both models have a significant influence.

Theory?
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Rules without practical applications Boring? . . . its just theory

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Theory!
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

A system of hypotheses which can explain phenomena and thus are able to predict them Explanation HOW something really works in reality Nothing is more practical than a good theory.1 It is a capital mistake to theorize before one has data.2

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

1 2

Ascribed to Kurt levin but disputed . . . Sherlock Holmes in A study of scarlet

Theory in Operations Management

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Different than the hard sciences Theory is central here as well; goal is to clarify the functioning of a rm USEFUL insight and understanding are central Clarication AND change Key issues:
Validity Useful when applied (applied science in contrast to pure science)

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

OR methodology should not be the only methodology (Meredith et al., 1989)

OM versus OR

Side-issue: reseach in Operations Management

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

The Positivists Approach

Only empirically veriable or analytic propositions are meaningful Reality exists independent of environment (language, culture, researcher, rm, etc.)

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

The Empirists approach

Hypotheses can be falsied (Popper)

Research
Research methods for Operation Management Research in practice

Post-positivist approach
Simultaneous use of multiple research methods Triangulation

Conclusion
Concluding remarks

Side-issue: the Empirists approach

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Type I ()
Reject the null-hypothesis when the null hypothesis is true

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Type II ( )
Accept the null hypothesis when the null hypothesis is false

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Methodology
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

How something must be done and why Rules of the game (and norms) Netjes werken

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Method versus methodology

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Survey Qualitative Preferential research analysis

Experiment User interface preference testing Simulation experiment

Case study Interviews

Archival data Quotation analysis

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Quantitative Scheduling analytical truck drivers research Quantitative Factor Statistical analysis analysis

Inventory modeling for company ABC Impact of fringe benets on personel behavior

Modeling shopping routes in supermarkets Modeling airline choice

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Testing interal validity

Methodology in Business Administration

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory application There is a theory (in business administration) There is limited empirical data available Key is to apply theory in practice Outline:
diagnose construction Implementation

Theory development There is a rudimentary theory/basic notions There is an abundance of empirical data Methods are available to development theory Outline:
exploration of the empirics explanation validation

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Development vs. application

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Theory development leads to a knowledge product: A more or less validated theory is developed by using empirical data Theory application leads to an intervention product: A set of tools that makes it possible to implement new measures for improvement

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Development: empirical cycle

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Goal: to test whether a theoretical hypothesis is valid in reality Steps:

Research objective Research design Data collection Data analysis Report the results

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Application: design cycle

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Goal: to create something new on the basis of existing data or an existing theory Steps:
Design objective Design specications Generation of alternative designs
Evaluation or development

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Selection from alternative designs Report the results

Conclusion
Concluding remarks

Cycle of research stages

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Testing

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Start

Description

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Explanation

What is workow?
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Well, its how one works (duh!) but it boils down to writing all things down, such as: transcripts; code; syntax; references; gures; maps.

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Why focus on workow?

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Empirical cycle Read other papers Do:

1 2 3 4 5 6

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

collect data; transform data; analyse data; write up results; present results; go back to 1) until satised

Send paper to supervisor and go back once again to 1) until supervisor satised And... documenting throughout the entire process!!!

Conclusion
Concluding remarks

Why focus on workowcntd.

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Good scientic practice: document how you have achieved your results But it allows as well: Reproducibility Transparency Modularity Portability (across systems and users) Efciency Self-sanity

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Some tools...
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

1 2 3 4 5 6

Reference manager Syntax les (stata, ArcMap, SPSS, etc) Version Control Manager (dropbox) Back up system (dropbox) Some folder system (txt les)

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Research paradigms
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Set of methods Various dimensions:

How to gather data (survey,case,experiment) How to analyse data (statistics, taxonomy) Purpose of the research (explanation, development) Unit of analysis (rms, individuals, supply chains)

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Two trade-offs
Rational/extensial dimension Natural/articial dimension

Conclusion
Concluding remarks

Research dimensions
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Rationalismuse formal structure and logic as measure of truth Naturalderiving explanations from actual data

Existentialindividual in concert with environment is basis of knowledge Articialderiving explanations from interpretation and articial reconstruction

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Research perspectives (part I)

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

RationalExistential Relates to structure of research process Continuum:

Axiomatic (theorem-proof) Logical positivist/empiricist (phenomenon can be isolated) Interpretive (including context: people) Critical theory (combine latter two)

Rationale pole: dimensions Deductive Formally structured High degree of objectivity Methodologically prescribed Restricts environmental interaction A priori assumptions Coherence with laws

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Research perspectives (part II)

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

NaturalArticial Based on kind of information used in research continuum:

1

Articial pole: dimensions Abstract and simplied models Conclusions are reliable and internally consistent Highly controlled No noise

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

There is an objective reality research through somebody elses eye Articial reconstruction of reality

Research methods4
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Methods Experiment Survey Archival analysis (e.g., economic study) History Case study

Type of research How, why Who, what, where, how many, how much Who, what3 , where, how many, how much How, why How, why

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

what questions, when asked as part of an exploratory study pertain to all categories 4 Source: Yin, R.Y., Case study Research; design and methods, 1989

Research methods
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory application
Survey Lab experiment Analytical quantitative research Statistical analysis Case research

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Theory development
Analytical quantitative research Case research

Conclusion
Concluding remarks

Relation between research methods

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Step 1: Theory selection

Develop heuristic (AQR) Literature

Theory
Why do we need theory?

Step 2: Data generation

Surveys Lab experiments Simulation (AQR) Firm selection

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Step 3: AnalysisInference
Case studies Statistical analysis

Conclusion
Concluding remarks

Research in general
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Three steps:
Preparation (describe) Research (test) Analysis of the ndings (explain)

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Four objectives:
Pure description of a phenomena Solution of a societal problem Development of a theory Validation of a theory

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Preparation phase
Research Seminar II T. de Graaff

Formulate research problem and a research question

Introduction
Positioning of the course Course outline

Formulate conceptual model

Limited representation of reality Theoretical framework

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Formulate research design, e.g.:

Focus/unit of analysis your main variable precisely Manner of data collection Whom to ask? etcetera

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Analysis of the results

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Analyzing the results

Appropriate number of cases? Correction needed?

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Analyzing the ndings. Three steps:

Data reduction Data presentation (schematical overview) Drawing conclusions

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Analysis of the resultscontinued

Research Seminar II T. de Graaff

Quantitative nature: statistical analysis

Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Means & standard deviations Correlations Regression analysis

Methodology
Methodology versus methods Workow Research paradigms

Test the hypotheses and then assess your theoretical framework (feedback) Report your results schematically (tables/gures/charts) Discuss assumptions & draw conclusions (inference)

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks

Validity of your research

Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Theory
Why do we need theory?

Validity can be increased by operationalization of denitions and doing some explicit reections Denition validity Internal validity External validity
Statistical vs. analytical / theoretical generalization

Validity ensured by:

Careful documentation Analysis of various perspectives (triangulation)

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Time intensive nature demands good planning (time) planning

Conclusion
Concluding remarks

In conclusion
Research Seminar II T. de Graaff Introduction
Positioning of the course Course outline

Research proposal/design is blueprint for research Theoretical framework is essential (especially for empirical research) Methodology vs research method Doing research is not sequential but cyclical Work as tidy as possible! Log every step you take

Theory
Why do we need theory?

Methodology
Methodology versus methods Workow Research paradigms

Research
Research methods for Operation Management Research in practice

Conclusion
Concluding remarks