Research Design
The research design connects the research question and methodology. It outlines the logical and transparent planning of the research process, specifies the chosen methods, and justifies their application.
AI-modifiedAI Use Information for this Web Page
The textual content of this page is AI modified.
- AI status: Modified with AI
- Scope: Entire page textual content
- Human oversight: Reviewed by Christian Huber before publication
- Details of AI usage: This page text was processed with AI assistance. The content was originally authored by Christian Huber and subsequently refined using language models to improve structure, consistency, and terminology. All AI-generated suggestions were manually reviewed and approved by Christian Huber before publication. The AI did not generate novel content but supported optimisation of existing material.
- Known limitations: AI-assisted text refinement may produce stylistic over-corrections; synonym suggestions may lack domain-specific precision; consistency checks may not account for intentional stylistic variation; applied grammar rules may reflect language model bias rather than prescriptive standards; estimated accuracy for editing suggestions: 94–97%.
- Example prompt used:
Example: "Improve clarity and consistency in this text whilst preserving the original voice. Check grammar, fix repetition, and ensure terminology is standardised. Suggest changes only, do not modify content." - Data flow: No personal data included. No data retention by model provider beyond session duration. No external storage or third-party sharing.
- Liability for AI errors: Liability for content accuracy rests with Christian Huber. Disclaimer: AI system recommendations are not binding and do not guarantee correctness.
- Content created: 23 August 2025
- Reviewed by: Christian Huber
Summary
Note: This summary was produced with AI support, then reviewed and approved.
- A research design is the blueprint of an academic study. It links the research question with the chosen methods and ensures that the process is logical, transparent and verifiable.
- Its functions are logical structure, traceability and verifiability. Examples show why clear steps and justified methodological choices are necessary.
- Limitations arise from data quality, sampling, contextual boundaries and possible researcher bias. Stating these openly is a mark of academic integrity.
- Ethical aspects include informed consent, data protection and safeguarding against harm or discrimination.
- Topic development starts with a problem statement. Criteria for a suitable topic are relevance, generalisability, availability of literature, data access and feasibility.
- A research gap defines unanswered questions in the existing literature. From this, a problem statement is derived which explains its importance for theory, practice or society.
- Research questions should be clear, answerable, delimited, relevant and open in terms of outcomes. Using wh-questions supports precise formulation.
- Hypotheses are precise, testable assumptions derived from theory and prior research. Types include difference, correlation and causal hypotheses.
- Methodological choices concern qualitative, quantitative and mixed-methods approaches. The decisive factor is the fit with the research question.
- Qualitative research aims at understanding and interpretation, quantitative research at measuring and testing. Mixed methods combine both logics.
- Sampling, data collection and analysis follow the chosen logic. Quality assurance requires validity, reliability, transparency and ethical reflection.
Topics & Content
- 1. Research Design as a Bridge between Question and Method
- Limitations and Constraints
- Ethical Considerations
- Checklist
- 2. From the Problem Statement to the Research Question
- 2.1 Topic Selection and Problem Definition
- 2.1.1 Sources for Topic Selection
- 2.1.2 Requirements for a Suitable Topic
- Distinction: Project Work vs. Academic Study
- 2.1.3 Identification of Research Gaps
- 2.1.4 Deriving a Problem Statement from the Research Gap
- 2.2 Research Question
- 2.2.1 Characteristics of a Good Research Question
- 2.2.2 Types of Research Questions
- 2.3 Developing Hypotheses
- 2.3.1 Criteria of Good Hypotheses
- 2.3.2 Types of Hypotheses
- 3. Research Logic and Fundamental Methodological Decisions
- 3.1 Choice of Research Approach: Qualitative, Quantitative, Mixed Methods
- 3.1.1 Qualitative Research - Understanding, Interpreting, Contextualising
- 3.1.2 Quantitative Research - Measuring, Testing, Generalising
- 3.1.3 Mixed Methods - Integrating, Complementing, Validating
- 3.1.4 Decision Criteria - Fit with the Research Question
- 3.1.5 Sampling, Data Collection, Analysis - Consequences of the Choice
- Sampling
- Data Collection
- Analysis
- 3.1.6 Common Misconceptions - Clarifications
- Qualitative Research - not unscientific
- Quantitative Research - not automatically objective
- Mixed Methods - more is not automatically better
- Sample Size - not an end in itself
- Allocation of Methods - not rigid
- 3.2 Pragmatic Decision Path - from Research Interest to Design
- Example
- 4 Research Methods
- 4.1 Secondary Data Analysis
- 4.1.1 Areas of Application
- 4.1.2 Strengths and Weaknesses
- 4.1.3 Common Misconceptions
- 4.2 Experiment
- 4.2.1 Areas of Application
- 4.2.2 Strengths and Weaknesses
- 4.2.3 Common Misconceptions
- 4.3 Simulation
- Procedure
- 4.3.1 Areas of Application
- 4.3.2 Strengths and Weaknesses
- 4.3.3 Common Misconceptions
- 4.4 Case Study
- Case Selection
- Anonymisation
- 4.4.1 Applications
- 4.4.2 Strengths and Weaknesses
- 4.4.4 Common Misconceptions
- 4.5 Systematic Review
- Implementation
- 4.5.1 Areas of Application
- 4.5.2 Strengths and Weaknesses
- 4.5.3 Common Misconceptions
- 4.5.4 PRISMA: Reporting standard for systematic reviews
- 4.6 Questionnaire Survey
- Types of Questions
- Scales
- Implementation
- 4.6.1 Areas of Application
- 4.6.2 Strengths and Weaknesses
- 4.6.3 Common Misconceptions
- 4.7 Interview
- Conduct
- 4.7.1 Use cases
- 4.7.2 Strengths and weaknesses
- 4.7.3 Common misconceptions / misunderstandings
- 4.8 Text Analysis
- 4.8.1 Areas of Application
- 4.8.2 Strengths and Weaknesses
- 4.8.3 Common Misconceptions
- 5 Qualitative analysis and coding methods
- Overview
- 5.1 Qualitative content analysis according to Mayring
- 5.1.2 Procedure
- 5.1.3 Practical notes
- 5.1.4 Distinction
- 5.1.5 Sources and further information
- 5.2 Qualitative content analysis according to Kuckartz
- 5.2.1 Core principle
- 5.2.2 Procedure
- 5.2.3 Practical notes
- 5.2.4 Distinction
- 5.2.5 Sources and further information
- 5.3 Grounded Theory according to Glaser/Strauss, Strauss/Corbin, Charmaz
- 5.3.1 Core principle
- 5.3.2 Procedure
- 5.3.3 Practical notes
- 5.3.4 Distinction
- 5.3.5 Sources and further information
- 5.4 Framework Method according to Ritchie & Spencer
- 5.4.1 Core principle
- 5.4.2 Procedure
- 5.4.3 Practical notes
- 5.4.4 Distinction
- 5.4.5 Sources and further information
- 5.5 Template Analysis according to King
- 5.5.1 Core principle
- 5.5.2 Procedure
- 5.5.3 Practical notes
- 5.5.4 Distinction
- 5.5.5 Sources and further information
- 5.6 Directed Content Analysis according to Hsieh & Shannon
- 5.6.1 Core principle
- 5.6.2 Procedure
- 5.6.3 Practical notes
- 5.6.4 Distinction
- 5.6.5 Sources and further information
- 5.7 Thematic Analysis according to Braun & Clarke
- 5.7.1 Core idea
- 5.7.2 Procedure
- 5.7.3 Practical notes
- 5.7.4 Distinction
- 5.7.5 Sources and further information
1. Research Design as a Bridge between Question and Method ^ top
A research design can be understood as the plan or blueprint of an academic study. It demonstrates how one moves from an initial idea or research question to verifiable results. While the research question defines what is to be examined, the research design sets out how the investigation is structured step by step.
The function of a research design is to ensure that the study is logical, transparent, and verifiable:
-
Logical Structure
A research design guarantees that the individual steps - from identifying the topic through data collection to analysis - build logically on one another. This prevents essential intermediate steps from being omitted or results from failing to correspond to the questions posed.Example: A researcher who wishes to examine building users’ satisfaction cannot begin directly with data analysis but must first formulate a precise research question, choose suitable methods, and determine how the responses will be analysed.
-
Transparency
Academic work requires that others can follow how results were achieved. A research design makes these decisions visible. It sets out why a particular method was chosen rather than another, and why the chosen approach fits the research question.Example: If a questionnaire is used, the researcher must be able to justify why this is more appropriate than an interview or a case study.
-
Verifiability
Academic results must not be mere opinions. They must, in principle, be open to verification by others. A research design specifies exactly how the study was conducted so that other researchers can follow the same steps and check whether they arrive at similar results.Example: A study on the energy efficiency of buildings is only verifiable if it is clearly described which data were collected, how they were processed, and with which statistical procedures they were analysed.
Limitations and Constraints ^ top
No research design is perfect. Every method involves limitations that must be considered and openly acknowledged.
-
Data Issues: There may be insufficient data, or the quality of the data may be restricted.
-
Sampling Issues: Surveys do not always reflect the entire population, as only certain groups may participate.
-
Context-Boundedness: A case study provides in-depth insights but cannot easily be generalised to all other cases.
-
Influence of Researchers: Especially in qualitative studies, personal assumptions or the way questions are formulated may influence the results.
Highlighting such limitations is not a weakness but a sign of academic integrity. It shows that researchers critically reflect on their approach and realistically assess the scope of their findings.
Ethical Considerations ^ top
All research is embedded within an ethical framework. This primarily includes the responsible treatment of participants and data:
-
Individuals may only be surveyed or observed if they have given their consent.
-
Personal data must be protected, anonymised, or pseudonymised.
-
Findings must not harm or discriminate against anyone.
Checklist ^ top
The checklist serves as a guide and summarises the key elements that should be considered in every research design. It helps to make the overall structure of the study visible, justify methodological decisions, and openly reflect on potential weaknesses or limitations.
The individual points of the list are to be understood as minimum requirements. Depending on the topic, scope, and research question, the level of detail may vary. What matters is that all dimensions are at least addressed and documented in the planning process.
2. From the Problem Statement to the Research Question ^ top
Every academic study begins with a topic that is gradually specified and refined during the planning process. The starting point is a problem statement, from which a research question is developed. This research question forms the core of the study and may be further specified through hypotheses.
2.1 Topic Selection and Problem Definition ^ top
Selecting a topic is the first crucial step in the research process. It determines the thematic framework within which the study is conducted and significantly influences motivation, feasibility, and academic quality.
Topic selection itself is a multi-stage process:
-
Choosing an area of interest (literature, practice, society, personal interest).
-
Checking whether the topic meets the requirements of academic work (relevance, generalisability, literature base, data access, feasibility).
-
Identifying a research gap that shows the academic value of investigating the topic.
-
Narrowing down to a problem statement that clearly defines the central challenge.
2.1.1 Sources for Topic Selection ^ top
Finding a suitable topic for an academic study is the first step in the research process. A topic does not emerge by chance but through conscious engagement with academic, practical, and societal contexts. Various sources provide starting points for developing a research question that is both academically relevant and suitable for completion within the scope of a bachelor’s or master’s thesis.
-
Academic Literature
-
Current articles in academic journals, monographs, or conference proceedings reveal the state of research.
-
Particularly valuable are indications in sections such as Outlook or Further Research, where open questions are explicitly highlighted.
Example: New approaches to evaluating sustainability certificates in the real estate sector, which are discussed in publications but have not yet been empirically tested.
-
-
Professional Practice
-
Research questions from companies, projects, or institutions can be examined scientifically.
-
Practical problems often provide not only interesting topics but also access to data.
Example: Optimising energy management in a hotel business, where it is investigated scientifically which measures actually contribute to reducing energy consumption.
-
-
Societal Developments
-
Political debates, new legislation, technological innovations, or social trends open up current research questions.
-
These areas are dynamic and can be approached from different perspectives (technical, economic, social).
Example: Opportunities and risks of hydrogen as an energy carrier in urban contexts.
-
-
Teaching and Coursework
-
Content from seminars, lectures, or projects may serve as a starting point.
-
Smaller assignments or presentations can be further developed and examined in greater depth.
Example: A project on building user satisfaction is expanded into a systematic investigation in a final thesis.
-
-
Personal Interests and Observations
-
Personal experiences or everyday observations may also provide a starting point, provided they can be translated into a form that allows for academic generalisation.
-
The crucial step is linking them to a theoretical or empirical framework.
Example: Observations on the use of smart home technologies among friends lead to a study on acceptance and patterns of use.
-
2.1.2 Requirements for a Suitable Topic ^ top
Not every interesting subject is automatically appropriate for an academic study. To meet the standards of a bachelor’s or master’s thesis, a topic must fulfil certain criteria. These criteria ensure that the subject is not only engaging but also academically manageable and methodologically sound.
-
Academic Relevance
-
A topic should contribute to the advancement of knowledge or address a practical issue in an academic way.
-
Mere description is not sufficient; the study must promise a clearly recognisable gain in knowledge.
Example: The use of hydrogen buses in Tyrol becomes more relevant when examining which factors promote or hinder their deployment, rather than simply stating the number of buses in operation.
-
-
Generalisability
-
Findings should have some degree of transferability beyond the specific case.
-
Even if a case study is the focus, it should be made clear which general insights can be derived from it.
Example: A study of a single hotel is only appropriate if the results can be transferred to similar businesses or placed within a broader context.
-
-
Literature Base
-
A topic must be able to build on existing academic literature.
-
Without sufficient sources, a solid theoretical framework is not possible.
Example: A thesis on a very recent trend is only suitable if there are already initial academic studies available or if neighbouring theories can be incorporated.
-
-
Availability of Data and Research Units
-
For empirical studies it is crucial that data can be collected or existing datasets used.
-
If interviews are planned, it must be clear that potential participants are accessible.
Example: A survey of facility managers is only meaningful if there are connections to companies or networks that allow for a sufficient sample size.
-
-
Feasibility within the Scope of the Study
-
Time and organisational constraints must be considered.
-
Bachelor’s theses usually have a smaller scope and fewer resources than master’s theses, so the topic must be narrowed accordingly.
Example: Instead of studying Sustainable Urban Development in Europe, a bachelor’s thesis would be better focused on Strategies for Green Roofs in Innsbruck.
-
Distinction: Project Work vs. Academic Study ^ top
An academic study differs fundamentally from project work. Project work often aims at the practical implementation or planning of concrete measures, such as the introduction of a new energy management system in a company. An academic study, by contrast, requires the systematic investigation of a research question.
Practical examples, case studies, or company projects can certainly serve as starting points, but they must always be generalisable, addressed with academic methods, and situated within the existing body of research.
Example: While project work may plan and technically implement the energy management system of a particular hotel, an academic study investigates the overarching question: Which factors influence the success of energy management systems in the hotel sector? In this way, the focus goes beyond a single case and contributes to broader academic understanding.
2.1.3 Identification of Research Gaps ^ top
A research gap refers to the part of a field of study for which no, insufficient, or contradictory academic evidence exists - or where established findings are not available for the relevant context, target group, method, or time frame. It justifies why a new study is necessary and highlights the expected contribution to the academic discourse. A well-documented research gap prevents the repetition of already resolved questions and directs the study towards generating genuine added value.
Important Distinctions:
-
Not mere "novelty for its own sake": A rarely studied topic is not automatically a research gap. What matters is the epistemological need (e.g. unclear cause-effect relationships, missing transferability, methodological blind spots).
-
Not a practical task: A practical implementation problem becomes a research gap only when formulated as a researchable academic question and situated within the body of existing research.
| Type | Description | Example |
|---|---|---|
| Contential Gap | A relevant aspect has so far not been examined at all or only marginally | Influence of acoustic comfort on user satisfaction in office buildings |
| Contextual Gap | Findings exist but cannot be transferred to the relevant region, sector, or population | Neighbourhood storage: many studies on metropolitan areas, few on alpine regions |
| Methodological Gap | A phenomenon has almost exclusively been studied with one method; alternative approaches are lacking | PV acceptance studied mainly through cross-sectional surveys; field experiments are missing |
| Temporal Gap | Older studies no longer reflect current practice or technology | Heat pumps: studies prior to 2020 without current funding schemes and grid integration |
| Theoretical Gap | Contradictions, unexplained mechanisms, or lack of model integration | ESG scores and market value: divergent effects, unclear causal pathways |
| Operationalisation/Data Gap | Key constructs are inadequately measurable or data are missing | Smart-readiness of existing buildings without validated indicators |
| Synthesis/Review Gap | Many individual studies but no systematic synthesis or review | User satisfaction: no up-to-date systematic review for the German-speaking context |
The process from an initial topic idea to the robust justification of a research gap follows a structured and documented approach. Each intermediate result (search strings, selection criteria, extraction tables) forms part of the later methodological transparency.
| Step | Aim | Procedure | Output |
|---|---|---|---|
| 1 Exploratory Orientation | Gain an overview, identify key concepts, theories, contexts, and typical methods | Review 5-10 overview sources, note key concepts and variables, record typical data types and designs, sketch initial topic map | Preliminary concept and topic list, one-page scoping note |
| 2 Developing a Search Strategy | Conduct a reproducible, broad-covering yet focused literature review | Collect synonyms and related concepts, use Boolean operators (AND, OR, NOT), adapt PICO or PEO, combine controlled and free search terms, develop example search string | Documented search strings in versions, list of accepted synonyms, defined inclusion and exclusion criteria |
| 3 Selecting Sources | Identify suitable and reliable publication outlets, use grey literature where appropriate | Bibliographic databases, repositories, preprints, quality-assured reports, conference papers | List of sources with purpose (database, theory, method, context) |
| 4 Conducting a Search Log | Ensure replicability and transparency | For each search, record date, database, search string, filters, number of hits; version and justify changes | Complete search log as table or appendix |
| 5 Screening with Criteria | Reliably select relevant studies and reduce bias | Title-abstract screening, full-text screening, backward and forward snowballing, note reasons for exclusion | Overview of found, screened, and included studies; screening log |
| 6 Mapping and Synthesis | Systematically record what is known and where gaps exist | Extract key information, visualise, synthesise consistencies and contradictions | Extraction table and short synthesis note |
| 7 Gap Formulation and Validation | Specify and contextualise the gap precisely, test plausibility | Formulate gap statement, justify relevance, test feasibility, validate through feedback and robustness check | Final gap statement with justification of how the study addresses the gap |
2.1.4 Deriving a Problem Statement from the Research Gap ^ top
The research gap identifies the area in which existing studies and findings provide no answers or only insufficient ones. However, this alone does not yet explain why precisely this gap is academically and practically relevant. To justify its examination in a bachelor’s or master’s thesis, the research gap must be translated into a problem statement.
The problem statement specifies why the identified lack of knowledge constitutes a challenge. It links the academic starting point with its relevance for theory, practice, or society. While the research gap answers the question "What is missing in the literature?", the problem statement formulates the follow-up question "Why is this absence problematic - and why is it worth investigating?"
Key steps in formulating a problem statement:
-
Positioning within the state of research:
The problem statement must clearly demonstrate how it arises from the identified gap.Example: "Numerous studies examine thermal and lighting comfort in office buildings. However, the influence of acoustic factors remains largely neglected."
-
Justifying relevance:
It is not enough to state that something has not yet been studied. It must be explained what consequences result from neglecting this aspect.Example: "Since noise is perceived as a major problem in many open-plan offices, the lack of research on acoustic comfort leads to an incomplete understanding of user satisfaction."
-
Establishing concreteness:
The problem statement must be formulated so that it can be directly translated into a research question. This requires narrowing it to specific contexts (e.g. region, time, population).Example: "It remains unclear in particular what role acoustic conditions play in Austrian office buildings and how they influence user satisfaction."
Characteristics of a good problem statement:
- derives clearly and transparently from a documented research gap.
- demonstrates the practical and/or theoretical relevance of the problem.
-
is formulated so that a concrete research question can be developed from it. Level Guiding Question Example Research Gap What is missing in the existing literature or inadequately studied The influence of acoustic comfort in office buildings has so far hardly been studied Problem Statement Why is this absence relevant - theoretically or practically As noise is a common problem in open-plan offices, neglecting acoustic factors leads to an incomplete understanding of user satisfaction Research Question How should this problem be investigated concretely What role do acoustic conditions play in the satisfaction of users in Austrian office buildings
2.2 Research Question ^ top
The research question forms the core of an academic study. It translates a previously formulated problem statement into a precise, researchable question and thereby guides all subsequent decisions of the research design, from the choice of methods to the analysis. A clearly formulated research question delineates the object of investigation, makes expectations for data and analysis transparent, and allows the progress of knowledge achieved in the study to be assessed in a comprehensible way.
2.2.1 Characteristics of a Good Research Question ^ top
A research question translates the problem statement into a precise academic inquiry. Good research questions are characterised by the following features:
-
Clarity and Precision
Formulations are unambiguous, central terms are understandable and, where necessary, defined. Ambiguous or metaphorical expressions are avoided.imprecise: "How does digitalisation have an impact?"
refined: "How does the introduction of a digital building management system influence the electrical energy consumption of office buildings in Austria?"
-
Answerability
The question can realistically be addressed with the available methods, data, and resources. This includes a broad idea of which types of data are required and how they can be collected or obtained. -
Defining Boundaries
Space, time, population, and object of investigation are specified. Such boundaries increase academic feasibility and transparency.Example: "in Tyrol", "between 2018 and 2024", "users of co-working spaces", "existing office buildings"
-
Relevance
The question promises academic or practical value, e.g. by clarifying contradictory findings, testing a theoretical mechanism, or deriving well-founded recommendations for practice. -
Openness of Results
The question does not pre-empt answers or evaluations. It is open to different, including unexpected, findings.
Formulating Research Questions
When formulating a research question, it is helpful to ensure that the essential dimensions of the study are explicitly stated: what is being studied, who or what is affected, where the study takes place, when it is relevant, how a process unfolds, and why certain relationships exist. Not every research question must address all of these aspects, but reflecting on them supports precision, clarity, and academic rigour. Descriptive questions often focus on what and where, while explanatory questions are more strongly guided by how and why. This provides a practical framework for developing well-structured and meaningful research questions.
| Guiding Aspect | Function in the Research Question | Example |
|---|---|---|
| What | Defines the subject or phenomenon under investigation | What are the most important factors influencing user satisfaction in office buildings? |
| Who | Specifies the group or population involved | Who uses co-working spaces in Tyrol, and what expectations do these users have? |
| Where | Establishes the spatial context | Where do differences in the acceptance of photovoltaic systems emerge between urban and rural regions? |
| When | Determines the temporal framework of the study | When do seasonal variations in the energy consumption of student halls of residence occur? |
| How | Focuses on processes, mechanisms, or relationships | How does the introduction of an energy management system affect electricity consumption in commercial properties? |
| Why | Targets causes, background factors, or explanations | Why do municipalities decide in favour of or against the use of hydrogen buses? |
Example
Unsuitable: "Why is renewable energy the best solution for all problems?" - this already contains a claim and is too general.
Refined: "Which factors influence the decision of Austrian municipalities to adopt photovoltaic systems?" - precise, researchable, and open to different possible outcomes.
2.2.2 Types of Research Questions ^ top
Research questions can be distinguished according to their intended contribution to knowledge. Such a typology helps to plan methodological fit and clarify the expected form of evidence.
| Type | Characteristic | Example |
|---|---|---|
| Descriptive | Describing a phenomenon or situation | "What is the share of timber construction in new buildings in Tyrol in 2023?" |
| Explanatory | Analysing causes and relationships | "Why do companies decide in favour of certain certification systems in facility management?" |
| Prognostic | Forecasting future developments | "How is the acceptance of hydrogen mobility likely to develop over the next ten years?" |
| Design-Oriented | Developing measures or action options | "Which strategies are suitable for implementing circular economy concepts in housing construction?" |
| Evaluative | Assessing processes or programmes | "How effective are government subsidy programmes for introducing heat pumps in existing buildings?" |
2.3 Developing Hypotheses ^ top
The research question is usually formulated openly and aims to investigate a phenomenon systematically. It marks the starting point of the research process and sets the direction for design, data collection, and analysis.
The hypothesis is a precise and testable assumption derived from theory and the state of research, formulating an expected relationship or difference. Hypotheses are primarily used in quantitatively oriented designs but may also play a role in mixed-methods studies.
-
Research Question: "Does room temperature influence job satisfaction in offices?"
-
Hypothesis: "The higher the perceived room temperature, the lower the reported job satisfaction."
The hypothesis differs from the research question in its directed statement and the possibility of being confirmed or falsified through data. It makes explicit which effect is expected and how it is likely to manifest.
2.3.1 Criteria of Good Hypotheses ^ top
Hypotheses summarise theoretical expectations. For them to be academically fruitful, they should meet the following criteria:
-
Testability
A hypothesis must be testable with empirical data, e.g. through statistical models, experiments, or clearly defined comparison groups. Non-testable, purely normative statements are unsuitable as hypotheses. -
Clarity
The formulation is unambiguous and avoids vague terms. Variables and relationships are explicitly named, and directions of measurement are specified where appropriate. -
Justification
The hypothesis is grounded in theory and the state of research. It follows logically from existing models, findings, or plausible mechanisms. -
Falsifiability
It must be possible to refute the hypothesis with data. Statements that remain "true" regardless of the outcome are not scientifically testable. -
Simplicity
Complexity is reduced to what is necessary. A simple, clearly testable hypothesis is preferable to an overloaded multiple claim, provided the theory allows for this.
Example
Unsuitable: "Some people think renewable energy is good" - not testable and too vague.
Refined: "Households with higher educational levels show greater acceptance of renewable energy" - clear, testable, and theoretically justifiable.
2.3.2 Types of Hypotheses ^ top
Hypotheses can differ in content and can be classified according to their logical structure and the type of expected relationship between variables. A conscious decision for a particular type increases transparency, strengthens methodological alignment, and ensures that the results of the study are clearly interpretable.
A systematic classification helps to formulate hypotheses precisely and to select appropriate methods of testing. The following types of hypotheses are particularly relevant in academic work - especially in technical and socio-economic fields of study.
-
Difference Hypotheses
Difference hypotheses express the expectation that two or more groups or conditions differ from each other. They address the question:
Is there a difference between Group A and Group B?Example: "Job satisfaction is higher in buildings with daylight access than in buildings without daylight."
Such hypotheses usually involve comparing two or more means and are often tested using statistical methods such as the t-test or analysis of variance.
-
Relationship Hypotheses (Correlational Hypotheses)
Relationship hypotheses assume that two or more variables are related. The direction of the relationship may remain open or be specified.Example: "The higher the thermal comfort, the higher the reported user satisfaction."
These hypotheses are often tested using correlation or regression analyses and are typical of exploratory research questions.
-
Causal Hypotheses
Causal hypotheses go a step further: they claim not only a relationship but also a cause-effect connection. This makes them particularly demanding, as causality can only be demonstrated under strict methodological conditions, such as through experiments or controlled quasi-experimental designs.Example: "The introduction of an energy management system leads to a significant reduction in electricity consumption."
The main challenge lies in ruling out alternative explanations (confounding or third variables).
-
Directional Hypotheses
Directional hypotheses not only predict a difference or relationship but also specify in which direction it goes.Example: "Acceptance of photovoltaic systems is higher among younger respondents than among older ones."
They are more precise than non-directional hypotheses and require a solid theoretical or empirical rationale for the assumed direction.
-
Non-Directional Hypotheses (Two-Sided Hypotheses)
Non-directional hypotheses merely state that a difference or relationship exists, without predicting its direction.Example: "There is a difference in the acceptance of photovoltaic systems between younger and older respondents."
They are broader in scope and are often used when the theoretical or empirical basis for a directional hypothesis is lacking.
-
Null Hypothesis (H₀) and Alternative Hypothesis (H₁)
In empirical research, especially in statistics, a distinction is made between the null hypothesis and the alternative hypothesis:- Null Hypothesis (H₀): There is no difference or relationship.
- Alternative Hypothesis (H₁): There is a difference or relationship.
The null hypothesis is tested statistically. If it is rejected, the alternative hypothesis is assumed.
Example:
H₀: "There is no difference in the acceptance of photovoltaic systems between urban and rural areas."
H₁: "Acceptance of photovoltaic systems is higher in urban areas than in rural areas."
3. Research Logic and Fundamental Methodological Decisions ^ top
The research design forms the foundation of every academic study and determines how a research process is structured and conducted. It involves not only the practical planning of individual steps but also fundamental considerations that shape the entire process of generating knowledge. Every academic project operates within a field of tension between theoretical orientation, methodological implementation, and practical feasibility.
Research logic describes the pathway through which knowledge is generated and addresses the question of how new insights can be developed on the basis of existing knowledge. Fundamental methodological decisions provide the framework within which data are collected and analysed. Both - logic and methodological orientation - are inseparably connected. Without a clear idea of the epistemological approach guiding the research, every methodological decision remains fragmented.
For researchers, this means that they must engage with the underlying logics of academic reasoning at the very beginning of their work. These logics are not merely abstract theories but determine whether results are verifiable, transparent, and transferable. Equally important are the fundamental methodological decisions that define which types of data are collected, how they are processed, and what conclusions can be drawn from them.
3.1 Choice of Research Approach: Qualitative, Quantitative, Mixed Methods ^ top
The choice of research approach determines the types of data, modes of analysis, explanatory power, and limitations of the results. The decisive factor is the fit with the research question, the theoretical framework, available resources (time, budget, access to fields/participants, data quality), and ethical requirements. Approaches are not strictly separate "camps"; rather, they form a continuum that can be meaningfully combined depending on the research question.
3.1.1 Qualitative Research - Understanding, Interpreting, Contextualising ^ top
Qualitative research focuses on meanings, patterns of interpretation, processes, and contexts. It primarily addresses "how?" and "why?" questions when phenomena are under-researched or when a deep understanding of participants’ perspectives is required. Sources of data include interviews (semi-structured, narrative, focused), focus groups, observations (participant/non-participant), field notes, documents, artefacts, or audio-visual materials. Sampling typically follows purposive strategies (e.g. theoretical sampling, maximum variation, contrasting cases) in order to capture relevant cases.
Analytical techniques include thematic or content-structuring analysis, Grounded Theory coding, discourse/frame analysis, interpretative phenomenological analysis, qualitative content analysis, or ethnographic thick description. Quality assurance aims at credibility and transparency (e.g. transparent coding decisions, audit trail, triangulation of data/participants/methods, member checking, researcher reflexivity). Generalisability is not statistical but argued as "transferability", for example through thick contextual description.
3.1.2 Quantitative Research - Measuring, Testing, Generalising ^ top
Quantitative research tests hypotheses, estimates parameters, and examines relationships or differences based on numerical data. It primarily addresses "how often?", "to what extent?", or "is there an effect?". Data collection includes standardised surveys, tests, measurement series, administrative/secondary data, or sensor-based measurements. Sampling is probabilistic (e.g. simple/stratified/cluster/multi-stage random sampling) to allow inference to the population.
Sample size planning (power analysis) and measurement quality (objectivity, reliability, validity) are central. Analyses include descriptive statistics, regression and variance models, scale analysis, causal models (e.g. difference-in-differences, instrumental variables, matching), as well as time-series and panel methods. Quality assurance relies on measurement accuracy, internal/external validity, replication, and sensitivity analyses. Generalisation is achieved through statistical estimation with confidence intervals and error control.
3.1.3 Mixed Methods - Integrating, Complementing, Validating ^ top
Mixed-methods research combines qualitative and quantitative logics within a coherent design in order to pool strengths and reduce blind spots. Integration can take place at different levels: in the design (sequence/parallelism), in the methods (e.g. an embedded qualitative sub-study within a survey), and in interpretation (joint conclusions).
Common designs:
-
Explanatory Sequential
Quantitative results first (e.g. survey, effect), followed by qualitative exploration to explain patterns. -
Exploratory Sequential
Qualitative exploration first for concept formation or instrument development, followed by quantitative testing and generalisation. -
Convergent Parallel
Parallel data collection, separate analyses, subsequent integration ("triangulation") with a focus on convergence or complementarity.
3.1.4 Decision Criteria - Fit with the Research Question ^ top
The choice of research approach must be closely tied to the research question. A clear match between the intended contribution to knowledge and the methodological implementation is essential for results to be meaningful and interpretable. It is therefore crucial to analyse the type of research question carefully and derive the most appropriate approach.
Exploratory questions, which ask how a phenomenon is experienced or why certain processes occur, are particularly suited to qualitative research designs. Here, the focus is on understanding meanings, perspectives, and contexts. Qualitative approaches make it possible to develop new concepts, capture complex interrelations, and highlight previously overlooked aspects. In mixed-methods designs, they can be used at the beginning of an investigation to generate hypotheses or prepare measurement instruments.
Testing questions, which ask whether a relationship exists, how strong an effect is, or whether groups differ significantly, require quantitative approaches. These allow hypotheses to be tested with the help of standardised measurements and statistical procedures. Quantitative designs are especially appropriate when results are to be generalised or when precise estimates for the population are needed. In mixed-methods research, they can be combined with qualitative findings to enrich numerical results with context and interpretation.
Questions focusing on the development or validation of instruments and concepts often benefit from a sequential mixed-methods approach. First, qualitative data are used to capture constructs precisely and identify suitable indicators. These indicators can then be quantitatively tested, scaled, and verified. This creates a close link between theoretical conceptualisation and empirical measurement.
In addition to the substantive orientation of the research question, further criteria come into play. These include access to data and participants - for instance, whether the entire population is reachable compared to selecting a few highly informative cases - the availability of resources such as time, budget, and technical infrastructure, and ethical feasibility, especially in sensitive contexts or with vulnerable groups. Finally, it must be considered in which form conclusions are to be drawn: should the aim be statistical generalisation to a population, or context-bound transferability based on transparent case analysis?
There is no universally "best" method. What matters is the fit with the research question, the theoretical framework, and the practical conditions of the study. Only through this deliberate alignment does the research approach become robust, transparent, and transferable.
3.1.5 Sampling, Data Collection, Analysis - Consequences of the Choice ^ top
The choice of research approach has direct methodological consequences. Each orientation - qualitative, quantitative, or mixed methods - requires specific decisions regarding sampling, data collection, and analysis. These elements must be aligned consistently in order to create a coherent research design that delivers robust results and remains comparable within the academic discourse.
Sampling ^ top
In qualitative research, smaller, purposefully selected samples are often used. The focus is less on statistical representativeness than on the informational richness of cases. Selection follows theoretical considerations, defined criteria, or the principle of maximum variation. The aim is to capture as broad a range of perspectives and experiences as possible until theoretical saturation is reached.
By contrast, quantitative approaches generally require larger samples drawn randomly from the population. This ensures that results can be generalised and statistically supported statements about the population can be made. Methods such as simple random sampling, stratified sampling, cluster sampling, or multi-stage sampling secure methodological rigour.
Mixed-methods designs combine these logics. For example, a targeted qualitative sample may first be used to develop concepts, followed by a large random sample to test them quantitatively. Conversely, a representative survey can be complemented by qualitative in-depth interviews to enrich numerical results with narratives and context.
Data Collection ^ top
Qualitative data collection is usually open or semi-structured. Interviews, observations, or focus groups give participants space to express their perspectives and allow flexibility in the collection process. The aim is to capture meanings, processes, and subjective experiences as authentically as possible.
Quantitative data collection relies on standardisation. Questionnaires, tests, or measurement instruments are applied according to fixed rules to ensure comparability and measurement quality. Standardisation reduces the scope for interpretation but enables statistical analyses and hypothesis testing.
Mixed methods requires careful planning of interfaces: Should a qualitative interview deepen the results of a survey? Or do qualitative categories provide the basis for scales in a subsequent questionnaire? The decision about sequence and integration must be explicitly justified.
Analysis ^ top
Qualitative analyses are usually iterative: data are interpreted step by step, concepts are developed, tested, and refined. Methods such as coding, content analysis, or discourse analysis emphasise reflexivity and theoretical sensitivity.
Quantitative analyses follow a pre-defined analysis plan. Statistical techniques such as regression, analysis of variance, or hypothesis testing are applied to quantify effects and relationships precisely. Adherence to quality criteria such as reliability, validity, and objectivity, as well as conducting robustness checks, is crucial.
Mixed-methods analyses focus on the integration of both strands. Results must not only be interpreted separately but also systematically brought together. This requires clear points of integration in the project timeline, for example by comparing, complementing, or linking findings.
An important tool here is the use of joint displays - visual presentations of qualitative and quantitative results in a shared table or figure. For example, survey scale values can be placed alongside illustrative interview quotations. In this way, relationships, agreements, or contradictions become immediately visible. Joint displays are particularly helpful when complex results need to be condensed while remaining accessible.
In addition, comparative interpretations are central. This concerns not presentation but the analytical process itself. Qualitative and quantitative results are systematically related to one another: researchers examine whether qualitative findings explain or challenge quantitative results - and whether statistical relationships can be illustrated through individual cases.
Example: If a survey indicates that students are mainly dissatisfied with acoustics, interviews may provide detailed descriptions of noise disturbances that contextualise the figures. Conversely, if the survey shows high satisfaction while interviews repeatedly highlight problems, comparative interpretation opens new hypotheses - for example, about different student groups or contexts of use.
Example Joint Display:
Aspect Quantitative Findings (Scale Values) Qualitative Findings (Interview Quotations) Noise / Acoustics 68% of students rated the acoustics ≤3 on a scale from 1 to 10 "In the group work rooms it is often so loud that it is hard to concentrate." Indoor Climate Average value 5.2 out of 10, 25% dissatisfied "In winter it is draughty and in summer much too hot - I often change rooms because of this." Furniture 72% rated seating comfort as adequate "The chairs are comfortable, but for long study sessions I miss an ergonomic solution." Technical Equipment 80% satisfied with Wi-Fi and power outlets "It’s great that there are sockets everywhere, but sometimes the Wi-Fi drops out when too many are online." Example Comparative Interpretation:
The quantitative survey showed that 72% of students were generally satisfied with the furniture. On average, the score was 6.8 on a 1-10 scale. This result suggests that the majority perceived the seating as sufficient.
In the qualitative interviews, however, students repeatedly expressed criticism, especially in relation to longer study periods. A typical quotation was: "After two hours I get back pain - the chairs are not made for long sitting."
A comparative interpretation of these findings shows: Although the overall rating is positive, there is a discrepancy between surface-level satisfaction and underlying problems. The quantitative survey provides an overall average that appears rather positive, while the qualitative statements reveal specific weaknesses that remain hidden in the numerical score.
From this, the hypothesis can be derived that while the furniture is adequate for shorter use, it shows clear deficits in longer-term study sessions. For the university, this means that measures should not primarily address the general level of equipment but instead focus on ergonomic improvements for extended study periods.
3.1.6 Common Misconceptions - Clarifications ^ top
In practice, numerous misunderstandings circulate about the different research approaches. Such misconceptions can lead to inaccurate assessments or insufficiently justified methodological choices. A reflective approach to these misconceptions is therefore central to the quality of academic work.
Qualitative Research - not unscientific ^ top
A common assumption is that qualitative research is less rigorous or less scientific because it does not rely on numbers. In reality, qualitative approaches are based on clear theoretical foundations, methodologically regulated procedures, and transparent interpretative steps. Their academic rigour lies not in standardisation but in the systematic analysis of meanings, processes, and contexts.
Quantitative Research - not automatically objective ^ top
It is also often assumed that quantitative research is per se objective because it works with numbers. Yet every measurement and every statistical model is based on assumptions: about the construction of variables, the choice of scales, the validity of the instruments used, and the mode of data collection. Quantitative results also require critical reflection and must be assessed in terms of their quality.
Mixed Methods - more is not automatically better ^ top
The combination of qualitative and quantitative methods is frequently seen as the "gold standard." However, mixed methods are only meaningful when integration actually provides additional insights. A mere sequence of methods without a common research question or without systematic integration does not lead to better results and may instead create confusion and additional workload.
Sample Size - not an end in itself ^ top
Sample size is not an isolated quality criterion. It must always be assessed in relation to the research question, the definition of the population, the chosen method, and the type of sampling procedure. Only then can results be meaningfully interpreted and generalised.
Larger samples do not automatically improve qualitative research. Here, the decisive criterion is theoretical saturation: cases are studied until no new relevant insights emerge. The goal is information density and in-depth analysis, not statistical representativeness.
In quantitative research, however, small samples are problematic because they do not allow reliable inferences about the population. Statistical tests require sufficient sample size to ensure stable estimates and meaningful confidence intervals and error margins.
Defining the population is of central importance. Only when the sample reflects the relevant characteristics of the target population - such as age, gender, educational background, or other dimensions relevant to the research question - can the results be generalised. A large sample is useless if it does not match the target group.
Example: If kindergarten children are surveyed about purchasing decisions, the sample may be large, but it does not represent the population of purchasing decision-makers.
Moreover, sample size calculators and formulas assume random selection. Only when participants are drawn using a randomised procedure can confidence intervals and error margins be calculated correctly. By contrast, if questionnaires are sent to an entire address list, this constitutes a formal census of the list, but the actual sample results from the responses received. These are based on self-selection, meaning that conventional sample size calculations cannot be applied directly.
Allocation of Methods - not rigid ^ top
Another misconception is that certain data collection methods are automatically tied to one approach. Questionnaires are often considered "typically quantitative" because they may contain standardised scales. However, they can also be designed openly to capture narrative responses or assessments - thus falling into the qualitative domain. Similarly, interviews are often seen as classically qualitative. In fact, there are highly structured interview formats with closed questions and fixed response options that can be analysed quantitatively. What matters is not the method itself but how it is designed and for what purpose it is employed.
3.2 Pragmatic Decision Path - from Research Interest to Design ^ top
The development of a research design is not a linear automatism but a deliberate decision-making process. Researchers must weigh different options against one another, justify their choices transparently, and keep the research process flexible. A pragmatic approach consists of translating the research interest step by step into a viable design.
-
Refine the Research Question
At the beginning stands the clear formulation of the research question. It determines whether an explanatory, a measuring, or a developing approach is appropriate. Questions about how and why tend to suggest qualitative or exploratory designs, while if and how strong point towards quantitative testing. -
Clarify the Theoretical Positioning
Every study requires a theoretical framework. This serves to define relevant concepts and make mechanisms visible. Theory forms the basis for hypotheses, categories, or indicators, without which neither qualitative nor quantitative research can be conducted in a robust manner. -
Examine Data Availability
A realistic view of available data sources is crucial. Some questions can only be answered if there is access to suitable participants, documents, or measurement instruments. The quality of the data - such as completeness, validity, or accessibility - must also be examined before the design is finalised. -
Assess Ethical and Resource-Related Feasibility
Alongside substantive criteria, practical and ethical issues play a central role. Time constraints, financial resources, and participant burden set boundaries. Data protection, informed consent, and the avoidance of harm must likewise be ensured. -
Choose and Justify the Approach
On the basis of the above considerations, the research approach is selected: qualitative, quantitative, or mixed methods. It is important to justify this choice - not out of habit or personal preference, but in close alignment with the research question and the logic of the intended conclusions. -
Derive Sampling, Data Collection, and Analysis Path
Once the approach has been chosen, concrete decisions regarding sample selection, the design of data collection, and the form of analysis can be made. These elements must be coherently aligned to build a consistent research strategy. -
Plan Quality and Integration Strategy
Already at the design stage, it should be considered how quality and robustness of findings can be ensured. In qualitative research this includes reflexivity, triangulation, and transparency of analytic steps. In quantitative research, reliability, validity, and objectivity are central. In mixed-methods designs, the additional question arises of how integration will be safeguarded, for example through joint displays or comparative interpretations. -
Pilot, Reflect, Adapt
No research design is perfect from the outset. Pilot studies, pre-tests, or initial analyses help to identify weaknesses and make adjustments. Reflection and iterative refinement are an integral part of academic practice and contribute decisively to the quality of the final outcome.
Example ^ top
This example illustrates how the pragmatic decision path can be applied step by step. From the initial research question through theoretical framing, data access, and feasibility to methodological design and quality assurance, a coherent research design emerges that delivers robust and practice-relevant results.
1. Refine the Research Question
The starting point is the question: How do students experience learning spaces, and why are certain areas avoided? Additionally of interest: How widespread are these problems, and which factors are statistically associated with satisfaction?2. Clarify the Theoretical Positioning
The analysis draws on theories of learning environment research, concepts of "third places," and models of user satisfaction. These serve to frame relevant dimensions such as spatial design, atmosphere, noise exposure, and social interactions.3. Examine Data Availability
The university has access to various learning spaces and to students from different degree programmes. Qualitative data can be collected through observations and interviews; quantitative data can be gathered via a standardised online survey.4. Assess Ethical and Resource-Related Feasibility
Consent is obtained for interviews and observations, and data protection policies are observed. The effort for transcriptions, questionnaire development, and statistical analysis is factored into the project plan.5. Choose and Justify the Approach
A mixed-methods design is chosen: first, exploratory qualitative data collection for concept development; then a quantitative survey for testing and generalisation; finally, integration of both strands. Justification: Only in this way can lived experience and prevalence be brought together.6. Derive Sampling, Data Collection, and Analysis Path
Qualitative sampling: purposive selection of students from different disciplines and usage profiles. Quantitative sampling: a larger random sample via an online survey. Instruments: semi-structured interviews, observation protocols, and a standardised questionnaire with scales. Analysis: qualitative content analysis combined with statistical procedures (e.g. factor analysis, regression models).7. Plan Quality and Integration Strategy
Qualitative quality assurance: triangulation of observations and interviews, transparency in the coding process. Quantitative quality assurance: pre-test of the questionnaire, checks of reliability and validity. Integration: joint displays that place qualitative categories and quantitative findings side by side.8. Pilot, Reflect, Adapt
Before the main project, a small pilot is conducted: one interview and a short questionnaire run. This tests question comprehensibility, technical feasibility, and time requirements. The results feed into the revision of the design.
4 Research Methods ^ top
Research methods are the concrete procedures through which research questions are addressed and hypotheses are tested. While research design and research logic provide the overarching framework, methods describe the practical instruments of data collection and analysis. They are the tools that enable researchers to translate theoretical concepts into verifiable empirical findings.
A sound understanding of different methods is essential in order to choose the most suitable approach for a given research question. No method is inherently "better" or "worse" - its appropriateness always depends on the research question, the subject of investigation, the available resources, and the intended knowledge outcomes. Qualitative and quantitative methods, as well as mixed forms, complement each other and open different perspectives on reality.
4.1 Secondary Data Analysis ^ top
Secondary data analysis refers to the systematic use and examination of data that have already been collected and are now applied to a new research question. In contrast to primary research, where researchers generate their own data, secondary analysis works with existing datasets. These may originate from a wide range of sources: official statistics from public authorities, standardised surveys by large research institutes, company databases, historical registers, digital research archives, or freely available open data portals.
The central characteristic of secondary data analysis is that the data were not originally collected for the current research question. Researchers therefore use them in a new context, critically examine their quality, completeness, and suitability, and interpret them in light of their own question. Secondary data analysis is thus an independent method that can enable both descriptive and analytical evaluations.
4.1.1 Areas of Application ^ top
Secondary data analyses are an important instrument in many fields of research, as they allow existing data sources to be reused for new questions. They are particularly suitable when primary data collection would be too costly, too time-consuming, or methodologically difficult to realise.
-
Studying large-scale relationships:
Secondary data make it possible to analyse broad structures, for example by using official statistics, company databases, or international comparative studies. In this way, trends, patterns, and differences can be captured that would not be visible through small-scale primary studies. -
Analysing historical developments:
Many data series are collected regularly and over long periods of time, enabling the reconstruction of developments over time. This makes it possible to empirically trace growth processes, shifts in demand, or technological transformations. -
Comparisons across regions or institutions:
Existing datasets allow systematic comparison of locations, organisations, or countries. This supports the identification of best practices as well as differences in structures, processes, or outcomes. -
Exploratory research questions:
Secondary data are well suited for hypothesis generation when the aim is to identify initial assumptions or patterns that can later be tested with primary data. They thus contribute to the development and refinement of research questions. -
Re-use of research resources:
Data from completed projects or publicly available archives can be re-analysed, providing additional insights without the need for new data collection.
4.1.2 Strengths and Weaknesses ^ top
Strengths
- Cost efficiency: no costs for new data collection, as the data already exist.
- Time saving: immediate access to large datasets.
- Coverage: access to extensive, often representative datasets that could not be collected independently.
- Comparability: enables longitudinal analyses and international comparisons.
Weaknesses
- Limited fit: data were not collected specifically for the current research question but for other purposes.
- Restricted control: researchers have no influence over instruments, sampling, or data collection processes.
- Data quality: possible errors, omissions, or biases cannot be corrected retrospectively.
- Accessibility and data protection: not all relevant data are freely available or may be used without restrictions.
4.1.3 Common Misconceptions ^ top
A widespread misconception is that secondary data are "objective" because they originate from official agencies or large institutions. In reality, such data are also shaped by their collection method, definitions, and categorisations.
It is also often assumed that secondary data analysis is straightforward because the data already exist. In fact, it requires a thorough examination of the data basis, a critical engagement with the logic of collection and measurement instruments, and methodological adaptation to the specific research question.
Another misconception is that secondary data are always free and easily accessible. In practice, many datasets are subject to charges or restricted by data protection regulations.
4.2 Experiment ^ top
An experiment is a scientific research method designed to demonstrate causal relationships between variables. At its core lies the deliberate manipulation of one or more independent variables (e.g. learning method, drug dosage, pricing strategy), while the effect of this manipulation on a dependent variable (e.g. learning outcome, recovery rate, purchasing decision) is measured.
The key feature of an experiment is the controlled arrangement of conditions. Researchers create an artificial but controlled environment in which relevant factors can be systematically managed and confounding variables minimised or eliminated. Only in this way can observed changes in the dependent variable be attributed with high probability to the influence of the manipulated independent variable.
Central to the logic of experiments is the principle of comparison groups. Typically, an experimental group is exposed to the manipulation, while a control group is not. By comparing the results of both groups, it becomes possible to identify whether the manipulation produced an effect. Random assignment can also be applied to prevent systematic biases in group composition.
Experiments are considered in many disciplines to be the "gold standard" for testing hypotheses because they go beyond other methods: they show not only that two phenomena are related but also whether one causes the other. They are therefore particularly suitable when the research question concerns cause-effect relationships - an aim that observational or survey methods can only partially achieve.
At the same time, it is important to stress that experiments are not confined to the traditional laboratory setting. They can be conducted in real-world environments (field experiments), embedded in natural processes (quasi-experiments), or take place in digital contexts (e.g. A/B testing in online marketing). What unites all variants is the deliberate manipulation of conditions and the systematic observation of their effects.
| Variant | Characteristics | Strengths | Weaknesses |
|---|---|---|---|
| Laboratory Experiment | Controlled, artificial environment | High internal validity, precise measurement | Low external validity, unnatural setting |
| Field Experiment | Natural environment, real-world situation | High practical relevance, realistic conditions | Limited control of confounders, logistical effort |
| Online Experiment | Digital environment, A/B tests, randomised | Large sample sizes, low cost, rapid data collection | Restricted to digital contexts, dependent on technical infrastructure |
An experiment is therefore a systematic manipulation under controlled conditions, aimed at empirically testing hypotheses about cause-effect relationships.
4.2.1 Areas of Application ^ top
Experiments are most appropriate when the aim is to test whether a particular factor genuinely produces a cause-effect relationship with an outcome. They are not only useful for describing associations but particularly for testing hypotheses and strengthening causal explanations.
-
Testing causal relationships:
Experiments enable researchers to deliberately manipulate single factors and measure their effects. For instance, changes in processes, technologies, or organisational frameworks can be analysed in terms of outcomes and behaviours. -
Evaluating interventions:
New programmes, strategies, or technical solutions can be tested for effectiveness in experimental designs. This allows researchers to assess whether intended improvements occur and whether unexpected side-effects arise. -
Comparing alternative options:
By investigating several conditions in parallel, different variants can be compared. This supports evidence-based decision-making, for example when selecting more efficient procedures or evaluating alternatives in social, economic, or technical contexts. -
Generating practice-oriented evidence:
Field and online experiments in particular produce insights that are directly transferable to real-world contexts. They enable decisions to be based on empirical evidence rather than solely on theoretical assumptions or models. -
Advancing theory:
By rigorously testing hypotheses, experiments not only answer practical questions but also contribute to the validation, refinement, or extension of scientific theories.
4.2.2 Strengths and Weaknesses ^ top
Strengths
- High internal validity: deliberate control allows causal conclusions.
- Replicability: experiments can be repeated and verified.
- Flexibility: experiments can be conducted in the laboratory, in the field, or online.
Weaknesses
- Limited external validity: laboratory findings may not generalise to real-life situations.
- Ethical restrictions: some questions cannot be investigated experimentally.
- Resource intensity: experiments can be time- and labour-intensive.
- Reactivity: participants may alter their behaviour when they know they are part of an experiment (Hawthorne effect).
4.2.3 Common Misconceptions ^ top
A frequent misconception is that experiments must always take place in a laboratory. In fact, they exist in different forms: laboratory, field, and online experiments.
It is also mistaken to assume that experiments are automatically "objective." Sampling, operationalisation, and interpretation all influence results.
Finally, it is often overlooked that experiments are not always the "best" method. They are highly suitable for testing causal hypotheses, but not necessarily the right choice for exploratory or descriptive questions.
4.3 Simulation ^ top
Simulation and modelling are research approaches in which real systems or processes are reproduced in a simplified, abstracted form in order to study their behaviour under specific conditions. The main aim is to make complex interrelations comprehensible, measurable, and predictable.
-
Modelling
Development of a model, i.e. a structured representation of reality. Models can be conceptual (e.g. flowcharts, theories), mathematical (e.g. equations, algorithms), or computer-based (e.g. software models). The key point is that they represent selected aspects of a system while deliberately excluding others. Every model is therefore a simplified, selective representation - never a complete reflection of reality. -
Simulation
Carrying out experiments on models. Simulations make it possible to examine how a system behaves when specific parameters are altered, or how it might develop under hypothetical conditions. They are therefore a means of generating knowledge through the controlled variation of model assumptions.
Models and simulations are closely linked: without a model there can be no simulation; without simulation a model remains a static representation. Only through dynamic testing does it become visible which consequences arise from specific inputs, conditions, or disruptions.
Procedure ^ top
The implementation of simulations and modelling follows a sequence of methodological steps that ensure models are built transparently, tested reliably, and interpreted critically.
-
Problem definition and research aim
At the outset stands the precise formulation of the research question: What is to be investigated through the simulation? Equally important is the delimitation of the system under study. Not all aspects of reality can be represented, so decisions must be taken about which processes and variables are relevant. -
Model construction
In the next step a model is created that reproduces reality in simplified form. This may be conceptual (e.g. flowcharts), mathematical (e.g. systems of equations), agent-based (e.g. simulations of decision-making), or physical-technical (e.g. heat flows). What matters is that assumptions and simplifications are documented explicitly, as they determine the explanatory power of the model. -
Data basis
The data basis forms the foundation of every model and simulation. It serves to determine parameters realistically, define input values, and enable later calibration. Data can originate from very different sources - such as official statistics, research databases, case studies, technical measurements, or original empirical surveys. It is crucial to document the origin of the data, as this shapes the transparency a -
Calibration and validation
A model is only robust if it is checked against real-world observations.- Calibration means adjusting the parameters so that the model accurately reproduces known states.
- Validation examines whether the model also produces meaningful results under different conditions.
- In addition, sensitivity analyses are often conducted: these test how strongly outcomes depend on changes in individual parameters.
-
Simulation experiments
At the core of model use are simulation experiments. Here, scenarios are deliberately tested by altering parameters, input values, or boundary conditions. The aim is to make possible developments visible and to assess how sensitive the model is to specific changes.A classic approach is to change only one parameter at a time while keeping all others constant. This allows the isolated effect of that single change to be analysed. Such experiments are particularly suitable for making causal relationships visible and for identifying which variables have the strongest influence on results.
In many fields of application, however, this one-dimensional variation is not sufficient, because systems are shaped by complex interactions between multiple parameters. This is where methods are used in which several parameters are varied at the same time:
-
Monte Carlo simulations: Random sampling of parameters within defined probability distributions to generate a wide range of possible scenarios. This makes it possible to calculate probabilities for certain outcomes and to make uncertainties visible. Monte Carlo simulations are a central method in quantitative risk analysis. The Monte Carlo approach replaces the fixed point values used in conventional models with probability distributions. Instead of assuming a fixed material price, for example, a range of possible prices with associated probabilities of occurrence is defined. In a repeated process, thousands of random samples are drawn from these distributions and the model outcome is calculated for each sample. The result is not a single number, but a distribution of outcomes. This allows risks to be quantified and enables statements about the likelihood of particular results — for example, how high the probability is of falling below or exceeding a certain threshold. The focus thus shifts from the question "What is the result?" to "What range of outcomes is how likely, and what risk does it entail?" In practice, the method is used, among other things, to aggregate individual risks into an overall risk, to evaluate investment projects under uncertainty, to support planning with risk assessments, and to determine risk-appropriate costs of capital. As a simplified preliminary step, a small number of consistent scenarios (e.g. an optimistic, a base, and a pessimistic scenario) can be defined to present different boundary conditions in a structured way; however, the Monte Carlo simulation goes beyond this by not only considering individual scenarios but systematically exploring the full range of possible developments.
-
Sensitivity analyses with multiple variation: Systematic combination of parameters to capture interactions and non-linear effects. Sensitivity analyses serve to identify the most influential parameters of a model. They answer the question of which assumptions have the greatest leverage on the final outcome. By varying several parameters simultaneously, both their individual effects and their interplay on the result become visible. The outcome is usually a ranking of the most influential factors. In contrast to simple one-at-a-time variation (where all other assumptions are held constant and interactions remain hidden), simultaneous multiple variation can also reveal non-linear effects — that is, cases where the combined effect of two parameters is greater or smaller than the sum of their individual effects.
-
-
Interpretation and generalisability
The results must be interpreted in light of the research question. Simulations do not provide certain predictions but illustrate possible development paths under specific assumptions. It is therefore essential to critically assess to what extent the findings can be generalised to other contexts and what limitations are imposed by the model assumptions. -
Documentation and replicability
Every step must be documented carefully: Which assumptions were made? Which data and software were used? Which parameters were set? Only in this way can other researchers or practitioners trace, replicate, or further develop the simulation.
Example of a parameter table:
Parameter Description Min Mode Max Unit Source (APA, fictitious) CAPEX Total investment costs 11,000 14,000 17,000 € Müller & Schmidt, 2024 OPEX_rate Annual operating costs 0.8 1.0 1.5 % of CAPEX Becker, 2023 Yield_1 Generation year 1 900 1,000 1,100 kWh/kWp·yr European Solar Atlas, 2022 Degradation Performance degradation 0.3 0.5 0.7 %/yr Li et al., 2021 EV_share Self-consumption share 25 35 60 % of generation Krause & Nguyen, 2023 Tariff_buy Grid purchase price 0.22 0.30 0.45 €/kWh Bundesnetzagentur, 2024 Esc_buy Electricity price escalation 0 2 5 %/yr Peters & Vogel, 2022 Tariff_feed Feed-in tariff 0.06 0.08 0.10 €/kWh EEG Monitor, 2024 r Discount rate 3 4 7 %/yr Ministry of Finance, 2020 T Analysis period 15 20 25 years Policy Report, 2023 WR_repl Inverter replacement (one-off) 800 1,200 1,800 € Hoffmann, 2021 WR_year Year of inverter replacement 12 13 15 year Hoffmann, 2021
4.3.1 Areas of Application ^ top
Simulations and modelling are particularly valuable when complex systems or processes need to be studied that are difficult or impossible to investigate directly in reality. They make it possible to design scenarios, test hypotheses, and support decisions on a solid evidence base.
-
Analysis of complex systems
Simulations allow researchers to capture interactions in systems with many variables and feedback loops. Examples include infrastructures, energy systems, or organisational processes. -
Forecasts and scenarios
Models can be used to project possible future developments. By varying assumptions (e.g. prices, demand, resource availability), different scenarios can be designed and examined in terms of their consequences. -
Policy and decision support
Simulations offer decision-makers an instrument to test alternative courses of action without immediately implementing them in reality. This enables risks to be assessed, cost-benefit relations evaluated, and strategies optimised. -
Planning and optimisation
In both technical and organisational contexts, models are used to make planning more efficient. Applications range from optimising buildings (e.g. energy consumption, indoor climate) to designing logistics or production processes. -
Research and theory development
Modelling is not limited to practical use but also advances scientific knowledge. It enables systematic testing of hypotheses about mechanisms and the development of new theoretical concepts. -
Education and communication
Simulations are a vivid tool for explaining complex relationships. Through visual or interactive presentation, even non-specialists can follow developments and scenarios, which makes them highly relevant for science communication and teaching.
4.3.2 Strengths and Weaknesses ^ top
Strengths
- Analysis of complexity: Simulations make it possible to understand systems with many variables, interactions, and feedbacks that would be almost unmanageable in reality.
- Risk-free experimentation: Hypothetical scenarios can be tested without incurring real costs, dangers, or ethical issues. This is especially valuable in areas where real-world experiments would be impossible or irresponsible.
- Forecasting capacity: Models allow the calculation of future scenarios, such as the development of markets, resource consumption, or organisational processes.
- Decision support: Simulations enable decision-makers to weigh different options and act on the basis of evidence.
- Transparency and traceability: Well-documented models clearly show which assumptions were made. This allows hypotheses to be examined and replicated by other researchers.
- Flexibility: Models can be continuously adapted and extended as new data or insights become available.
Weaknesses
- Dependence on assumptions: Every model is a simplified representation of reality. Its validity depends heavily on the quality and plausibility of the underlying assumptions. Inaccurate or overly simplified assumptions lead to distorted results.
- Validity problems: Even complex models only represent parts of reality. It must always be critically examined whether findings are transferable to real processes.
- High resource demand: Developing, calibrating, and validating models is often time- and resource-intensive. The more complex the model, the greater the need for expertise and computing capacity.
- Risk of misinterpretation: Simulation results can give the impression of exactness, even though they are based on assumptions and simplifications. There is a danger of overinterpretation or uncritical acceptance as "objective".
- Data dependency: Models require high-quality input data. If the data are incomplete, unreliable, or biased, the model will only reflect a limited reality.
- Communication barriers: The more complex a model is, the harder it becomes to explain its functioning and limitations to non-specialists.
4.3.3 Common Misconceptions ^ top
A frequent misconception is to regard simulations as direct representations of reality. In fact, models are always simplified, selective representations that highlight certain aspects while leaving others aside. Results are therefore not "the truth" but approximations based on chosen assumptions.
Another widespread belief is that greater complexity automatically produces better models. In practice, overly complex models can become confusing, difficult to validate, and hard to communicate. Good models are characterised by capturing the essential elements while remaining manageable.
A further misunderstanding is the assumption that simulations are inherently objective. Even though they are based on mathematical or technical procedures, models always reflect the perspectives and decisions of the researchers: Which variables are included? Which assumptions are made? Which data sources are used? These decisions have a decisive influence on the results.
It is also often overlooked that simulations have little value without valid input data. Even the most sophisticated model is only as robust as the data on which it is based. If uncertain, incomplete, or biased data are used, the results may be misleading.
Finally, there is sometimes the mistaken expectation that simulations can predict the future. Simulations do not provide certain forecasts but rather scenarios that illustrate what is likely under specific conditions. They are tools for exploration and decision support, not instruments of deterministic prediction.
4.4 Case Study ^ top
The case study is a research method that focuses on the in-depth and comprehensive examination of a single case or a small number of selected cases. A "case" is understood as a clearly defined unit that can be subjected to systematic analysis. Such a unit may be an individual, a group, an organisation, an event, a place, a process, or even documents. The central idea of the case study is to investigate a phenomenon in its natural setting and full complexity, rather than reducing it to a few isolated variables.
Case studies are characterised by a holistic perspective. This means that not only individual aspects of the case are examined, but that interactions, contexts and framework conditions are also considered in the analysis. In contrast to experimental designs, which aim at high internal validity through the control of variables, the case study seeks depth of understanding, contextual sensitivity and a nuanced reconstruction of real processes.
The methodological foundation of case studies is the use of multiple data sources. Interviews, observations, document analyses and statistical data can be combined in order to examine the case from different perspectives. This process of data triangulation increases the credibility of the findings and helps to create the most comprehensive picture possible.
A particular strength of the case study lies in its ability to capture complex social and organisational phenomena that cannot be adequately addressed by standard quantitative instruments. Case studies are therefore especially suitable for research questions that require a deeper understanding of processes, actions, meanings and structures. They are also highly relevant for theory development: through the intensive analysis of one or a few cases, new hypotheses may emerge, existing theories may be refined or contextualised, and previously overlooked connections may be revealed.
From an epistemological perspective, the case study is characterised by a close link between empirical research and theory. It often operates in the tension between inductive and abductive logic: on the one hand, empirical observations are used to develop theories, while on the other, existing concepts and theoretical approaches are applied and further developed in the analysis.
Case Selection ^ top
The case study does not aim for statistical representativeness. Its generalisability is instead based on analytical generalisation: the findings of a single case can be generalised in theoretical terms when they are related to existing concepts. The value of the case study therefore lies less in its quantitative scope than in the depth with which it contributes to the understanding of social reality. For academic work, this means that the selection of the case (e.g. a company, project or organisation) must be described in a transparent and methodologically sound way. This includes:
- Explaining why this particular case is especially suitable with regard to the research question and theoretical framework
- Justifying whether it is a typical case, representing a general pattern, or a special/extreme case that allows for specific insights
- Briefly outlining other cases considered and the reasons for rejecting them
- Reflecting on possible influencing factors (e.g. the researchers’ closeness to the field) and critically assessing them
This makes it clear that the selection is not random or solely motivated by access to data, but is based on academic criteria. Such transparency strengthens the credibility and significance of the case study.
Example formulations for describing case selection in academic work
The selection of the company under investigation was based on its relevance to the research question, as it exemplifies medium-sized enterprises in sector X and thus represents a typical case.
The decision in favour of this project was made because it represents a particularly striking example of the implementation of sustainability strategies and thus serves as an extreme case, providing specific insights.
Several potential organisations were considered in the selection process. Ultimately, Organisation A was chosen, as comprehensive access to data (interviews, internal documents, publicly available information) was possible here, while other options were rejected for methodological reasons.
The researchers’ proximity to the field was reflected upon. To avoid possible bias, the choice of case was motivated by its fit to the theoretical research question rather than by personal accessibility.
The case study was selected to allow for analytical generalisation. The chosen case represents a typical manifestation within the sector and contributes to examining theoretical concepts in a real-world context.
Anonymisation ^ top
Equally important is anonymisation. While publicly available data - such as published annual reports, press releases or court rulings - can usually be mentioned by name, internal or sensitive information must be protected. The degree of anonymisation depends on the balance between academic transparency and confidentiality.
| Original | Anonymised version |
|---|---|
| XY Ltd., Innsbruck, annual turnover €42m | "medium-sized manufacturing company in Western Austria, turnover range €40-50m" |
| IT service provider TechSolutions, Vienna | large IT service provider in an urban area |
| Location Salzburg | a site in Western Austria |
The decision on whether to disclose or anonymise a case must be justified in the academic work. Typical formulations include:
Justification for disclosure:
The company under investigation is named, as all information used originates from publicly available sources (annual reports, press releases). Permission to use this data was obtained.Justification for anonymisation:
The company under investigation is anonymised, as internal documents and confidential interview data are included in the analysis. To ensure academic transparency, industry, company size and region are specified, while the name and exact location are pseudonymised.
In this way, the methodological decision is made transparent while ensuring both academic quality and ethical standards.
4.4.1 Applications ^ top
Case studies are employed when complex phenomena need to be examined in their entirety and when an in-depth understanding of structures, processes, and meanings is required. They are particularly appropriate when the interaction of different factors and their contextual conditions, rather than isolated variables, is to be analysed.
-
Analysis of complex systems and organisations:
Case studies make it possible to capture processes, decision-making, or interactions within a specific system in detail. This is especially useful when structures and dynamics cannot be fully captured through standardised procedures. -
Investigation of real-world contexts:
Case studies are helpful when a research subject should not be artificially isolated but instead studied in its actual environment. They reveal how technical, economic, and social conditions are intertwined. -
Exploration of processes and developments:
Case studies can reconstruct long-term change processes, innovation trajectories, or organisational transformations. This provides insights into causes, mechanisms, and consequences that cross-sectional surveys may overlook. -
Comparison and contrast:
By examining multiple cases, similarities and differences can be systematically identified. This allows the generation of hypotheses or the testing of existing theories in different contexts. -
Practice-oriented insights:
Case studies offer concrete findings that can be directly applied in practice. They illustrate how theoretical concepts operate in real settings and which factors determine success or failure. -
Theory development:
Beyond their practical relevance, case studies contribute to advancing scientific theories. Through the detailed analysis of one or a few cases, new concepts can emerge or existing models can be critically reviewed and refined.
4.4.2 Strengths and Weaknesses ^ top
Strengths
- Depth of understanding: Case studies provide detailed insights into complex phenomena.
- Context sensitivity: The specific conditions and interactions of a case are made visible.
- Data variety: By using different sources (interviews, documents, observations), a multi-layered picture emerges.
- Theory development: Case studies are valuable for generating new hypotheses and refining existing theories.
- Practical relevance: Findings are often directly applicable to concrete fields of practice.
Weaknesses
- Limited generalisability: Findings refer to specific cases and are not statistically representative.
- Researcher dependency: Interpretation and weighting of data require high reflexivity, as subjectivity may influence results.
- Resource intensive: Detailed data collection and analysis demand significant time and effort.
- Risk of overload: Extensive data volumes can be difficult to structure and analyse.
4.4.4 Common Misconceptions ^ top
A common misconception is that case studies are automatically representative of a larger population. In fact, the aim is not statistical generalisability but analytical generalisation. Findings can be transferred to theoretical concepts but not directly to all comparable cases.
It is also often assumed that a case study is "only descriptive". In reality, it is a systematic research method that is scientifically grounded through structured data collection, triangulation, and theoretical embedding.
Another misconception is that case studies can be chosen arbitrarily. The selection of a case must be well justified, for example on the basis of relevance, informational value, or theoretical interest. An unreflective choice greatly reduces the explanatory power.
4.5 Systematic Review ^ top
A systematic review, internationally often referred to as a Systematic Review, is a scientific method that aims to compile the current state of research on a clearly defined question in a comprehensive, transparent, and methodologically verifiable way. In contrast to narrative or selective literature reviews, which are often influenced by subjective selection, a systematic review follows a structured, documented, and reproducible procedure.
Key steps include the precise formulation of the research question, the development of a systematic search strategy (including the selection of suitable databases and search terms), the definition of clear inclusion and exclusion criteria, as well as the critical appraisal of the studies found. All decisions taken in the process must be documented in a transparent manner, so that other researchers can review or replicate the procedure.
In this context, sources are not general textbooks or reference works. Systematic reviews typically draw on primary scientific studies that contain original empirical data or theoretical models. These studies form the foundation of systematic reviews, as they provide concrete findings or concepts that can be assessed methodologically and related to one another. Textbooks or handbooks may serve for orientation, but they are secondary sources and therefore not the primary subject of a systematic review.
The purpose of a systematic review is to produce a complete and unbiased picture of the state of research. This includes not only compiling the main findings, but also critically considering the methodological quality of the included studies, comparing results, and identifying research gaps. In this way, systematic reviews contribute significantly to organising and consolidating existing knowledge and to providing a sound basis for future research projects.
Note on terminology
In many disciplines, the term meta-analysis is also used. This refers to a specific quantitative procedure applied within a systematic review when several studies provide comparable data that can be statistically combined. A meta-analysis is therefore not a stand-alone method, but a particular tool used as part of a systematic review.
Implementation ^ top
For conducting systematic reviews, the PRISMA approach (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) has become the established standard. It ensures that the entire process is traceable, transparent, and verifiably documented.
-
Identification
- Development of a comprehensive search strategy with clearly defined search terms.
- Search across several academic databases as well as grey literature.
- Documentation of search paths, databases, and number of hits.
-
Screening
- Initial review based on titles and abstracts.
- Application of broad inclusion and exclusion criteria (e.g. language, publication period, type of publication).
- Removal of duplicates.
-
Eligibility
- Full-text review of the remaining studies according to precise inclusion and exclusion criteria.
- Typical exclusion criteria: insufficient methodological quality, unsuitable population, lack of relevance to the research question, purely theoretical papers in an empirical context, or vice versa.
-
Inclusion
- Final selection of studies to be included in the analysis.
- Documentation of the number of included studies and the reasons for exclusions.
-
Data Extraction
- Systematic recording of relevant information from the included studies (authors, year, study design, sample, methods, key findings).
- Use of standardised tables or data extraction forms.
-
Quality Assessment / Risk of Bias
- Critical appraisal of the methodological quality and validity of the included studies.
- Application of standardised assessment tools (e.g. checklists for study designs, bias assessment criteria).
-
Synthesis
- Integration of results, either narratively (qualitative) or quantitatively in the form of a meta-analysis.
- Presentation of key patterns, differences, and research gaps.
-
Reporting
- Visualisation of the process in the PRISMA flow diagram, showing the number of studies identified, excluded, and included, along with reasons for exclusion.
- Clear presentation of all methodological decisions to ensure transparency and replicability.
4.5.1 Areas of Application ^ top
Systematic reviews serve to organise and critically assess the existing body of research and are therefore a key instrument when it comes to capturing the current state of knowledge on a specific question. They are particularly useful when research findings are widely scattered, partly contradictory, or methodologically heterogeneous, and when a structured synthesis is required.
-
Stocktaking of the state of research:
Systematic reviews provide a transparent overview of which studies exist on a topic, which questions have already been examined, and what results have been obtained. This creates orientation for subsequent research projects. -
Synthesis and comparison of findings:
Different studies often yield partly contradictory results. A systematic review highlights these, places them side by side, and identifies both commonalities and differences. In this way, reliable conclusions can be drawn. -
Assessment of methodological quality:
Systematic reviews evaluate the methodological soundness of the included studies. This makes it possible to better judge the significance of findings and to identify potential biases or methodological weaknesses. -
Identification of research gaps:
Through systematic structuring, it becomes clear in which areas sufficient evidence exists and where further research is needed. This serves as an important basis for developing new projects. -
Development of theoretical and practical guidance:
Systematic reviews not only provide an overview, but also create a foundation for critically examining existing theories or formulating practical recommendations based on a broad body of empirical evidence. -
Support for decision-making:
In many contexts, systematic reviews are used to inform decisions - whether in planning, management, or policy-making. They provide robust evidence that goes beyond individual studies.
4.5.2 Strengths and Weaknesses ^ top
Strengths
- Transparency: Clear criteria and structured procedures enhance traceability.
- Clarity: Systematic summaries allow rapid access to extensive fields of research.
- Evidence building: Quantitative syntheses (e.g. meta-analyses) can pool effects and strengthen the reliability of findings.
- Error control: Biases or weaknesses of individual studies can be put into perspective within the overall review.
- Research guidance: Results indicate where further research is needed and which questions have already been adequately addressed.
Weaknesses
- Effort: Systematic reviews require time-intensive searches, selection processes, and analyses.
- Dependence on data: The quality of the review depends on the quality and availability of primary studies.
- Publication bias: Studies with significant results are published more frequently, which may distort systematic reviews as well.
- Complexity: Differences in study designs, measurement tools, or populations make direct comparisons more difficult.
- Limited generalisability: Systematic reviews are bound by the strength and scope of the underlying studies.
4.5.3 Common Misconceptions ^ top
A common misconception is that a systematic review is merely an "extended literature review." In fact, it differs from unsystematic reviews through a clearly defined methodology, documented selection criteria, and transparent analytical steps.
It is also often assumed that quantitative syntheses such as meta-analyses are "objective" because they use statistical methods. In reality, their reliability strongly depends on the quality of the included studies. Weak or biased primary studies can lead to misleading overall results.
Another misunderstanding is that systematic reviews are only relevant for quantitative research. Qualitative studies can also be systematically synthesised, for instance through meta-syntheses that integrate concepts, theories, or interpretations across several studies.
Finally, it is often overlooked that even a comprehensive systematic review is never "final." It reflects the state of research at a given point in time, which may change with the publication of new studies and data.
4.5.4 PRISMA: Reporting standard for systematic reviews ^ top
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) is an internationally established reporting standard that ensures systematic reviews are reported in a transparent, complete and traceable way. PRISMA is not an analysis method in the strict sense, but a guideline for the structured documentation of the entire review process — from the search strategy through screening to synthesis. The current version (PRISMA 2020) includes a checklist with 27 items and a flow diagram that visualises the selection process. There is a dedicated extension for scoping reviews (PRISMA-ScR).
Systematic reviews consolidate the state of research on a defined question. To make this consolidation robust, all decisions in the process must be disclosed: Which databases were searched? Which search terms were used? How many hits were found? According to which criteria were studies included or excluded? How was the quality of the included studies assessed? PRISMA provides a clearly defined reporting standard for each of these questions. Without such a structure, reviews risk being selective, non-replicable or biased.
PRISMA process
| Step | Aim | Procedure | Typical output |
|---|---|---|---|
| 1. Create protocol | Pre-specify the approach | Document research question, PICO/PEO, search strategy, inclusion/exclusion criteria, synthesis plan | Protocol |
| 2. Develop search strategy | Reproducible, comprehensive literature search | Define search terms, synonyms, Boolean operators (AND, OR, NOT); specify databases and time frames; include grey literature | Documented search strings per database |
| 3. Conduct and document search | Record hit counts | Run searches in all defined databases; note hit counts per database; remove duplicates | Search log with date, database, hit count |
| 4. Title–abstract screening | Exclude obviously irrelevant hits | Screen titles and abstracts using broad inclusion/exclusion criteria; if in a team, screen independently then reach consensus | List of potentially relevant full texts |
| 5. Full-text assessment (eligibility) | Final study selection | Assess full texts against precise criteria; document reasons for exclusion | List of included studies + reasons for exclusion |
| 6. Data extraction | Capture relevant information in a standardised way | Use an extraction form (author, year, design, sample, methods, results, limitations) | Extraction table |
| 7. Quality appraisal | Assess methodological quality and risk of bias | Apply a standardised tool (e.g., RoB 2 for RCTs, CASP for qualitative studies, JBI checklists) | Appraisal table with ratings |
| 8. Synthesis | Bring findings together | Narrative (thematic, tabular) and/or quantitative (meta-analysis with effect sizes, confidence intervals, heterogeneity tests) | Synthesis report, possibly forest plot |
| 9. Create PRISMA flow diagram | Visualise the selection process | Display the number of hits, exclusions and inclusions at each phase | Flow diagram |
| 10. Write report | Complete, structured presentation | Address all PRISMA items; use the checklist for self-audit | Final publication/chapter |
PRISMA flow diagram
The flow diagram is the heart of PRISMA documentation. It shows at a glance how many studies were included or excluded at each stage of the process. The following table reflects the logic of the diagram:
| Phase | Description |
|---|---|
| Identification: database search | Hits from all databases searched |
| Identification: other sources | Hits from reference lists, grey literature, expert contacts |
| Duplicates removed | Entries found more than once removed |
| Title–abstract screening | Records screened after de-duplication |
| Excluded (title/abstract) | Obviously unsuitable (topic, language, publication type) |
| Full-text assessment | Full texts assessed for eligibility |
| Excluded (full text) with reasons | e.g., wrong population, wrong design, missing data, duplicate |
| Included studies | Included in the synthesis |
| Of these in meta-analysis (if applicable) | Quantitatively synthesised |
Formulating inclusion and exclusion criteria
A key quality aspect is the pre-specified, transparent definition of the criteria for including or excluding studies from the review. The criteria are often based on the PICO or PEO framework:
| Dimension | Description | Example |
|---|---|---|
| P – Population/Problem | Who or what is being studied? | Commercial properties in Europe |
| I/E – Intervention/Exposure | Which measure or influencing factor? | Energy efficiency measures (e.g., LED, HVAC, building envelope) |
| C – Comparison (optional) | What is the comparison? | Buildings without the measure or pre-intervention |
| O – Outcome | Which outcome is considered? | Energy use, CO₂ emissions, payback period |
Quality appraisal
| Instrument | Suitable for | Core focus |
|---|---|---|
| RoB 2 (Cochrane Risk of Bias) | Randomised controlled trials (RCTs) | Risk of bias across six domains |
| ROBINS-I | Non-randomised intervention studies | Confounding, selection, measurement, reporting |
| CASP (Critical Appraisal Skills Programme) | Qualitative studies, reviews, cohort studies | Methodological rigour, relevance, clarity of results |
| JBI checklists (Joanna Briggs Institute) | Various designs (qualitative, quantitative, mixed methods) | Design-specific quality criteria |
| AMSTAR 2 | Systematic reviews (appraisal of reviews) | Methodological quality of the review process itself |
| Newcastle–Ottawa Scale (NOS) | Observational studies (cohort, case–control) | Selection, comparability, outcome assessment |
Example search terms and databases
Database Fields (recommended) Search string (example, adapt to UI) Primary filters Emerald Insight All fields or Title/Abstract/Keywords ("hybrid work" OR "hybrid working" OR "flexible work" OR "remote AND office") AND ("employee satisfaction" OR "job satisfaction" OR wellbeing OR "well-being" OR engagement) Year: 2015–2025; Content type: Research Article; Language: English, German SpringerLink Advanced Search: Title + Abstract + Keywords ("hybrid work" OR "hybrid working" OR "flexible work" OR "remote and office") AND ("employee satisfaction" OR "job satisfaction" OR wellbeing OR "well-being" OR engagement) Discipline: Business & Management; Social Sciences (optional); Article type: Article; Year: 2015–2025; Language: English, German; Exclude: Chapter, Reference work entry SAGE Journals Abstract/Title/Keywords ("hybrid work" OR "hybrid working" OR "flexible work arrangement" OR "remote and office") AND ("employee satisfaction" OR "job satisfaction" OR wellbeing OR "well-being" OR engagement) Article type: Research Article; Year: 2015–2025; Language: English, German Example inclusion and exclusion criteria
Category Criteria Inclusion - Empirical primary studies (quantitative, qualitative, mixed methods)
- Population: Employed persons in companies/organisations (no purely student samples)
- Intervention/exposure: Hybrid working models (combining remote and in-person work, clearly defined)
- Outcomes: Employee satisfaction/job satisfaction, wellbeing, engagement (validated or clearly operationalised)
- Period: 2015–2025 (year of publication)
- Languages: German, English
- Full text accessibleExclusion - No hybrid setting (purely remote or purely in-person without a hybrid component)
- No primary data (editorials, commentaries, opinion pieces, book chapters, reviews without new primary data)
- Wrong outcome (e.g., productivity only without satisfaction/wellbeing/engagement)
- Population/context not suitable (e.g., exclusively students, school contexts without organisational relevance)
- Inadequate methodological quality (e.g., unclear instruments, missing sample description)
- Full text not available
- Language other than German/EnglishExample PRISMA table
PRISMA phase Count Notes Identification – databases 1,860 Emerald 540; SpringerLink 780; SAGE 540; Google Scholar/preprints 110; references 50 Total before de-duplication 2,020 De-duplication 520 Remaining after de-duplication 1,500 Screening (title/abstract) screened 1,500 Excluded (title/abstract) 1,090 no hybrid setting 520; wrong outcome 330; non-empirical 170; wrong population/context 70 Full texts assessed 410 Full texts excluded 340 no clearly defined hybrid model 120; outcome not suitable 95; methodological quality 65; full text not available 35; language other than DE/EN 25 Excluded (methodology) 70 Quantitative 45; Qualitative 17; Mixed methods 8 Analysis 17 purely qualitative studies
Distinction from reporting standards for primary studies
PRISMA refers solely to the reporting of reviews. Separate guidelines exist for reporting empirical primary studies:
| Standard | Study type | Purpose |
|---|---|---|
| PRISMA | Systematic reviews, meta-analyses | Reporting the review process |
| COREQ | Qualitative primary studies (interviews, focus groups) | Transparency of qualitative data collection and analysis |
| SRQR | Qualitative research (broader than COREQ) | Completeness of qualitative reports |
| CONSORT | Randomised controlled trials (RCTs) | Reporting of experiments |
| STROBE | Observational studies (cohort, cross-sectional, case–control) | Reporting of epidemiological/observational designs |
Common pitfalls and best practice
| Common pitfall | Why it is problematic | Best practice |
|---|---|---|
| Only one database searched | Systematic gaps; relevant studies may be missed | At least two to three databases + reference lists + grey literature |
| Search strings not documented | Search not reproducible | Archive exact strings with date and database |
| Reasons for exclusion not stated | Not transparent why studies are missing | Document every full-text exclusion with a reason |
| No quality appraisal | Strong and weak studies weighted equally | Apply and report a standardised instrument |
| Flow diagram missing or incomplete | Selection process not transparent | Provide a complete PRISMA flow with numbers and reasons |
| Unstructured narrative synthesis | Results appear selective or arbitrary | Structure thematically or by outcome; use tables |
4.6 Questionnaire Survey ^ top
The questionnaire survey is one of the most widely used methods of data collection in the social, economic, and technical sciences. Its purpose is to systematically gather information from a larger number of participants. Questionnaires consist of a series of questions or items that are presented in a standardised format. This makes it possible to compare responses across participants and use them for further analyses.
Types of Questions ^ top
Questionnaires can include both quantitative and qualitative elements:
-
Quantitative: standardised questions with predefined response categories (e.g. scales, multiple choice). The aim is to analyse frequencies, correlations, or differences statistically.
-
Qualitative: open questions where respondents can formulate their answers freely. The aim is to capture subjective perceptions, interpretations, and explanations in detail.
| Question Type | Characteristics | Areas of Application | Advantages | Challenges and Risks |
|---|---|---|---|---|
| Open Questions | Responses are formulated freely; no predefined response categories | Capturing subjective impressions, individual assessments, or aspects not previously known to researchers | High informational depth, new perspectives, particularly useful for exploratory studies | Time-consuming analysis, limited comparability, risk of ambiguous responses |
| Closed Questions | Predefined response options; respondents choose from a list | Measuring frequencies, distributions, and relations; standardised surveys | High comparability, easy to analyse, efficient for large samples | Low informational depth, responses limited to preset categories |
| Scaled Questions (e.g. Likert scales) | Respondents rate a statement on a gradual scale (e.g. from strongly disagree to strongly agree) | Measuring attitudes, satisfaction, acceptance, or perceptions | Produces differentiated data that can be analysed statistically, high degree of standardisation | Scales must be precisely constructed, risk of tendency towards neutral midpoint choices |
| Semi-open Questions (hybrid) | Predefined response options with the possibility to add a self-formulated answer | Useful when standardisation is desired but open responses may add value | Combines comparability with flexibility | Increased effort in analysis due to additional open responses |
| Filter and Contingency Questions | Direct respondents to different follow-up questions depending on their answers | Avoids irrelevant questions, increases survey efficiency | Individually adjusted surveys, reduces respondent frustration | Complex questionnaire design, increased risk of errors in implementation and analysis |
| Projective Questions | Questions asked indirectly, e.g. through scenarios, images, or hypothetical situations | Capturing underlying attitudes, motivations, or values that respondents may not express directly | Uncovers hidden perspectives, reduces social desirability bias | Difficult to analyse, high degree of interpretation, requires well-designed questions |
Scales ^ top
Scales are a central instrument in standardised questionnaires, as they make it possible to capture attitudes, perceptions, or behaviours not only dichotomously (yes/no), but also in gradations. Instead of restricting respondents to a simple choice, scales allow for more nuanced assessments and thus enable finer analysis.
Commonly used types of scales include:
- Likert scales: Respondents indicate the extent to which they agree with a statement (e.g. from "strongly disagree" to "strongly agree"). Likert scales are widely used because they translate attitudes into quantifiable data.
- Rating scales: Evaluations are made on a scale of numerical or verbal steps (e.g. 1-10, very poor to very good). They are often used to measure satisfaction or the intensity of a perception.
- Semantic differential scales: Respondents assess objects or concepts between pairs of bipolar adjectives (e.g. "modern - traditional", "practical - impractical"). They are useful for capturing complex perception profiles.
- Visual analogue scales (VAS): Responses are marked on a continuous line between two extremes (e.g. pain perception between "no pain" and "worst imaginable pain"). This method is particularly applied when high sensitivity to subtle differences is required.
Advantages of scales
- They increase measurement accuracy by capturing not only the existence of an attitude but also its strength.
- They are suitable for statistical analysis and allow the calculation of means, variances, or correlations.
- They enable comparisons between groups or over time.
Challenges of scales
- The wording must be precise, as unclear anchor points (e.g. "rather agree") may be interpreted differently.
- The number of scale points influences the results: a few points (e.g. 3 or 4) simplify responses, while many points (e.g. 10 or more) allow more differentiation but may overwhelm respondents.
- Cultural differences play a role: in some cultures extreme values are avoided, while in others they are preferred.
- Scales are susceptible to response tendencies, such as central tendency (preference for neutral answers) or acquiescence bias (general tendency to agree).
- It must also be noted that a numerical response alone does not automatically explain what a given number means to respondents. For example, a score of "2" on a satisfaction scale indicates low approval, but it does not reveal whether this is due to missing facilities, unfavourable conditions, or personal expectations. For deeper insight, a combination with open questions or additional methods is often advisable.
Implementation ^ top
Questionnaires can be administered in written form (paper), digitally (online surveys), or orally (structured interviews). What matters most is clear structuring, comprehensible language, and alignment with the research question.
The quality of a questionnaire survey largely depends on the care taken in formulating and testing the questions. Even small ambiguities or unnecessary items can considerably reduce the validity of the data.
Where possible, questions should not be developed entirely anew but should draw on established templates from the research literature or existing studies. This ensures that formulations have already been tested and that evidence of validity and reliability is often available. When questions are newly developed, they must be closely aligned with the research question and underlying theoretical concepts.
Principles of wording
- Clarity: Questions must be unambiguous, easy to understand, and precise.
- Neutrality: Leading or value-laden formulations must be avoided.
- Relevance: Only questions that genuinely contribute to answering the research question should be included. This is particularly important for personal data - it must be checked whether their collection is truly necessary.
Data protection and ethical aspects
Particularly strict requirements apply when collecting personal data. The General Data Protection Regulation (GDPR) of the European Union stipulates that only data strictly necessary for the research purpose may be collected (principle of data minimisation). Researchers must therefore always examine whether information is indispensable for answering the research question or whether it can be omitted.
A central risk lies in the fact that seemingly anonymous data may, in combination with other variables, allow re-identification of individuals. For example, if age, gender, department, and place of residence are collected together, it may be possible to identify participants in small samples or clusters. This would violate the basic principles of the GDPR, which aim to protect privacy and prevent data from being traced back to individuals.
Particular caution is required when dealing with sensitive data (e.g. relating to health, religion, or political orientation). According to the GDPR, these may only be collected under the strictest conditions, such as explicit consent and clearly defined purposes. Even for less sensitive data, it is essential to consider whether the information is really needed for the analysis or whether anonymisation or aggregation (e.g. age groups instead of exact date of birth) is sufficient.
The GDPR also requires transparency: participants must be informed in clear and accessible language about what data is collected, for what purpose it is used, and how long it will be stored. They must also have the right to withdraw consent and request the deletion of their data.
Pretests
Before being used in the main study, questionnaires should be tested in a pretest. This helps determine whether questions are understandable, whether response categories are appropriate, whether technical functions work properly (e.g. in online surveys), and whether the completion time is reasonable. Pretests make it possible to identify and address ambiguities or technical problems at an early stage.
Handling incomplete responses
A common misconception is that incomplete questionnaires must always be excluded. In fact, a differentiated approach is required:
- If only a few questions are missing, the remaining data may still be valuable.
- In some cases, it may even be appropriate to impute missing values statistically.
- Exclusion should only occur if central variables are missing or if response patterns are evidently random or contradictory.
4.6.1 Areas of Application ^ top
Questionnaire surveys can be used in a wide range of contexts where information on attitudes, opinions, experiences, or behaviours is required. They are particularly suitable when:
- Larger groups need to be surveyed systematically in order to identify patterns and trends.
- Comparisons are to be made between different groups, organisations, or points in time.
- Subjective assessments such as satisfaction, acceptance, or perceptions are to be captured.
- Hypotheses need to be tested or exploratory questions clarified.
- Practice-oriented information is required to support decisions in organisations, planning processes, or projects.
Questionnaires are therefore a flexible instrument that can be used both for descriptive stocktaking and for analytical hypothesis testing.
4.6.2 Strengths and Weaknesses ^ top
Strengths
- Wide reach: Surveys can cover large groups at comparatively low cost.
- Standardisation: Asking all participants the same questions enables comparability.
- Versatility: The combination of open and closed questions allows for both quantitative and qualitative analysis.
- Efficiency: Online surveys in particular are quick to administer and easy to evaluate.
Weaknesses
- Limited depth: Standardised questionnaires provide less detail than open interview formats.
- Response bias: Social desirability or lack of motivation may distort answers.
- Response rate: In voluntary online surveys, willingness to participate is a critical factor.
- Comprehension issues: Ambiguous or unclear questions lead to misunderstandings and reduce data quality.
4.6.3 Common Misconceptions ^ top
A widespread misconception is that questionnaires are automatically a "quantitative" method. In fact, it depends on the design whether data are analysed numerically or interpreted qualitatively.
It is also often assumed that a large number of responses automatically leads to valid results. What really matters is whether respondents are representative of the target population and whether the sample is methodologically well-founded.
Another misconception concerns the handling of incomplete responses. It is often assumed that questionnaires with missing data must always be excluded. In practice, however, a more differentiated approach is advisable:
- If only a few questions are missing, the remaining data can still be used.
- Missing values can sometimes be statistically imputed under certain conditions.
- Exclusion should only occur if central variables are missing or if response patterns are evidently random or contradictory.
It is also frequently believed that online surveys are inherently easier and better than traditional methods. While they are cost-effective and fast, they require careful design, technical safeguards, and targeted monitoring of response rates to avoid bias.
Finally, it is often overlooked that questionnaires are only as good as their design. Without precise wording, logical structure, pretesting, and strict adherence to data protection requirements, even large-scale surveys cannot produce robust results.
4.7 Interview ^ top
Overview of key regulations in your study programme:
- Number of interviews based on theoretical saturation + 1–2 additional interviews for confirmation (possible sample size for homogeneous group: 6–12 interviews, heterogeneous group: 12–20 interviews with 5–8 per subgroup, experts: 8–15 interviews)
- (Semi-)structured guide with core questions; flexibility in sequence & depth; conduct pretest with 1–2 people before main study
- Audio recording is standard (consent required) + document contextual factors (location, duration, etc.)
- Maintain protocol throughout entire data collection process
- smoothed transcription (grammatically corrected) with anonymisation and separate, encrypted mapping list
- Select and document coding procedure according to research design (e.g. deductive and/or inductive category formation)
- Coding guide includes categories with definitions, inclusion/exclusion criteria, sources (deductive) or anchor examples (inductive). Document versioning (e.g. amount of material reviewed for first coding, additions/changes to categories, etc.)
- Software: QDA tools are optional; the logic is decisive, not the tool (transparency also when using software)
- Submission in work appendix: interview guide (final), coding guide (final)
- Separate Moodle upload: transcripts (pseudonymised)
- Do not submit but archive securely: audio files, consent forms
| Interviews are among the central methods of qualitative research and exist in various forms: | Interview Type | Characteristics | Purpose | Advantages | Limitations / Risks |
|---|---|---|---|---|---|
| Structured Interview | All questions are prescribed; sequence and wording remain identical | Comparability between many respondents; often quantitative evaluation | High standardisation, good reproducibility, efficient for large samples | Low flexibility, no tailoring to individual responses, risk of superficial data | |
| Semi-structured / Guide-based Interview | Guide with core topics; sequence and depth can vary | Combines structure with flexibility; applicable to many qualitative research questions | Good balance between comparability and individuality; follow-up questions possible | Dependent on interviewer competence; evaluation time-consuming | |
| Unstructured / Narrative Interview | No fixed questions; open conversation; topic co-shaped by respondent | Exploratory studies; gaining in-depth insights and personal narratives | Maximum flexibility; open to new, unexpected aspects; enables deep understanding | Low comparability; strong dependence on research competence; very time-consuming to evaluate | |
| Focus Group Interview | Conversation with multiple people simultaneously; moderated by researchers | Capturing opinion formation, group dynamics and collective perspectives | Efficient for many viewpoints in short time; open to discussion; makes social processes visible | Individual perspectives fade into background; strong personalities can dominate; moderation-intensive |
Whilst structured interviews primarily ensure quantitative comparability and unstructured interviews offer maximum openness for individual narratives, the guide-based interview represents a methodological middle ground. It combines necessary thematic structure with flexibility to respond to individual answers and enable deeper exploration. Due to this balance between comparability and openness, the guide-based interview is a particularly frequently used form of qualitative research and forms the focal point of the following discussion.
A guide contains the central themes and questions to be addressed in all conversations. At the same time, interviewers retain the flexibility to respond flexibly to answers, ask follow-up questions, and explore interesting aspects in greater depth. Unlike standardised questionnaires, questions do not need to be formulated in a way that they can be answered without context and follow-up questions. Instead, the interview thrives on interaction, which allows individual perspectives to be explored in differentiated detail.
Conduct ^ top
The conduct of guide-based interviews requires careful preparation that is both methodologically sound and practically feasible.
Selection of interview participants
The selection of respondents is a central methodological step, as it decisively determines which perspectives become visible in the research process. Whilst quantitative studies often aim for representative random samples, the selection in guide-based interviews follows different logic. Here the focus is not primarily on statistical representativeness, but on the deliberate selection of people who can contribute relevant knowledge, experiences or perspectives to the research question.
In principle, selection is guided by research interest:
- For exploratory research questions, participants are sought who can cover as broad a range of viewpoints as possible.
- For hypothesis-testing or theory-driven research questions, selection often occurs deliberately according to characteristics relevant to the assumptions being tested.
Various sampling strategies can be distinguished:
- Theoretical sampling: Respondents are selected so that different perspectives, roles or contexts are included in the analysis. Example: In a study of organisational culture, people from different hierarchical levels or functional areas could be interviewed.
- Criterion sampling: Selection based on clearly defined criteria, such as experience in a specific area, belonging to a particular target group, or participation in a relevant process.
- Extreme or contrast cases: Deliberate selection of particularly typical or particularly atypical cases to make differences and tension fields visible.
- Snowball sampling: Begins with a few central respondents who can nominate other relevant people from their network. This is particularly suitable when access to certain groups is difficult.
If all respondents share similar professional experience, organisational background or personal relationships, there is a risk that certain viewpoints are over-represented whilst other relevant perspectives are missing. Moreover, familiarity and existing relationships between researchers and respondents can influence the openness and authenticity of responses—either through restraint in critical statements or by adapting to expected positions.
However, qualitative research aims at perspective diversity and context sensitivity. Therefore, it is necessary to include interview partners from different organisations, institutions or social contexts. In this way, contrasts become visible that enable a deeper understanding of the phenomenon being examined.
Crucial is that selection is methodologically justified and transparently documented. Researchers must clearly explain why specific people were included in the study and how they contribute to the research interest. This prevents results from appearing as random individual cases and strengthens the transferability of the research for academic discourse.
Example formulations for selecting interview partners in academic work:
Interview partners were selected according to the criterion that they have at least five years' experience in project management and thus bring well-founded practical experience.
To capture different perspectives, people were deliberately interviewed from various hierarchical levels (department management, team management, operational staff).
Selection was based on the principle of theoretical saturation: interviews were conducted until no new insights emerged.
Sample size is not predetermined in qualitative research but is guided by the principle of theoretical saturation: interviews are conducted until no substantial new insights emerge and central categories are sufficiently substantiated.
Empirically proven orientation values for different research contexts:
| Target Group / Context | Recommended Sample Size | Rationale |
|---|---|---|
| Homogeneous Groups | 6–12 interviews | Similar characteristics, faster saturation |
| Heterogeneous Groups | 12–20 interviews (5–8 per subgroup) | Different perspectives, multiple variations |
| Expert Interviews | 8–15 interviews | Specific detailed knowledge, high information density |
These values are based on empirical standards of German-language qualitative research (cf. Kuckartz, Mayring, Helfferich) and serve as orientation framework, not rigid specifications.
Saturation occurs when:
- No new codes emerge—Coding of already-examined material yields no fundamental new categories.
- Confirmed categories—Existing categories are confirmed and strengthened by new data, but not expanded.
- Full variation explained—The range of all relevant manifestations of the phenomenon is documented.
Practical procedure:
- After reaching these three indicators, at least 1–2 additional interviews should be conducted to empirically confirm saturation.
- This is particularly important in Bachelor's and Master's theses to document robustness of results.
- The saturation point is transparently described in the methodology section of the work (e.g. "After the 11th interview, no new codes emerged; two additional interviews (n=13) confirmed saturation").
Function and structure of the guide
The interview guide is a structuring instrument that ensures thematic focus without impairing the flexibility and openness of the conversation. It is not a rigid question schema, but an orientation framework for the interviewer.
A proven three-phase model organises qualitative interviews:
- Narrative stimulus (opening)
- Broad, open initial question that invites the respondent to unfold their perspective narratively
- Example: "Tell me how you came to your current profession."
- Avoid direct formulation of the research question
- Thematic question complexes (main section)
- Structured thematic blocks, each with immanent questions (from the narrative) before exmanent questions (external theoretical perspective)
- Immanent questions: "You mentioned that cooperation was difficult—can you give me a concrete example?"
- Exmanent questions: "How would you evaluate that from an organisational perspective?"
- Flexible sequencing depending on conversation flow
- Closure and evaluation
- Summarising, evaluative or imaginative questions
- Example: "If you could give advice to other colleagues—what would you say?"
- Open space for respondent's additional remarks
The quality of guide-based interviews depends substantially on the care with which questions are developed and structured. The fundamental principle is that questions must be formulated clearly, openly and with thematic focus. They should give respondents sufficient space to present their viewpoints, experiences and reasoning, without being restricted by narrow answer options.
Question development should always start from the research question: each guide question must have a recognisable relationship to the research objective and ensure that data collected in the interview actually contributes to answering the research question. For this, it is useful to break down the research question into thematic sub-aspects and transfer these to the guide.
An important step is orientation to existing literature and established instruments. Often, questions can be taken from or adapted from earlier studies, which increases comparability and ensures theoretical grounding. Where such templates are lacking, new questions can be developed but should be closely oriented to theoretical concepts and clearly defined terms.
The guide itself usually contains overarching guide questions for the individual topic blocks. These function as "entry anchors" and ensure that all relevant content is addressed. Supplementary questions or possible follow-up questions can be prepared to deepen answers where necessary, request examples, or clarify unclear statements. The interview guide is thus not a rigid script, but structured guidance that enables interviewers to conduct flexible yet systematic conversations.
Unlike standardised questionnaires, questions do not need to be formulated so that they can be answered unambiguously without follow-up questions. Rather, openness and interactivity are part of the methodological design. Nevertheless: all central topic areas of the guide must be systematically addressed in each interview to ensure a minimum level of comparability between interviews.
Qualitative questions must generate narrative responses and not simply provoke yes/no answers.
| Do's | Don'ts |
|---|---|
|
|
Before actual use, it is advisable to test the guide in a pretest with one or two people from the target group. This makes it possible to check whether the questions are understandable, whether sequence and transitions work well, and whether the conversation duration is realistic. The technique (e.g. recording devices, online tools) should also be tested. Pretests help identify ambiguities or unnecessary complexity in the guide and resolve them before the main study.
Data protection and informed consent
As with all qualitative methods, the principle of data minimisation under the General Data Protection Regulation (GDPR) applies here. Only data required directly for the research question may be collected. The consent of participants must be obtained and transparently documented.
Before each interview, informed consent must be obtained. This documents that the respondent:
- Has knowledge of the research objective, methodology and data use
- Understands that participation is voluntary and can be withdrawn at any time
- Knows how their data will be protected and anonymised
- Has the option to view transcripts and analysis results
An informed consent form is signed by the interviewer and the respondent. At least two copies are created (one for the respondent, one for the researchers).
Content of the informed consent form:
- Title and context of the study
- Description of data collection (duration, recording, transcription)
- Data protection and anonymisation (pseudonymisation, deletion periods)
- Options for data sharing and archiving
- Contact details of the researcher and, if applicable, supervision
- Signature and date
Anonymisation means that conclusions about the identity of the respondent are excluded. This is the standard for qualitative research in higher education.
- At the start of the interview: Each respondent receives a unique participant ID (e.g.
IP01,IP02, …), under which all data is stored. - Mapping list: A separate, encrypted mapping list (key file) links the ID to the actual name. This is not stored together with other materials.
- Transcription and analysis: All transcripts and analysis files contain only the ID, no name.
- Sensitive information: Location details, institution names, distinctive names of people are replaced in transcripts with generalised terms (e.g. "large city in western Germany" instead of "Munich", "University A" instead of university name, "colleague Petra" → "colleague B").
The anonymisation of interviews is a central component of academic integrity and ethical standards. Here it must be decided to what extent information can be anonymised or disclosed.
Original Anonymised Presentation Noa Müller, Head of Human Resources Department, Company XY, Munich Senior HR role, mid-sized company in southern Germany Interview with Phil Becker, Project Lead at Construction Firm Z, Hamburg Project management in a large construction company in northern Germany Maxi Schmidt, Student at FH Kufstein Tirol Student at an Austrian university
- Rationale for disclosure: Respondents are named because they have explicitly consented to publication of their information and all details are publicly available.
- Rationale for anonymisation: All interview partners were anonymised to maintain confidentiality. Function and organisational context remain to ensure scientific traceability.
- Rationale for partial anonymisation: Interview data were anonymised to the extent that no conclusions about specific individuals are possible. However, position and general context are mentioned for better classification (e.g. industry, company size).
Interviews are often recorded (audio or video) and subsequently transcribed; it must be ensured that data are encrypted and accessible only to authorised persons.
All collected data are subject to data protection regulations and corresponding retention periods.
| Data Type | Retention Period | Storage Location |
|---|---|---|
| Original audio recordings | At least 10 years | Encrypted, password-protected storage (local or university server) |
| Signed consent forms | At least 10 years | Secure physical or digital archiving |
| Transcripts (anonymised) | Can be archived longer | Can be used for teaching archives or secondary analyses |
| Mapping list (ID → name) | Can be deleted or anonymised after project | Separate, protected storage |
- Use of passwords and encryption (e.g. VeraCrypt, 7-Zip)
- Regular backups
- No storage on unsecured cloud platforms (Google Drive, Dropbox for sensitive data)
- Prefer local or university-owned storage
Recording and documentation
Standard: All qualitative interviews should be digitally audio-recorded. This enables:
- Complete data basis: No information loss through note-taking
- Controlled analysis: Multiple listening and contextualisation possible
- Intersubjective traceability: Other researchers can check coding
- Transcription: Basis for written analysis
Technical requirements:
- Recording device: Digital recorder, smartphone with recording app (e.g. "Voice Memos" on iOS, "Google Recorder" on Android) or laptop software
- Audio format: MP3 or WAV (lossless)
- Quality: Clear speech recording without background noise; microphone test before interview
- Backup: Copy immediately after interview to secure storage (e.g. university server, encrypted external drive)
Field notes and interview protocol
Parallel to recording, field notes should be made:
- Atmosphere and context: Brief notes on interview situation (location, time of day, visible interruptions/emotions)
- Special features: Noticeable points, pauses, technical problems, non-verbal signals
- Reflection: Interviewer's first impressions, possible hypotheses
These field notes are transferred after the interview into an interview protocol containing the following:
| Field | Example |
|---|---|
| Respondent ID | IP03 |
| Date and time | 2025-03-15, 14:30–15:45 |
| Duration | 1 hour 15 minutes |
| Location | Respondent's office, by phone, online (Zoom) |
| Special features | Multiple interruptions by phone calls; noticeably more relaxed at end than beginning |
| Recording quality | Good, minimal background noise |
| Notes | Respondent hesitant on conflict questions; repeatedly used circumlocution instead of direct answers |
Guide-based interviews can be conducted in different formats. The choice of format should be guided by the research question, organisational framework conditions and characteristics of the target group.
- Face-to-face interviews This form is regarded as the "classic" variant and offers the most intensive conversation situation. Personal contact allows consideration of non-verbal signals such as facial expressions, gestures or pauses, which can provide valuable additional information for interpreting answers. Moreover, personal encounter makes it easier to establish a trustworthy conversation atmosphere, which promotes openness of respondents. However, face-to-face interviews require higher organisational effort (e.g. scheduling and room coordination, travel).
- Telephone interviews Telephone interviews are location-independent and organisationally simpler to implement. They are particularly suitable when respondents are difficult to reach or have limited time to participate. However, visual impressions are missing, which means some communicative signals are lost. The conversation atmosphere can thus seem less personal, which can affect the depth of responses.
- Online interviews by video Videoconference systems combine advantages of face-to-face and telephone interviews. They enable direct exchange with eye contact and are still location-independent. Particularly for internationally distributed respondents, they are a practical solution. However, technical problems (connection failures, sound or image disruptions) can impair conversation flow. Also note that not all participants have the necessary technical equipment or familiarity with the tools.
- Email interviews—not actually interviews Written interviews conducted by email differ methodologically fundamentally from oral interview forms. Since follow-up questions and spontaneous enquiries are not possible here, a central feature of the interview—interactivity—is lost. Answers often remain shorter, more carefully controlled or formally phrased. Whilst email interviews offer advantages such as temporal flexibility and the opportunity for respondents to formulate their statements thoughtfully, they do not meet the actual purpose of the interview procedure. Interviews thrive on the dynamics of a conversation that can address new aspects and deepen content. This dimension is absent in email interviews, so they are better regarded as written surveys rather than interviews in the strict academic sense.
Transcription & anonymisation of the interview
An essential step in qualitative interview research is transcription. This refers to the transfer of spoken language into written form to enable systematic analysis. Transcription forms the basis for evaluation procedures such as qualitative content analysis, Grounded Theory or discourse analysis. Different transcription standards exist, chosen according to research interest:
| Type | Explanation | Example |
|---|---|---|
| Verbatim transcription | Every utterance is transcribed exactly as spoken, including pauses, filler words and slips of the tongue. Suitable for analyses where linguistic nuances, interactions and expressions are relevant. | "Um… so I, uh, think that we, um, actually did the project pretty well." |
| Smoothed transcription | The spoken text is linguistically corrected and smoothed without changing meaning. More readable when focus is on content statements. | "I think we actually did the project pretty well." |
| Extended transcription | In addition to spoken words, non-verbal signals or particular emphases are documented. Helpful for analyses examining communication patterns or conversation dynamics. | "I think we actually did the project [laughs] pretty well. (Pause, 3 seconds)" |
Recommendation for Bachelor's/Master's work: Smoothed transcription—time and cost-efficient, sufficient for qualitative content analysis and category formation.
Transcripts serve primarily as working material for analysing qualitative data. They make interviews systematically evaluable, as spoken language is converted into written form that can be processed with methodological procedures (e.g. qualitative content analysis, Grounded Theory, discourse analysis). Without a transcript, it would be scarcely possible to code statements precisely, form categories or reconstruct conversation structures.
Transcription conventions
To ensure consistency, uniform conventions are used:
Standard transcription rules (smoothed):
1. Verbatim transcript
- Every word is captured verbatim
- Speaker changes marked (e.g. "I: Interviewer", "R: Respondent")
2. Punctuation
- Sentences grammatically correctly closed with full stop, comma, question mark
- Dashes (–) for unfinished sentences: "I actually wanted to –"
3. Pauses and special characters (only in extended transcription)
- (…) for longer pauses (>2 seconds)
- […] for incomprehensible passages
4. Speaker name format
- I: (for Interviewer)
- R: or IP01, IP02, etc. (for Respondent, optionally with ID number)
5. Paragraphs
- New paragraphs for significant topic changes
- Numbering of paragraphs for citability: [1], [2], etc.
Example excerpt (smoothed):
[1] I: You mentioned that the shift to remote work was a challenge. Can you give me a concrete example?
[2] R: Yes, especially at the beginning. We had no clear structures. Meetings were called spontaneously without warning. I sat at home and didn't know when the next conference would start.
[3] I: And how did you manage that?
[4] R: Eventually I started keeping a calendar and writing all times in it. That helped.
File management and naming
To ensure consistency and traceability, transcript files are named according to a uniform schema:
File naming format:
TXX_IPXX_YYYY-MM-DD.pdf
Explanation:
- T01, T02, T03, …—Sequential number of transcripts (order of conduct)
- IP01, IP02, IP03, …—Participant ID (not the real name!)
- YYYY-MM-DD—Interview date (ISO format)
- .pdf—File format (transcripts are archived as PDF)
Examples:
T01_IP01_2025-03-10.pdf—First interview, Participant 1, 10 March 2025T07_IP05_2025-04-02.pdf—Seventh interview, Participant 5, 2 April 2025
Storage structure (example):
Project_Folder/
├─ Transcripts/ (working copies, local backup)
│ ├─ T01_IP01_2025-03-10.pdf
│ ├─ T02_IP02_2025-03-12.pdf
│ └─ T03_IP03_2025-03-15.pdf
├─ Audio_Recordings/ (encrypted, separate backup)
│ ├─ T01_IP01_2025-03-10.mp3
│ ├─ T02_IP02_2025-03-12.mp3
│ └─ T03_IP03_2025-03-15.mp3
├─ Mapping_List_ENCRYPTED/ (store separately!)
│ └─ ID_Names_Mapping.xlsx (password-protected)
├─ Consent_Forms/ (original documents, secure archiving)
│ ├─ Consent_IP01.pdf
│ └─ Consent_IP02.pdf
└─ Guide_and_Codebook/
├─ Interview_Guide_final.pdf
└─ Coding_Guide.pdf
Publication and archiving of transcripts
However, publication of complete transcripts in academic papers is not standard practice. There are several reasons for this:
- Data protection and confidentiality: Transcripts often contain sensitive or personal data whose publication would be ethically and legally problematic.
- Space constraints: Space in academic journals or theses for extensive interview texts is limited.
- Work focus: Scientific value lies in the analysis, not in complete reproduction of all conversation content.
Instead of complete transcripts, academic work typically uses direct quotations that are representative of specific topics, categories or lines of argument. These quotations are integrated into the analysis and contextualised. Many qualitative studies use instead of detailed presentation (e.g. "(Interview, project lead, own research, 2025)") simplified codes or abbreviations to improve readability and identify interview partners anonymously. Typical are I1, I2, I3 … (for Interview 1, 2, 3), P1, P2 … (for Person 1, 2) or IP_A, IP_B … (for Interview Partner A, B).
Example of presentation of anonymised interview participants:
ID Age Role/Function Segment/Organisational Type Experience (Years) Region/Country Recruitment Interview Date Duration Mode IP01 34 Project Lead Energy Efficiency Residential property management (long-term holder) 9 DACH Industry association 2025-02-10 58 min Video conference IP02 46 Technical Lead Commercial real estate (asset management) 20 DACH Expert network 2025-02-13 72 min Face-to-face IP03 29 ESG Analysis Real estate fund (open-ended) 5 EU Snowball 2025-02-18 54 min Telephone
Note: The selection of variables (e.g. role/function, segment/organisational type, experience, region and interview mode) is guided by the research questions and substantive focal points of the study. This ensures that contextual information supports the analysis without allowing conclusions about specific people or organisations. It is important to include only those characteristics relevant to interpretation of responses.
Example formulations for (non-)publication of transcripts in academic work:
- Interviews were fully transcribed but serve only as the basis for analysis. Within the work, only selected, anonymised quotations are published to illustrate the argument.
- For data protection reasons, publication of complete transcripts is not undertaken. Key passages are integrated in anonymised form into the evaluation.
- The anonymised transcripts were archived in a protected research data repository and can be viewed there under controlled conditions for replication studies.
When research data are to be made transparently accessible, for example for Open Science and replication studies, (anonymised) transcripts can be deposited in research data repositories. Access is often controlled and permitted only for academic purposes.
Coding, category formation and quality assurance
- Deductive coding (theory-driven)
- Category system is developed before analysis (based on theory, research questions or previous studies)
- Data are sorted into these predetermined categories
- Advantage: Efficient, comparable
- Disadvantage: Emergent phenomena may be overlooked
- Inductive coding (data-driven)
- Categories emerge from the data themselves during coding
- Open, flexible approach
- Advantage: New, surprising findings
- Disadvantage: Time-consuming, requires high coding discipline
Recommendation for Bachelor's/Master's work: Hybrid approach—based on research-question-driven basic structure (deductive) with openness to new categories (inductive).
The coding guide
A coding guide (codebook) is structured documentation of all coding categories. It contains:
| Element | Description | Example |
|---|---|---|
| Category name | Unique, concise designation | Time shortage as barrier |
| Definition | Brief, precise explanation of what this category captures | "Statements in which time pressure is presented as an obstacle to a task or goal" |
| Inclusion criteria | How do I recognise that a text passage belongs to this category? | Explicit mention of time resource shortage, deadline pressure, tight schedules |
| Exclusion criteria | When does something NOT belong to this category? | Mere time statements without negative context (e.g. "The interview lasted one hour") |
| Anchor examples | 1–2 concrete text passages from interviews that perfectly represent this category | "I would have liked more preparation time, but it's simply not possible." |
| Coding rules | Special-case notes for ambiguous text passages | If time shortage is mentioned but not presented as a problem → do not code |
Coding guide template (minimal version for Bachelor's theses):
CODING GUIDE: [Project name] Category 1: Time shortage as barrier Definition: Statements in which time pressure is presented as an obstacle to a task. Inclusion: Explicit time resource constraints Exclusion: Mere time statements without negative context Anchor example: "I would have liked more preparation time, but it's simply not possible." Category 2: Team cohesion Definition: Statements about positive or negative relationships, trust or conflicts within the team. Inclusion: Colleague support, conflicts, collaboration Exclusion: Mere mention of colleague names without relational dimension Anchor example: "The collaboration with my team is the best thing about my job." […further categories…]
The final coding guide is submitted as an appendix to the work.
Example of a coding table:
Main Category Subcategory Definition (Coding Rule) Anchor Example (in vivo or Paraphrase) Inclusion Criteria Exclusion Criteria Memo/Notes Regulatory Drivers EU/national regulation Utterances referring to laws, directives or funding programmes that steer decisions "We prioritised heat pumps because of the new funding requirements" References to regulation, funding, standards (e.g. EPBD, Taxonomy) General market trends without regulatory reference Check for specific policy instruments Economic Viability CAPEX Considerations Statements on initial investment costs influencing decisions "Heat pump CAPEX is 30% over our budget" References to investment costs, CAPEX budgets, funding dependency Operating costs, maintenance without reference to acquisition costs Specify currency and year Economic Viability OPEX and Amortisation Statements on operating costs and expected/observed amortisation or ROI "Lower O&M lead to a four-year amortisation of LED retrofit" Energy costs, maintenance costs, amortisation time, ROI, LCOE Pure CAPEX topics or financing structure Note assumptions on amortisation
Note: If the coding table is too extensive for full inclusion in body text, it is advisable to present an exemplary excerpt in the text and place the complete table in the appendix.
Coding process
Practical procedure:
- First coding round (open): All transcripts are systematically reviewed; each relevant text passage is assigned a category. New categories are added if they emerge.
- Category review: After the first 2–3 transcripts, the category list is reviewed and refined as needed (merging similar categories, splitting overly broad categories).
- Systematic coding: All remaining transcripts are coded with the refined system.
- Recoding: After 2–4 weeks, 1–2 already-coded transcripts are recoded to check consistency (see section 4.7.6).
Quality assurance of coding
In university research projects with single coders (standard in Bachelor's/Master's theses), classical "intercoder agreement" (multiple coders compare) is often unrealistic. Instead, student-friendly quality assurance procedures are used:
- Recoding Reliability
- A random selection of 10–15% of the material is fully recoded after 2–4 weeks.
- The first codings and the second codings are compared: do the codes match?
- Agreement rate is calculated: (number of matches / total number of codes) × 100
- Target: ≥ 80% agreement
- This demonstrates that coding categories are consistently applied. Example:
- Coding 1 (first time): 45 codes assigned
- Coding 2 (after 3 weeks): 44 codes assigned, of which 40 identical to Coding 1
- Agreement: 40/45 = 88.9% ✓
- Colleague Check (Peer Coding)
- A trusted person (study colleague, mentor, supervisor) codes 10–15% of the material independently using the same coding guide.
- Both codings are compared and differences discussed:
- Where do we agree? → Category is robust
- Where do we differ? → Category definition needs clarification
- Discussion leads to refinements of the coding guide
Documentation:
- What % was coded by peer?
- What was the agreement level?
- Which categories were subsequently refined?
Coding memos are notes made by the coder during and after coding. They document:
- Category decisions: Why was this text passage assigned to this category? Were there doubts?
- New insights: What surprising patterns emerge?
- Problematic cases: Which text passages don't clearly fit a category? → Potential improvement to definition
- Coding reflection: How fair and objective have I remained? Were there own biases?
Example coding memo:
Memo – Coding IP03, 2025-03-20
Text passage [34]: "The boss doesn't listen to me, that's the main problem."
Coded under: Communication Problems (Hierarchy)
Reflection: Could also be coded under "Leadership Deficits".
Decision: Under Communication, because focus is on listening.
Note for coding guide: Both categories are closely related, possibly merge?
New pattern observed: IP03 repeatedly emphasises that emotional support is important
(statements [12], [34], [48]). This category should feature more prominently in analysis.
These memos are referenced as an appendix to the work or in the methodology section.
Analysis procedures
After coding, categories and their relationships are analysed. Common procedures:
| Procedure | Focus | Output |
|---|---|---|
| Qualitative Content Analysis (Mayring) | Systematic category development and reduction | Category system with frequencies and relationships |
| Thematic Analysis (Braun & Clarke) | Thematic patterns and narratives | Thematic map |
| Grounded Theory | Theory development from data | Conceptual models and hypotheses |
| Phenomenological Analysis | Essential structures of experience | Dense descriptions |
Recommendation for Bachelor's/Master's work: Qualitative Content Analysis—systematic, traceable, not overly complex.
Presentation and interpretation
- Category overview: Tabular or visual presentation of category system with frequencies/weightings
- Detailed category analyses: For each central category: definition, frequency, representative quotations, interpretation
- Relationships between categories: Which categories occur together? Which contradict each other?
- Subgroup analyses (if relevant): Do patterns differ according to respondent characteristics?
- Synthesis and theory integration: Integration into existing literature; new insights
Example of integrating a quotation into academic text:
The findings show that interviewed project leads assess the course largely positively. One respondent emphasised: "I think we actually did the project pretty well." (IP01).
The findings show that interviewed project leads assess the course largely positively. One respondent emphasised: "I think we actually did the project pretty well." (IP02).
Several respondents reported similar approaches (IP01, IP03, IP07).
4.7.1 Use cases ^ top
Guide-based interviews are particularly suitable when:
- Subjective viewpoints and interpretations are central, which cannot be captured in fixed answer categories.
- Processes, experiences and backgrounds should be captured in detail, for example regarding decision pathways, motivations or action logics.
- Supplementary in-depth information is needed for quantitative surveys (mixed-methods designs).
- Complex topic areas should be examined in a structured yet flexible way, without abandoning the open character of qualitative research.
- Expert knowledge should be explored that cannot be represented through standardised scales.
4.7.2 Strengths and weaknesses ^ top
Strengths
- Flexibility: follow-up questions and deeper exploration are possible, allowing answers to be contextually refined.
- Proximity to research field: Interviews enable capture of subjective meanings and personal experiences.
- Structure: The guide ensures that central themes are comparably addressed across interviews.
- Deep understanding: Interaction between interviewer and respondent allows moving beyond superficial information.
Weaknesses
- Time and resource investment: Interviews must not only be conducted but also transcribed and evaluated in detail.
- Dependence on interviewer: Interview style, experience and conversational conduct influence results.
- Limited comparability: Despite the guide, interviews differ in depth and detail.
- Email interviews: Here the spontaneous dynamic is missing, follow-up questions are only possible to a limited extent, and responses often remain shorter or more carefully controlled. Moreover, misunderstandings can more easily go unnoticed, and return rates are heavily dependent on respondent motivation.
4.7.3 Common misconceptions / misunderstandings ^ top
A widespread misconception is that interviews are simply "conversations". In reality, they constitute a scientific method that pursues clear objectives, requires systematic planning and demands methodologically grounded evaluation.
It is often assumed that guide-based interviews are fully standardised. However, the guide only prescribes topic blocks and core questions—sequence and depth can be flexibly adapted.
Another misconception concerns email interviews. Some researchers view them as equivalent alternatives to oral interviews. In practice, however, direct interaction is missing: spontaneous follow-up questions, non-verbal signals and conversation dynamics are absent. Whilst email interviews offer advantages such as temporal flexibility and the opportunity for respondents to formulate answers thoughtfully, they are methodologically not equivalent to face-to-face or video interviews.
Finally, it is often overlooked that data protection and ethical standards also apply to interviews. Conversation content must be treated confidentially, personal data protected and consent forms obtained. Particularly with recordings (audio, video, transcripts), compliance with the General Data Protection Regulation (GDPR) is mandatory.
4.8 Text Analysis ^ top
Text analysis refers to the systematic scientific examination of texts that themselves constitute the object of study. It thus differs fundamentally from systematic reviews, which evaluate research literature. In text analysis, the focus is on primary texts, i.e. documents that convey content directly without having already been scientifically interpreted or examined. These include, for example, legal texts, regulations, contracts, political strategy papers, organisational guidelines, or minutes.
The aim of text analysis is to uncover the content structures, linguistic patterns, or argumentative logics of such texts. The analysis may be descriptive, comparative, or interpretative in nature. The key point is that the text is not used merely as a source of data, but as an independent research object from which scientifically relevant questions are developed and addressed.
There are different methodological approaches, depending on which aspects of texts are the focus: content, structures, argumentation patterns, or discourses.
| Type of Text Analysis | Characteristics | Typical Research Questions | Example |
|---|---|---|---|
| Qualitative Content Analysis | Systematic categorisation of content; structured approach (e.g. according to Mayring, Kuckartz) | Which topics, regulations, or contents systematically appear in texts? How are they distributed? | Structured analysis of a law according to regulatory sections |
| Comparative Text Analysis | Comparison of several texts or versions | How do laws in different countries differ? How has a regulation changed from an old to a new version? | Comparison of environmental laws in two countries |
| Argumentation Analysis | Analysis of logical and rhetorical structures in texts | How are laws or measures justified? Which argumentative patterns dominate? | Analysis of the justification of a law |
| Discourse Analysis | Texts as part of societal discourses; focus on framing, linguistic patterns, and power structures | How is a concept (e.g. "sustainability") linguistically framed? Which narratives are set in strategy papers? | Examination of policy strategy documents |
The four approaches often overlap in practice but pursue different research aims: while qualitative content analysis identifies structures, comparative text analysis focuses on similarities and differences. Argumentation analysis reveals the underlying logic of reasoning, and discourse analysis examines how texts are embedded in social and linguistic contexts. What they all share is the understanding of texts as primary research objects, analysed in a methodologically reflective way. Text analysis thus opens up the possibility of making institutional rules, linguistic framings, or argument-based legitimisations visible and comparable.
4.8.1 Areas of Application ^ top
Text analysis is particularly relevant when written documents are not merely used as background information but are treated as a central data source in their own right. It is suitable for research questions that address the content, structures, or meanings of institutional, legal, or organisational texts.
-
Analysis of laws and regulations
Text analyses can reveal differences between legal versions (before and after a reform) or systematically compare regulations across countries. They can also show which thematic areas are emphasised and how terms are legally defined or linguistically framed. -
Examination of contracts and guidelines
Organisational documents such as employment contracts, works agreements, or internal policies contain normative provisions that shape action. Text analysis can examine which duties, rights, or responsibilities are emphasised and how they are expressed linguistically. -
Evaluation of political strategy papers
Political programmes, national strategies, or international agreements contain objectives and patterns of reasoning that can be systematically examined through text analysis. This allows priorities, tensions, and normative frameworks to be identified. -
Comparison of institutional documents
Text analysis is useful for identifying similarities and differences between organisations, regions, or sectors. For example, sustainability reports from different institutions can be compared to highlight trends and shifts in discourse. -
Investigation of linguistic constructions and discourses
Terms such as "sustainability," "resilience," or "innovation" are often not clearly defined. Text analysis can examine how such terms are used in different documents and how they are loaded with specific meanings. This makes visible how language contributes to legitimising measures or shaping social reality. -
Analysis of reasoning structures
In justificatory texts (e.g. legal justifications, policy statements, or management reports), typical argumentative patterns can be studied. Text analysis enables researchers to assess the logic and consistency of these arguments and to detect differences between actor groups.
4.8.2 Strengths and Weaknesses ^ top
Strengths
- Availability of data: Texts such as laws, strategy papers, or contracts are often publicly accessible and do not need to be generated through primary data collection. This also makes it possible to include extensive and historical documents.
- Traceability: As texts represent stable data sources, analyses can usually be repeated or verified at any time. This increases transparency and replicability of research.
- Level of detail: Texts often contain a wealth of information - from normative regulations and linguistic nuances to implicit meanings. With suitable methods of analysis, these can be systematically examined.
- Comparability: Text analysis allows documents from different origins (e.g. countries, organisations, periods) to be compared, thereby highlighting developments or differences.
- Interdisciplinary relevance: The method is applicable in technical, economic, and social sciences alike, as documents serve as central instruments of governance across all fields.
Weaknesses
- Context dependency: Texts never exist in isolation but are embedded in political, legal, or organisational contexts. Without contextual knowledge, their meaning may easily be shortened or misunderstood.
- Room for interpretation: Especially qualitative text analyses require a reflective approach, as multiple interpretations are possible. The subjectivity of the researcher must be controlled through transparent methodology.
- Limited generalisability: Results relate to the specific documents analysed. They cannot automatically be generalised to all comparable texts or contexts.
- Effort: The systematic evaluation of extensive texts is time-consuming, particularly when large collections of documents or multiple versions are compared.
- Lack of completeness: Not all relevant texts are always accessible, for instance when organisations withhold internal documents. This may limit the explanatory power of the analysis.
4.8.3 Common Misconceptions ^ top
A common misconception is the assumption that texts "speak for themselves" and that their meaning can be directly understood without methodological reflection. In reality, every text is embedded in a social, political, and institutional context that is crucial for interpretation. Without such contextual knowledge, important meanings may be overlooked or misinterpreted.
It is also often believed that text analysis merely involves counting the frequency of terms. While quantitative measures such as word counts can provide useful indications, they are insufficient for scientific analysis. Only embedding texts within categories, discourses, or argumentative structures allows substantial insights to be gained.
Another misconception concerns the objectivity of text analysis. Precisely because texts are often complex and ambiguous, their analysis requires interpretative decisions. These are not "arbitrary," but they must be made transparent through methodological reflection. Ignoring the subjectivity of the researcher risks producing seemingly neutral but in fact biased results.
It is also frequently overlooked that texts alone are rarely sufficient to fully explain social or organisational phenomena. Text analysis can provide important insights but should, where possible, be complemented with other data sources (e.g. interviews, observations, statistical data) in order to achieve a more complete picture.
Finally, there is sometimes the assumption that text analysis is quick and straightforward because the data already exist. In practice, however, the systematic evaluation of extensive documents is time-intensive: categories must be developed, passages coded, and results interpreted.
5 Qualitative analysis and coding methods ^ top
Qualitative research typically produces extensive, text-based data: interview transcripts, open-ended questionnaire responses, observation notes, or primary texts such as laws, guidelines and strategy papers. These data contain meanings, relationships and lines of argument that cannot simply be "read off", but must be systematically uncovered. This is precisely where qualitative analysis and coding methods come in.
Coding refers to the process of assigning text segments (individual sentences, paragraphs or meaning units) to specific categories or codes. These categories can be derived in advance from theory or the interview guide (deductive), emerge directly from the material (inductive), or combine both (hybrid). The result is a structured category system that consolidates the central content of the material, making it comparable and interpretable.
There are various methods that differ in their starting logic, knowledge aim and form of output. Some are more rule-governed and focus on transparent category development (e.g., Mayring, Kuckartz); others aim to develop new theory from the data (Grounded Theory); still others emphasise systematic case comparison using a matrix (Framework Method) or iterative work with a provisional code tree (Template Analysis). Some assume an existing theoretical framework and test it against the material (Directed Content Analysis), while others deliberately work without a fixed starting structure and develop patterns of meaning recursively (Thematic Analysis).
Choosing a method is not about "better" or "worse", but about fit: Does the method suit the research question, the data type, the available resources and the intended knowledge aim? An exploratory study without a theoretical frame requires a different analytical logic than the empirical testing of an ESG framework; analysing a small number of in-depth interviews demands different tools than the systematic comparison of twenty cases in a team.
All seven methods described below are demonstrated using the same fictional text excerpt. This shows that different methods structure the same text differently — not because one is "right" and another "wrong", but because they pursue different knowledge aims, starting logics and output forms.
Shared fictional interview excerpt (common basis for all subsections)
"We decided on LED retrofitting because the payback period is under four years. The funding landscape tipped the balance. However, there were reservations in-house because some were worried about light quality. After a pilot on the fourth floor the feedback was positive, and we combined the tender to secure better terms. The data situation was difficult at first because meters were missing; we have since installed sub-metering and are seeing monthly savings of about 18%."
Overview ^ top
| Method | Starting logic | Knowledge aim | Typical output form |
|---|---|---|---|
| Mayring | deductive–inductive, rule-governed | Systematically structure content | Category report with rules and anchor quotes |
| Kuckartz | theme-based + inductive subcodes | Organise and compare themes | Theme matrices, case/theme profiles |
| Grounded Theory | purely inductive (open > axial > selective) | Develop theory from data | Process model, core category |
| Framework Method | thematic frame + matrix condensation | Compare cases systematically | Case x theme matrix |
| Template Analysis | provisional code tree, iteratively refined | Code themes consistently | Stabilised code tree + synthesis |
| Directed Content Analysis | theory-led + inductive additions | Test and extend framework/theory | Theory comparison with extensions |
| Thematic Analysis | flexible, recursive, no fixed start structure | Identify patterns of meaning | Themes with narratives and quotes |
5.1 Qualitative content analysis according to Mayring ^ top
Mayring’s qualitative content analysis is a rule-governed method for systematically organising text material (e.g., interviews) into themes and analysing it in a transparent, traceable way. Key features include clearly defined categories, concise coding rules with anchor examples, and a documented pilot phase. The method is particularly suitable when a structured analysis that can be reported transparently is required (e.g., in dissertations or team projects).
5.1.2 Procedure ^ top
| Step | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Analysis frame | Clarify focus | Define research question, material, unit of analysis | Question: "Which factors influence the decision and implementation of the LED retrofit?"; unit: meaning unit | Short protocol of analysis frame |
| 2. Initial categories | Provide structure | Derive top-level categories from theory/interview guide | Economics, regulation, acceptance, process/implementation, data/monitoring | Category system (v1) |
| 3. Coding rules | Standardise application | For each category: definition, inclusion/exclusion, anchor quote | Economics/payback: include statements on payback; exclude technology without cost link | Codebook (rules + quotes) |
| 4. Pilot coding | Test discrimination | Test-code 1–2 cases, adjust categories | Add "bundled tendering" as subcategory under process/procurement | Codebook (v2) |
| 5. Main coding | Ensure systematics | Full coding, memos on boundary cases | Assignments: payback, funding, quality concerns, pilot, procurement, sub-metering, 18% | Code matrix |
| 6. Condensation | Consolidate content | Paraphrase, generalise, reduce | Economics: short payback, scale effects; data: closing measurement gap > evidence | Category profiles |
| 7. Synthesis | Show relationships | Link categories, mark exceptions | Funding + payback > decision; pilot > acceptance ↑; monitoring > 18% evidenced | Results text with quotes |
| 8. Quality | Ensure traceability | Audit trail, peer debriefing, if needed intercoder check | Rule changes documented; subsample double-coded | Quality evidence |
Example codings (extract)
- "Payback under four years" > Economics > Payback
- "The funding landscape tipped the balance" > Regulation > Funding
- "Reservations ... light quality" > Acceptance > Quality concerns
- "Pilot ... feedback positive" > Process > Piloting/feedback
- "Tender combined" > Process > Procurement/bundling
- "Sub-metering ... 18%" > Data/monitoring > Metering infrastructure/result
5.1.3 Practical notes ^ top
- Justify categories: Briefly document how they were derived from the research question/theory.
- Keep rules concrete: One concise anchor quote per category increases reliability.
- Take the pilot seriously: Even one or two cases reveal where de*finitions need sharpening.
- Reflect on limit: Mayring strongly structures content; for theory-building process logics, Grounded Theory is more suitable, and for case x theme comparisons, the Framework Method fits better.
5.1.4 Distinction ^ top
Mayring’s qualitative content analysis is characterised by its rule-governed systematics. Coding rules, anchor examples and inclusion/exclusion criteria make category assignments verifiable. This sets it apart from more flexible approaches (e.g., Thematic Analysis) or more theory-building procedures (e.g., Grounded Theory).
| Dimension of comparison | Mayring | Kuckartz | Grounded Theory | Framework | Template | Directed | Thematic Analysis |
|---|---|---|---|---|---|---|---|
| Starting logic | deductive–inductive, rule-governed | theme-based + inductive | purely inductive (open) | thematic frame + matrix | provisional code tree | theory-led + inductive additions | flexible, recursive |
| Coding rules | explicit (definition, inclusion/exclusion, anchor) | definitions + anchors | no fixed rules, constant comparison | indexing + charting rules | template definitions | framework definitions + addition rules | no fixed rules, reflexivity as principle |
| Output form | Category report with rules and quotes | Theme matrices, profiles | Process model/theory | Case x theme matrix | Code tree + synthesis | Theory comparison with extensions | Themes with narratives and quotes |
| When to prefer Mayring? | When transparent, rule-based category development is central; well-suited for theses needing replicability |
5.1.5 Sources and further information ^ top
-
Mayring, P. (2015). Qualitative Inhaltsanalyse: Grundlagen und Techniken (12. Aufl.). Beltz.
-
Mayring, P. (2014). Qualitative content analysis: Theoretical foundation, basic procedures and software solution. Klagenfurt University. https://nbn-resolving.de/urn:nbn:de:0168-ssoar-395173
-
Mayring, P. (2000). Qualitative content analysis. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 1(2), Art. 20. https://doi.org/10.17169/fqs-1.2.1089
5.2 Qualitative content analysis according to Kuckartz ^ top
Kuckartz’s qualitative content analysis combines a theme-oriented basic structure with inductive elaboration. The starting point is a small set of clearly named top-level themes (often drawn from the research question or interview guide). These are refined during the analysis by developing data-driven subcategories and sharpening their definitions. The method is practical, well-documented and particularly suitable for semi-structured interviews, open-ended survey responses and team-based analyses (e.g., using matrices).
5.2.1 Core principle ^ top
- Top-level themes provide the initial structure (deduction).
- Subcategories emerge from the material (induction).
- The outcome comprises thematic profiles, case x theme matrices, and clearly traceable categories with short definitions and example quotes.
5.2.2 Procedure ^ top
| Phase | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Create theme overview | Translate guide/research questions into top-level themes | Name 5–10 top-level themes | Economics, regulation, acceptance, process/implementation, data/monitoring | Theme list |
| 2. Initial broad coding | Structure material along top-level themes | Assign relevant passages to top-level themes | "Payback < 4 years" > economics; "funding landscape" > regulation | Broad code matrix |
| 3. Develop inductive subcategories | Data-driven differentiation | Generate subcodes within each top-level theme | Economics > payback; process > pilot, procurement/bundling; data > measurement gap, sub-metering, result (18%) | Hierarchical code tree (v1) |
| 4. Sharpen definitions (pilot) | Check discrimination and fit | Fine-code pilot case(s); refine rules | Define subcode "quality concerns" (acceptance); add anchor quote | Codebook (v2) |
| 5. Main coding | Ensure consistent application across all material | Complete fine-coding; write memos on boundary cases | All relevant segments coded; uncertainties noted | Complete code matrix |
| 6. Case- and theme-based analysis | Reveal patterns and differences | Profiles by case/theme; optionally a case x theme matrix | Sequence in "process" theme: pilot > positive feedback > bundled tender | Theme/case profiles, matrix |
| 7. Visualisation and reporting | Transparent presentation | Code tree, tables, quotes; condensation per theme | Short reports per top-level theme with 2–3 supporting quotes | Results report |
| 8. Quality assurance | Ensure traceability | Audit trail, peer feedback, intercoder where appropriate | Rule changes documented; consensus coding | Quality evidence |
Example code tree (extract)
- Economics
- Payback < 4 years
- Economies of scale/bundling
- Regulation
- Funding as trigger
- Acceptance
- Quality concerns
- Positive feedback (pilot)
- Process/implementation
- Piloting
- Procurement/bundling
- Roll-out
- Data/monitoring
- Measurement gap
- Sub-metering
- Result indicator (18% savings)
Example codings (same text, thematically differentiated)
- "Payback under four years" > Economics > Payback < 4 years
- "The funding landscape tipped the balance" > Regulation > Funding as trigger
- "Reservations ... light quality" > Acceptance > Quality concerns
- "Pilot ... feedback positive" > Acceptance > Positive feedback (pilot)
- "Tender combined" > Process/implementation > Procurement/bundling
- "Meters missing ... sub-metering ... 18%" > Data/monitoring > Measurement gap; sub-metering; result indicator
5.2.3 Practical notes ^ top
- Justify top-level themes: Derive them from the research question/interview guide and document briefly.
- Use subcategories sparingly but distinctly: Not every nuance becomes a subcode; aim for clarity and comparability.
- Use matrix thinking: The case x theme matrix simplifies comparisons, especially with multiple interviews.
- Select quotes deliberately: Representative, anonymised, with minimal context.
- Delimitation: Kuckartz resembles Mayring in systematics but places stronger emphasis on thematic phase work and subsequent matrix/profile analysis. For theory-building process models, Grounded Theory is more suitable; for theory-/framework-led tests, use Directed Content Analysis.
5.2.4 Distinction ^ top
Kuckartz shares the basic idea of categorical content analysis with Mayring, but places greater emphasis on a thematic phase model and systematic work with matrices (cases x themes). This makes Kuckartz particularly suitable for semi-structured interviews where top-level themes are given and subcategories are elaborated in a data-driven way.
| Dimension of comparison | Kuckartz | Mayring | Grounded Theory | Framework | Template | Directed | Thematic Analysis |
|---|---|---|---|---|---|---|---|
| Starting logic | Top-level themes (interview guide) + inductive subcodes | deductive–inductive, rule-governed | purely inductive | thematic frame + matrix | provisional code tree | theory-led | flexible, recursive |
| Phase structure | clearly phased (broad > fine > matrix) | stepwise, less phase-centred | iterative, emergent | indexing > charting > mapping | template > pilot > adjustment > application | deductive > fill gaps inductively | six recursive phases |
| Matrix focus | central (cases x themes) | more secondary | not foreseen | central (charting) | not mandatory | not mandatory | not mandatory |
| When to prefer Kuckartz? | When the interview guide defines clear themes and a matrix-based comparison is desired |
5.2.5 Sources and further information ^ top
-
Kuckartz, U. (2018). Qualitative Inhaltsanalyse: Methoden, Praxis, Computerunterstützung (4. Aufl.). Beltz Juventa.
-
Kuckartz, U., & Rädiker, S. (2022). Qualitative content analysis: Methods, practice and software (2nd ed.). SAGE.
5.3 Grounded Theory according to Glaser/Strauss, Strauss/Corbin, Charmaz ^ top
Grounded Theory is an inductive approach for developing theory from data. Instead of pre-set categories, the focus is on discovered concepts, relationships and process logics. Key features are open, axial and selective coding (emphasised differently across schools), constant comparison, memos as a thinking and documentation tool, and — ideally — theoretical sampling, i.e., adjusting data collection case by case to test emerging concepts.
5.3.1 Core principle ^ top
- Start openly: Develop concepts directly from the material (in vivo/process-near codes).
- Work out relationships: Link causes, conditions, strategies and consequences.
- Condense into theory: Identify a core category and an explanatory model.
5.3.2 Procedure ^ top
| Phase | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Open coding | Name phenomena close to the wording | Create line-by-line/segment-by-segment codes (often verbs/processes) | "funding-induced decision", "economic justification", "quality-related concerns", "pilot validation", "scaling through bundling", "closing the measurement gap", "reporting evidence (18%)" | Initial list of concepts, close to the data |
| 2. Constant comparison | Sharpen concepts | Compare codes across segments/cases; merge similar ones, test boundaries | "Pilot validation" vs "reporting evidence" > different process steps (testing vs communicating) | Merged/differentiated concepts |
| 3. Axial coding (Strauss/Corbin) | Structure relationships | Model conditions, context, action strategies, consequences | Condition: funding/payback > Strategy: pilot, bundling, metering expansion > Consequence: acceptance ↑, 18% savings | Category network (relationship model) |
| 4. Selective coding | Core category and storyline | Identify a central category that integrates the others | "Evidence-based legitimation of efficiency measures under regulatory–economic pressure" | Provisional theoretical explanation |
| 5. Theoretical sampling (ideal) | Test/extend concepts | Add cases purposefully to probe variations/extremes | Additional interviews where funding is absent, paybacks are longer, pilot experience negative | Data extension towards theoretical saturation |
| 6. Memos & theoretical saturation | Reflect and condense | Write memos on concepts, relationships, open questions; check whether new data still add novelty | Memo: "Bundling as a scaling strategy — when do returns diminish?" | Documented decisions and thinking steps |
| 7. Theory formulation | Report explanatory model | Define concepts, justify relationships, state conditions/variants | Process model of decision/implementation with paths and conditions | Substantive theory (context-specific) |
Example: From open code to core category (extract)
- Open codes: funding-induced decision; economic justification (payback < 4y); quality-related concerns; pilot validation; scaling through bundling; closing the measurement gap; reporting evidence (18%).
- Category bundles (axial):
- Conditions: funding landscape, economic threshold (payback)
- Strategies: pilot > acceptance; procurement bundling > terms; sub-metering > evidence
- Consequences: positive feedback; documented savings
- Core category (selective): "Evidence-based legitimation of efficiency measures under regulatory–economic pressure"
5.3.3 Practical notes ^ top
- Safeguard openness: Keep terms close to the data at first; avoid premature theory steering. - Take memos seriously: They are the memory of the analysis (ideas, doubts, decisions).
- Theoretical sampling is the gold standard: Often limited in theses; be transparent about constraints.
- Note variants: Glaser stresses emergence and minimal pre-structuring; Strauss/Corbin structure with axial coding; Charmaz emphasises constructivist reflexivity.
- Suitability: GT is appropriate when explaining processes/mechanisms. For strongly structured, teaching-/assessment-friendly category schemes, Mayring/Kuckartz are often more efficient; for case x theme comparisons, the Framework Method is practical.
5.3.4 Distinction ^ top
Grounded Theory differs fundamentally from the other approaches because it aims not to structure existing content but to develop new theory from data. Open, axial and selective coding, constant comparison and memos are not optional extras but constitutive elements.
| Dimension of comparison | Grounded Theory | Mayring | Kuckartz | Framework | Template | Directed | Thematic Analysis |
|---|---|---|---|---|---|---|---|
| Knowledge aim | Develop theory from data | Structure content | Organise and compare themes | Compare cases systematically | Code themes consistently | Test/extend a framework | Identify patterns |
| Origin of categories | purely from data (inductive) | deductive–inductive | deductive + inductive | deductive + inductive | deductive + iterative | deductive + inductive additions | inductive/recursive |
| Coding logic | open > axial > selective | rule-governed | phased model | indexing > charting | template > adaptation | framework > addition | codes > themes |
| Distinctive feature | theoretical sampling, memos as "engine" | coding rules + anchors | matrix logic | case x theme matrix | code tree iteration | theory comparison | six recursive phases |
| When to prefer GT? | When a process/mechanism model is to be developed and sufficient resources (time, cases) are available |
5.3.5 Sources and further information ^ top
-
Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Aldine.
-
Strauss, A. L., & Corbin, J. M. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). SAGE.
-
Corbin, J. M., & Strauss, A. L. (2015). Basics of qualitative research: Techniques and procedures for developing grounded theory (4th ed.). SAGE.
-
Charmaz, K. (2014). Constructing grounded theory (2nd ed.). SAGE.
5.4 Framework Method according to Ritchie & Spencer ^ top
The Framework Method is a transparent, matrix-based approach to qualitative analysis, particularly suited to teamwork, case comparison and practice-/policy-oriented studies. Its hallmarks are a clearly defined thematic framework, systematic indexing (coding) of the material, and "charting": the structured summarisation of content in a case x theme matrix. This makes it possible to identify patterns, contrasts and exceptions across cases and themes.
5.4.1 Core principle ^ top
- Define the thematic framework (deductively from guide/theory, refine inductively as needed).
- Index (code) text passages and condense them into a matrix.
- In the matrix (cases x themes), "map" and interpret patterns, relationships and exceptions.
5.4.2 Procedure ^ top
| Phase | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Define thematic framework | Create an orienting grid | Derive top-level themes from research question/guide; add openly as needed | Economics, regulation, acceptance, process/implementation, data/monitoring | Framework (version 1) |
| 2. Indexing (coding) | Systematic assignment | Assign text passages to themes (and sub-themes) | "Payback < 4 yrs" > economics; "funding landscape" > regulation; "concerns about light quality" > acceptance; "pilot"/"bundling" > process; "sub-metering/18%" > data | Indexed transcripts |
| 3. Charting (matrix) | Condensation by case and theme | Enter paraphrased key points into matrix cells; note anchor quotes | Cell "Case A x Economics": "Payback < 4 yrs; bundling as scale effect" (quote ID) | Case x theme matrix |
| 4. Mapping & interpretation | Identify patterns, contrasts, relationships | Read across cells: find clusters, sequences, exceptions | Sequence: funding + payback > decision; pilot > acceptance ↑; data > evidence (18%) | Interpretive mapping |
| 5. Reporting | Transparent presentation | Describe patterns, insert exemplar quotes, reflect on limits | Thematic summary with matrix excerpts | Results report |
Example: Extract from a case x theme matrix (compact, one case)
Theme Condensed statement (paraphrase) Anchor quote/note Economics Payback < 4 years; cost advantages through bundled tendering "...payback under four years..."; "...tender combined..." Regulation Funding framework as trigger "...funding landscape tipped the balance..." Acceptance Initial concerns about light quality; pilot generates positive feedback "...concern... light quality..."; "...feedback positive..." Process/implementation Pilot on 4th floor; roll-out via bundled procurement "...pilot... fourth floor..." ; "...tender combined..." Data/monitoring Initial measurement gap; sub-metering; 18% monthly savings "...meters missing... sub-metering... 18%..."
Strengths and limitations
- Strengths:
- High transparency and excellent for teams (matrix as shared reference point).
- Very good for case comparisons, policy/programme research and review syntheses.
- Good balance of deductive structure and inductive refinement.
- Limitations:
- Risk of "over-condensation" if summarised too strongly too early.
- Less suitable when deep, theory-building interpretation (à la Grounded Theory) is the main goal.
- Requires disciplined documentation (paraphrases + quote anchors).
5.4.3 Practical notes ^ top
- Charting is a summary, not transcription: Paraphrase + quote ID (transcript location) ensures traceability.
- Mind the sequence: Index carefully first, then condense. Summarising too early weakens discrimination.
- Use the comparison logic: The matrix supports pattern detection across multiple cases (common/divergent trajectories).
- Fit for purpose: With multiple interviews/cases and practice-oriented questions (organisations, programmes, measures), the Framework Method is particularly efficient. For strictly theory-led tests, Directed Content Analysis can be used in addition.
5.4.4 Distinction ^ top
The Framework Method stands out through its consistent matrix logic (cases x themes) and charting as a distinct condensation step. It is particularly team-friendly and geared towards systematic case comparison.
| Dimension of comparison | Framework | Mayring | Kuckartz | Grounded Theory | Template | Directed | Thematic Analysis |
|---|---|---|---|---|---|---|---|
| Form of condensation | Case x theme matrix (charting) | Category reports | Theme/case matrices | Relationship model | Code tree + synthesis | Framework comparison | Themes + narratives |
| Case comparison | central purpose | possible, not core | well supported (matrix) | not primary | possible | possible | possible |
| Team suitability | very high (matrix as shared reference) | medium | good | requires GT experience | good | good | medium |
| Charting as step | yes, explicitly | no | similar (matrix logic) | no | no | no | no |
| When to prefer Framework? | With multiple cases/interviews, teamwork, policy/programme research, and when transparent, tabular results are needed |
5.4.5 Sources and further information ^ top
-
Ritchie, J., & Spencer, L. (1994). Qualitative data analysis for applied policy research. In A. Bryman & R. G. Burgess (Hrsg.), Analyzing qualitative data (S. 173–194). Routledge.
-
Ritchie, J., Lewis, J., Nicholls, C. M., & Ormston, R. (Hrsg.). (2014). Qualitative research practice: A guide for social science students and researchers (2nd ed.). SAGE.
-
Gale, N. K., Heath, G., Cameron, E., Rashid, S., & Redwood, S. (2013). Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Medical Research Methodology, 13(1), Art. 117. https://doi.org/10.1186/1471-2288-13-117
5.5 Template Analysis according to King ^ top
Template Analysis is a flexible yet structured approach to qualitative analysis. It works with a provisional "template" (code tree) of top-level categories derived from theory, the research question or the interview guide. This template is piloted on part of the material, iteratively refined (adding, renaming, restructuring), and then applied consistently to the entire dataset. The method is particularly suitable for semi-structured interviews and contexts where a balanced mix of structure and openness is needed.
5.5.1 Core principle ^ top
- Start with a manageable, well-justified code tree (template).
- Use pilot coding to check fit and guide targeted development.
- Apply the stabilised template consistently; report results along the template.
5.5.2 Procedure ^ top
| Phase | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Set up a provisional template | Create structure | Derive 5–10 top-level categories from research question/theory | Economics, regulation, acceptance, process/implementation, data/monitoring | Template (v1) |
| 2. Pilot coding | Check fit and find gaps | Code part of the material; note ambiguities | "Bundled tendering" missing as a subtheme; "quality concerns" needs sharpening | Documented need for changes |
| 3. Refine the template | Increase discrimination | Add/rename/re-nest categories | Process > piloting; Process > procurement/bundling; Acceptance > quality concerns/feedback | Template (v2, stabilised) |
| 4. Main coding | Ensure consistency | Apply the stabilised template to all material; memos for boundary cases | Assignments: payback, funding, quality concerns, pilot, procurement, sub-metering, 18% | Complete code matrix |
| 5. Thematic synthesis | Report results along the template | Summarise by top-/sub-category, add quotes, work out patterns | Economics: short payback + scale effects; Process: pilot > positive feedback > bundled tendering | Thematic reports (structured output) |
| 6. Quality assurance | Ensure traceability | Version the template, document rule changes; peer review/intercoder optional | Log of changes (v1 > v2) | Template audit trail |
Example: Stabilised template (extract)
- Economics
- Payback < 4 years
- Economies of scale/bundling
- Regulation
- Funding as trigger
- Acceptance
- Quality concerns
- Positive feedback (pilot)
- Process/implementation
- Piloting
- Procurement/bundling
- Roll-out
- Data/monitoring
- Measurement gap
- Sub-metering
- Result indicator (18% savings)
Example codings (same text, template-guided)
- "Payback under four years" > Economics > Payback < 4 years
- "Funding landscape ... tipped the balance" > Regulation > Funding as trigger
- "Reservations ... light quality" > Acceptance > Quality concerns
- "Feedback positive" > Acceptance > Positive feedback (pilot)
- "Tender combined" > Process/implementation > Procurement/bundling
- "Sub-metering ... 18%" > Data/monitoring > Sub-metering; result indicator
Strengths and limitations
- Strengths:
- Good balance of structure (template) and openness (targeted adjustment).
- Efficient for semi-structured interviews; team-friendly due to a clear code tree.
- Iterations are explicitly planned and easy to document.
- Limitations:
- An overly pre-structured starting template can create blind spots.
- Too many changes hinder consistency; too few may overlook relevant aspects.
- Less suitable when radical theory-building from data (without pre-structure) is central — Grounded Theory fits better here.
5.5.3 Practical notes ^ top
- "Less is more" at the start: prefer a few, clearly justified top-level categories.
- Document changes: briefly justify each template adjustment (what, why, evidence).
- Ensure consistency: after stabilisation (v2), avoid structural changes; record ambiguities via memos.
- Align reporting: link the structure of the results section to the template (maintain clear through-lines).
- Delimitation: Template Analysis resembles Kuckartz in thematic organisation but emphasises explicit work with a provisional code tree adjusted in a pilot phase. For policy/case comparisons, the Framework Method is a useful complement; for theory-led tests, use Directed Content Analysis.
5.5.4 Distinction ^ top
Template Analysis shares with Mayring/Kuckartz the use of starting categories, but places stronger emphasis on iterative work with an explicit, provisional code tree (template) that is purposefully adjusted during a pilot phase.
| Dimension of comparison | Template | Mayring | Kuckartz | Grounded Theory | Framework | Directed | Thematic Analysis |
|---|---|---|---|---|---|---|---|
| Starting structure | Provisional code tree (template) | Deductive categories + rules | Theme list + phases | No pre-structure | Thematic frame + matrix | Theory framework | No fixed starting structure |
| Iteration | Explicit (template v1 > v2 > ...) | Pilot coding, less iterative | Pilot coding, phase-based | Constant comparison | Frame seldom changed | Frame supplemented | Recursive across six phases |
| Flexibility | Medium (template as anchor) | Lower (rules fixed early) | Medium | High | Lower (matrix fixed early) | Lower (framework guides) | High |
| When to prefer Template? | When an initial theoretical frame/guide should serve as a starting point but room for systematic adjustment is desired |
5.5.5 Sources and further information ^ top
-
King, N. (2012). Doing template analysis. In G. Symon & C. Cassell (Hrsg.), Qualitative organizational research: Core methods and current challenges (S. 426–450). SAGE.
-
King, N., & Brooks, J. M. (2017). Template analysis for business and management students. SAGE.
-
King, N., Brooks, J. M., & Tabari, S. (2018). Template analysis in business and management research. In M. Ciesielska & D. Jemielniak (Hrsg.), Qualitative methodologies in organization studies (Bd. 2, S. 179–206). Palgrave Macmillan. https://doi.org/10.1007/978-3-319-65442-3_8
5.6 Directed Content Analysis according to Hsieh & Shannon ^ top
Directed Content Analysis is a theory- or framework-led approach to qualitative content analysis. It starts from predefined categories drawn from an existing model, standard or theory (e.g., ESG framework, policy logic, technology model). These starting categories are applied deductively to the material. Where segments do not fit or new aspects appear, supplementary subcategories are added inductively. DCA is particularly suited to testing, extending or sharpening concepts.
5.6.1 Core principle ^ top
- Deductive start: define theory/framework categories and use them as a grid.
- Supplementary induction: add subcategories for gaps or novel phenomena.
- Outcome: framework–data comparison with clearly documented extensions.
5.6.2 Procedure ^ top
| Phase | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Define the framework | Set theory-based starting categories | Derive categories from theory/model | Regulatory drivers; economics; stakeholder acceptance; implementation; data/monitoring | Start codebook (v1) |
| 2. Specify coding rules | Ensure consistency | Draft short definitions + anchor quotes | Economics: statements on costs/payback; Implementation: pilot/procurement | Codebook with rules |
| 3. Deductive coding | Test the theory | Code text along starting categories | "Funding landscape" > regulatory drivers; "payback < 4 yrs" > economics | Code matrix (deductive) |
| 4. Inductive additions | Expose gaps | Create new subcodes for non-fitting segments | "Bundled tendering" > Implementation: procurement strategy (new) | Codebook (v2) with additions |
| 5. Framework appraisal | Test, refine, extend | Which categories hold? Where are refinements needed? | Confirmation: regulatory drivers/economics; addition: implementation/scaling | Framework comparison with extensions |
| 6. Reporting | Present results transparently | Report confirmed and extended categories; add quotes; reflect on limits | "Funding + payback" as drivers; "pilot + bundling + sub-metering" as implementation path | Results text with theory link |
Example: Starting categories, rules, additions (extract)
Start (deductive, from framework)
- Regulatory drivers: references to laws, funding, standards
- Economics: costs, payback, ROI
- Stakeholder acceptance: attitudes, concerns, feedback
- Implementation: measures, processes, procurement
- Data/monitoring: metering infrastructure, indicators, reporting
Coding rules (short form)
- Economics covers payback, operating costs, ROI; purely technical mentions without cost link excluded.
- Regulatory drivers capture mentions of funding schemes, legal requirements.
Implementation bundles piloting, procurement, roll-out steps.
Inductive additions (from the example)
- Implementation > procurement strategy: "bundled tendering"
- Data/monitoring > result indicator: "18% savings"
Example codings (same text, DCA logic)
- "Payback under four years" > Economics > Payback
- "Funding landscape ... tipped the balance" > Regulatory drivers
- "Reservations ... light quality" > Stakeholder acceptance > Quality concerns
- "Feedback positive (pilot)" > Stakeholder acceptance > positive feedback; Implementation > piloting
- "Tender combined" > Implementation > procurement strategy (new)
- "Sub-metering ... 18%" > Data/monitoring > metering infrastructure; result indicator (new)
5.6.3 Practical notes ^ top
- Derive the framework transparently (cite the source) and briefly justify its fit to the research question.
- Document additions explicitly (new code, anchor quote, rationale).
- Plan falsification checks: look deliberately for segments that contradict the framework (negative cases).
- Structure the report: first present confirmed categories (with quotes), then extensions and implications for the framework.
- Combinations: DCA combines well with the Framework Method (matrix display) or Template logic (stabilised code tree after additions).
5.6.4 Distinction ^ top
Directed Content Analysis is the most theory-led approach here: starting categories are taken directly from a model/framework. The inductive element is deliberately limited to filling gaps. This distinguishes it from more open approaches (Thematic Analysis, Grounded Theory) as well as from more thematically organised procedures (Kuckartz, Framework).
| Dimension of comparison | Directed | Mayring | Kuckartz | Grounded Theory | Framework | Template | Thematic Analysis |
|---|---|---|---|---|---|---|---|
| Dependence on theory | Very high (framework guides) | Medium (theory + data) | Medium (guide + data) | Low (theory emerges) | Medium (thematic frame) | Medium (template) | Low to medium |
| Inductive share | Targeted, only for gaps | Balanced | Balanced | Dominant | Balanced | Iterative | Dominant |
| Knowledge aim | Test/extend a framework | Structure content | Organise themes | Develop theory | Compare cases | Code themes consistently | Discover patterns |
| Risk | Confirmation bias | Over-structuring | Theme pre-shaping | Drift/over-complexity | Over-condensation | Template bias | Lack of rigour |
| When to prefer DCA? | When an existing concept/framework (e.g., ESG, standard, policy logic) should be empirically tested and selectively extended |
5.6.5 Sources and further information ^ top
- Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687
5.7 Thematic Analysis according to Braun & Clarke ^ top
Braun and Clarke’s Thematic Analysis is a flexible approach for identifying, developing and reporting "themes" — recurring, meaningful patterns in text. It is epistemologically open (usable from more realist/essentialist to constructivist–interpretivist stances) and suits a wide range of qualitative data, especially semi-structured interviews and open responses. The focus is on recursive work on themes across six phases, not on a rigid rule set. TA is particularly helpful when you want to develop patterns, narratives and meaning structures without over-prescribing the analysis.
5.7.1 Core idea ^ top
- Iterative work across six phases: from familiarisation and code generation to candidate themes, review, definition/naming and reporting.
- Codes are tools for marking segments: the goal is to develop consistent, clearly defined themes that answer the research question.
5.7.2 Procedure ^ top
| Phase | Aim | Procedure | Example in the text | Output |
|---|---|---|---|---|
| 1. Familiarisation with the data | Gain overview and initial ideas | Read transcripts, take notes/memos; mark early observations | Signals of economic motives, funding, acceptance concerns, pilot, data/monitoring | Initial idea notes |
| 2. Generate initial codes | Mark meaningful segments | Move systematically through the material; assign brief, precise codes (semantic/latent) | "Payback < 4y", "funding trigger", "quality concerns", "pilot feedback +", "bundled tendering", "measurement gap", "sub-metering", "18% savings" | Code list with references |
| 3. Develop candidate themes | Bundle codes into larger patterns | Group related codes; form thematic clusters | Cluster "decision drivers" (payback, funding); "acceptance path" (concerns > pilot > positive feedback); "evidence & scaling" (sub-metering, 18%, bundling) | Draft themes (candidates) |
| 4. Review themes | Check coherence and coverage | At code-extract and whole-dataset levels: do themes fit? Gaps? Overlaps? | Check: does "acceptance path" cover all relevant segments? Is "evidence & scaling" too broad and needs splitting? | Revised theme structure |
| 5. Define and name themes | Sharpen each theme’s core message | Clarify content, boundaries, subthemes; craft precise labels | "Decision drivers: economics & funding", "acceptance via pilot validation", "evidence-based scaling (sub-metering & procurement)" | Final named themes with short definitions |
| 6. Reporting | Coherent presentation with evidence | Write narratives, add quotes, link to the research question; reflect on limits | Theme-centred results with exemplar quotes and linking argument | Results report (theme-led) |
Example: Codes > candidate themes > final themes (extract)
Codes (Phase 2):
- "Payback < 4y", "funding trigger", "quality concerns", "pilot feedback +", "bundled tendering", "measurement gap", "sub-metering", "18% savings"
Candidate themes (Phase 3):
- Decision drivers (economics/regulation)
- Acceptance path (concerns > pilot > positive feedback)
- Evidence & scaling (measurement/18% > bundling)
Final themes (Phase 5, refined): 1) Decision drivers: economics & funding
- Short definition: decisions are pragmatically initiated by short payback times and available funding schemes.
- Example quotes: "...payback under four years..."; "...funding landscape tipped the balance..."
2) Acceptance via pilot validation
- Short definition: pilot projects allay quality concerns and generate positive feedback for roll-out.
- Example quotes: "...concern... light quality..."; "...feedback positive..."
3) Evidence-based scaling
- Short definition: sub-metering and documented savings legitimise scaling; bundled procurement achieves economies of scale.
- Example quotes: "...sub-metering..."; "...18%..."; "...tender combined..."
5.7.3 Practical notes ^ top
- Clarify orientation: semantic (surface) vs latent (deeper, interpretative) themes — depending on the knowledge aim.
- Themes are not codes: codes mark, themes interpret and integrate. A good theme answers "what is the core issue here?"
- Work iteratively: phases are recursive — codes can be adjusted after reviewing themes.
- Keep reporting tight: per theme, provide a clear core idea, 2–3 concise quotes, brief context and a link to the research question.
- Fit within the compendium: TA bridges more structured approaches (Mayring/Kuckartz) and theory-building approaches (Grounded Theory). For team/case comparisons, the Framework Method complements well; for theory-led tests, use Directed Content Analysis.
5.7.4 Distinction ^ top
Braun and Clarke’s Thematic Analysis is the most flexible approach in this set. It deliberately avoids fixed coding rules or rigid starting structures and instead relies on reflexive, recursive theme development. This suits exploratory studies and heterogeneous data — but requires disciplined documentation.
| Dimension of comparison | Thematic Analysis | Mayring | Kuckartz | Grounded Theory | Framework | Template | Directed |
|---|---|---|---|---|---|---|---|
| Flexibility | Very high | Lower (rules) | Medium (phases) | High (but methodologically demanding) | Lower (matrix) | Medium (template) | Low (framework) |
| Rule set | None; reflexivity as principle | Explicit coding rules | Definitions + phases | Comparison as principle | Indexing + charting | Template definitions | Framework definitions |
| Output form | Themes with narratives and quotes | Category reports | Matrices/profiles | Process model/theory | Case x theme matrix | Code tree + synthesis | Framework comparison |
| Quality assurance | Reflexivity, memos, peer debriefing | Intercoder, audit trail | Intercoder, audit trail | Memos, theoretical sampling | Charting transparency | Template versions | Falsification checks |
| When to prefer TA? | When you aim to extract patterns and meanings without strong theoretical pre-structuring — and when reflective discipline is available |
5.7.5 Sources and further information ^ top
-
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
-
Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, 11(4), 589–597. https://doi.org/10.1080/2159676X.2019.1628806
-
Braun, V., & Clarke, V. (2022). Thematic analysis: A practical guide. SAGE.
![Creative Commons 4.0 International Licence [CC BY 4.0]](https://melearning.online/compendium/themes/simpletwo/images/meLearning/cc-by-large.png)