11.Statistics -UnitXI
11.Statistics -UnitXI
3
Statistics – Unit XI
Qualitative Analysis of Data
analysis to analyze the data generated from focus group
discussions.
These are just a few examples of the diverse range of qualitative research
methods used in psychology. Each method offers its own strengths and
limitations, and researchers often use a combination of methods to
triangulate data and enhance the validity and reliability of their findings.
Overall, qualitative research methods play a crucial role in providing
insights into the subjective experiences and social contexts that shape
human behavior and psychology.
Scope:
5
Statistics – Unit XI
Qualitative Analysis of Data
Qualitative research methods can be applied across various
subfields of psychology, including clinical psychology, social
psychology, developmental psychology, organizational psychology,
and more.
Advantages:
Disadvantages:
6
Statistics – Unit XI
Qualitative Analysis of Data
3. Limited Generalizability: Findings from qualitative research may
not be easily generalizable to larger populations, as the focus is
often on depth rather than breadth of understanding.
4. Difficulty in Replication: The subjective nature of qualitative
research and the reliance on context-specific data can make
replication challenging.
5. Ethical Considerations: Qualitative research may raise ethical
concerns related to privacy, confidentiality, and informed consent,
particularly when studying sensitive topics or vulnerable
populations.
Limitations:
Applications:
7
Statistics – Unit XI
Qualitative Analysis of Data
Organizational Psychology: Qualitative methods are applied to
examine workplace dynamics, leadership styles, organizational
culture, and employee experiences.
8
Statistics – Unit XI
Qualitative Analysis of Data
Content analysis
Content analysis has a rich history that spans multiple disciplines, including psychology,
sociology, communication studies, and anthropology. Its roots can be traced back to the early
20th century, where scholars began to recognize the value of systematically analyzing textual
material for research purposes.
One of the earliest proponents of content analysis was Harold D. Lasswell, an American
political scientist who introduced the method in the 1920s. Lasswell emphasized the
importance of studying communication to understand society and politics. His work laid the
foundation for content analysis as a methodological approach to studying media content,
propaganda, and political discourse.
During the 1940s and 1950s, content analysis gained popularity in communication research,
particularly in the study of mass media and propaganda. Researchers used content analysis to
analyze newspaper articles, radio broadcasts, and film content to understand the portrayal of
social issues, stereotypes, and ideological messages.
In psychology, content analysis began to emerge as a research method in the mid-20th
century. Psychologists recognized its potential for analyzing various forms of
communication, including interviews, written texts, and visual materials, to explore topics
such as attitudes, personality traits, and cognitive processes.
The development of computer technology in the latter half of the 20th century revolutionized
content analysis by enabling researchers to process and analyze large volumes of textual data
efficiently. Computer-assisted content analysis (CACA) became increasingly common,
allowing researchers to code and categorize texts using specialized software programs.
Since then, content analysis has continued to evolve and adapt to new research contexts and
technologies. It remains a versatile and widely used method in various fields, including
psychology, sociology, marketing, and education. Contemporary applications of content
analysis encompass diverse forms of communication, from traditional media sources to
online platforms and social media networks, reflecting the evolving nature of human
communication and interaction.
Content analysis serves as a prominent research method within psychology, employed to
dissect and make sense of various forms of data including textual, visual, or audio content.
This method entails a structured process of categorizing and deciphering the substance of
9
Statistics – Unit XI
Qualitative Analysis of Data
communication, spanning interviews, written records, social media interactions, and more. Its
applicability ranges across qualitative, quantitative, or hybrid methodologies, tailored to suit
the research objectives and the characteristics of the data under scrutiny. Through content
analysis, researchers systematically scrutinize information to unveil patterns, themes, and
underlying meanings embedded within the communication, thereby enriching our
understanding of human behavior, cognition, and social interactions.
Common approaches to content analysis in psychology
Content analysis in psychology research can be approached through various methods, each
tailored to the specific research objectives and the nature of the data being analyzed. Here are
some common approaches to content analysis in psychology, along with detailed examples:
1. Qualitative Content Analysis: Qualitative content analysis involves a systematic
examination of textual, visual, or audio data to identify patterns, themes, and
underlying meanings. This approach is commonly used when researchers aim to
explore the richness and complexity of a phenomenon in depth.
Example: A psychologist conducting a study on the experiences of individuals coping with
chronic pain might conduct qualitative content analysis of open-ended survey responses. By
analyzing participants' descriptions of their pain experiences, coping strategies, and
emotional responses, the researcher can identify common themes such as the impact of pain
on daily life, adaptive coping mechanisms, and challenges in seeking support.
2. Quantitative Content Analysis: Quantitative content analysis involves the systematic
coding and categorization of textual or visual data to quantify the frequency,
distribution, and relationships between variables of interest. This approach is often
used when researchers aim to quantify patterns or trends within a large dataset.
Example: A study on gender representation in children's literature might involve quantitative
content analysis of a sample of books. Researchers could code the gender of main characters,
the frequency of gendered language (e.g., use of masculine or feminine pronouns), and the
portrayal of gender roles (e.g., depiction of traditional gender stereotypes). By analyzing
these variables across a large sample of books, researchers can quantify patterns of gender
representation and identify trends over time.
3. Mixed-Methods Content Analysis: Mixed-methods content analysis involves
integrating qualitative and quantitative approaches to gain a more comprehensive
understanding of a phenomenon. This approach allows researchers to combine the
depth of qualitative analysis with the breadth of quantitative analysis.
10
Statistics – Unit XI
Qualitative Analysis of Data
Example: A study on the portrayal of mental illness in popular films might use a mixed-
methods approach to analyze both the content and context of film scenes depicting mental
health issues. Qualitative content analysis could be used to identify common themes and
stereotypes in the portrayal of mental illness, while quantitative content analysis could be
used to quantify the frequency of specific depictions (e.g., use of diagnostic labels, portrayal
of symptoms) across a sample of films.
4. Directed Content Analysis: Directed content analysis involves applying existing
theories or frameworks to guide the analysis of textual or visual data. This approach is
useful when researchers have specific hypotheses or theoretical concepts they want to
test or explore.
Example: A study on the portrayal of body image in advertising might use directed content
analysis guided by feminist theory. Researchers could apply feminist perspectives on beauty
standards and objectification to analyze advertisements for beauty products. By examining
how advertisements depict and promote idealized body types, researchers can explore the
ways in which advertising perpetuates or challenges gendered norms and expectations.
These approaches to content analysis in psychology research illustrate the versatility of the
method and its applicability to a wide range of research questions and contexts. Whether used
qualitatively, quantitatively, or in combination, content analysis provides valuable insights
into human behavior, cognition, and communication.
Advantages:
1. Flexible and Versatile: Content analysis can be applied to analyze a wide range of
textual, visual, or audio data, making it suitable for studying diverse topics in
psychology.
2. Systematic and Replicable: Content analysis involves a systematic coding and
categorization process, which enhances the reliability and replicability of research
findings.
3. Unobtrusive: Content analysis allows researchers to analyze existing communication
without directly interfering with participants, making it a non-intrusive research
method.
4. Can Analyze Large Datasets: With the advent of computer-assisted content analysis,
researchers can efficiently process and analyze large volumes of data, enabling studies
with extensive datasets.
11
Statistics – Unit XI
Qualitative Analysis of Data
5. Can Reveal Hidden Patterns and Themes: Content analysis can uncover underlying
patterns, themes, and meanings within textual or visual data that may not be
immediately apparent, providing insights into human behavior and cognition.
Disadvantages:
1. Subjectivity in Coding: The process of coding and categorizing content may involve
subjective judgments, leading to potential biases or inconsistencies across coders.
2. Time-Consuming: Content analysis can be time-consuming, particularly when
analyzing large datasets or conducting qualitative analysis, which may require manual
coding and interpretation.
3. Limited Contextual Information: Content analysis focuses on the content of
communication and may lack contextual information, making it challenging to fully
understand the meaning or intent behind the communication.
4. Difficulty in Establishing Causality: Content analysis is primarily descriptive and
correlational, making it difficult to establish causal relationships between variables.
Limitations:
1. Sample Representativeness: The quality of content analysis findings may be
influenced by the representativeness of the sample, as well as the selection criteria
used to identify relevant content for analysis.
2. Validity of Coding Schemes: The validity of content analysis findings depends on
the reliability and validity of the coding scheme used, as well as the accuracy of
coding decisions made by researchers.
3. Difficulty in Analyzing Visual or Audio Data: Analyzing visual or audio data in
content analysis may pose challenges, as interpretation may be more subjective
compared to textual data.
Applications in Psychology Research:
1. Exploring Attitudes and Beliefs: Content analysis can be used to explore attitudes,
beliefs, and perceptions expressed in textual or visual communication, such as
interviews, surveys, or media content.
2. Studying Social Representations: Researchers use content analysis to examine how
social constructs and representations are communicated through language or visual
imagery, shedding light on societal norms and values.
12
Statistics – Unit XI
Qualitative Analysis of Data
3. Analyzing Media Effects: Content analysis is commonly used to study the effects of
media on behavior, attitudes, and perceptions, including representations of violence,
stereotypes, or mental health issues in media content.
4. Evaluating Interventions: Researchers may use content analysis to evaluate the
effectiveness of interventions or programs by analyzing changes in communication
patterns or content before and after intervention implementation.
5. Understanding Communication Dynamics: Content analysis can be used to study
communication dynamics in various contexts, such as therapeutic interactions, online
communities, or educational settings, to understand patterns of communication and
interaction.
Overall, content analysis is a valuable research method in psychology, offering researchers a
systematic and versatile approach to analyzing textual, visual, or audio data and gaining
insights into human behavior, cognition, and communication. However, researchers must
carefully consider the method's strengths, limitations, and potential biases when designing
and conducting content analysis studies.
13
Statistics – Unit XI
Qualitative Analysis of Data
Qualitative methodologies within psychosocial research
Qualitative methodologies within psychosocial research are employed to explore the intricate
layers of human behavior, emotions, and social dynamics. These methodologies prioritize the
examination of subjective experiences, interpretations, and contextual influences, with the
overarching goal of gaining deeper insights into the complexities inherent in psychological
and social phenomena.
Rather than relying solely on quantifiable data or numerical metrics, qualitative approaches
delve into the rich tapestry of individual and collective experiences, seeking to understand the
multifaceted nature of human cognition and interaction. By focusing on the subjective
realities of participants, qualitative methods allow researchers to uncover nuanced
perspectives and meanings that might otherwise remain obscured by more traditional,
quantitative approaches.
Through techniques such as in-depth interviews, focus groups, and participant observation,
researchers immerse themselves in the social contexts under investigation, engaging directly
with participants and capturing the subtleties of their lived experiences. These methods
enable researchers to explore the diverse range of factors shaping human behavior and
emotions, including cultural norms, social structures, and personal histories.
Moreover, qualitative methodologies facilitate the exploration of complex phenomena that
cannot be easily quantified or standardized, such as emotions, identity formation, and
interpersonal relationships. By embracing the complexity and subjectivity inherent in
psychosocial processes, qualitative researchers are able to generate rich, contextually
grounded insights that contribute to a more holistic understanding of human behavior and
social interaction.
In essence, qualitative methods serve as a powerful tool for uncovering the deeper layers of
meaning and significance that underlie psychological and social phenomena, allowing
researchers to capture the richness and complexity of human experience in all its diversity
and nuance.
common qualitative methods used in psychosocial research include:
1. Interviews: In-depth interviews allow researchers to explore participants'
experiences, perceptions, and beliefs regarding specific psychosocial issues. These
interviews can be structured, semi-structured, or unstructured, depending on the
research objectives.
14
Statistics – Unit XI
Qualitative Analysis of Data
2. Focus Groups: Focus groups involve bringing together a small group of participants
to discuss a particular topic guided by a moderator. This method allows researchers to
explore shared experiences, group dynamics, and diverse perspectives within a
specific social context.
3. Observation: Observational methods involve systematically observing and recording
behavior, interactions, and social dynamics in naturalistic settings. This approach
allows researchers to understand behavior within its natural context and can provide
valuable insights into psychosocial phenomena.
4. Participant Observation: Participant observation involves researchers immersing
themselves in the environment being studied, actively participating in the activities
and interactions while also observing and documenting their experiences. This
method is particularly useful for understanding social processes and cultural norms.
5. Ethnography: Ethnography involves conducting in-depth, long-term fieldwork to
gain a holistic understanding of a particular culture, community, or social group.
Ethnographic research often combines various qualitative methods, such as
interviews, observation, and participant observation, to explore complex psychosocial
phenomena within their cultural context.
6. Narrative Analysis: Narrative analysis focuses on examining the stories and
narratives individuals use to make sense of their experiences. Researchers analyze the
structure, content, and meaning of narratives to uncover underlying themes, values,
and beliefs related to psychosocial phenomena.
7. Content Analysis: Content analysis involves systematically analyzing written, verbal,
or visual materials (e.g., texts, speeches, media) to identify patterns, themes, and
meanings related to specific psychosocial topics. This method can provide insights
into cultural representations, discourses, and societal attitudes.
8. Grounded Theory: Grounded theory is an inductive approach used to develop
theories based on empirical data collected through qualitative methods. Researchers
iteratively analyze data to identify patterns and concepts, leading to the development
of theoretical frameworks grounded in participants' experiences and perspectives.
These qualitative methods are often used in combination to provide a comprehensive
understanding of psychosocial phenomena, allowing researchers to explore the subjective
meanings and contexts that shape human behavior and social interactions.
15
Statistics – Unit XI
Qualitative Analysis of Data
Ethnography
Ethnography is a qualitative research method commonly used in psychology to understand
social and cultural phenomena within specific groups or communities. It involves immersing
oneself in the environment being studied, observing and interacting with participants, and
collecting rich, descriptive data. Ethnographic research in psychology aims to uncover the
complexities of human behavior, beliefs, and practices within their natural contexts. Here are
a few examples of ethnographic studies in psychology:
1. Cultural Psychology: Ethnographic research is often employed in cultural
psychology to investigate how cultural factors influence individual behavior and
cognition. For instance, a psychologist might conduct ethnographic research in a rural
village to understand how cultural beliefs about family, community, and spirituality
shape individuals' identities and psychological well-being. By living among
community members, observing their daily routines, and participating in cultural
practices, researchers can gain insights into the unique psychological processes at play
within that cultural context.
2. School Ethnography: Ethnographic studies in educational psychology explore the
social dynamics, learning environments, and educational practices within schools. For
example, a psychologist might conduct ethnographic research in a diverse urban
school to examine how students from different cultural backgrounds navigate social
interactions and academic challenges. By observing classroom interactions,
interviewing teachers and students, and analyzing school policies, researchers can
identify the ways in which cultural norms and institutional structures impact students'
educational experiences and outcomes.
3. Workplace Ethnography: Ethnographic research is also used in industrial-
organizational psychology to investigate workplace cultures, organizational dynamics,
and employee behavior. For instance, a psychologist might conduct ethnographic
research in a corporate office to explore how organizational values, leadership styles,
and communication patterns influence employee motivation and job satisfaction. By
observing meetings, conducting interviews with employees at all levels, and analyzing
workplace artifacts (such as emails and memos), researchers can uncover the complex
social processes that shape behavior within the workplace.
4. Community Ethnography: Psychologists may conduct ethnographic research in
community settings to understand social issues such as poverty, homelessness, or
16
Statistics – Unit XI
Qualitative Analysis of Data
substance abuse. For example, a psychologist might immerse themselves in a
homeless shelter to investigate the factors contributing to homelessness and the
experiences of individuals living on the streets. By building relationships with
community members, participating in outreach efforts, and documenting personal
narratives, researchers can gain a deeper understanding of the social and
psychological factors that contribute to vulnerability and resilience within
marginalized communities.
In each of these examples, ethnographic research allows psychologists to gain a nuanced
understanding of human behavior within specific social and cultural contexts. By immersing
themselves in the environments being studied and engaging directly with participants,
researchers can uncover rich, contextualized data that enhances our understanding of the
complex interplay between individuals, communities, and cultural systems.
18
Statistics – Unit XI
Qualitative Analysis of Data
2. In-depth Interviews: This method involves conducting structured or semi-structured
interviews with participants to gather detailed information about their experiences,
perspectives, beliefs, and behaviors.
Example: A psychologist conducting research on the experiences of immigrants might
conduct in-depth interviews with individuals who have recently migrated to a new country.
By asking open-ended questions about their migration journey, cultural adaptation process,
and challenges they face, the researcher can explore the complexities of the immigrant
experience and the psychological factors influencing their adjustment.
3. Ethnographic Mapping: This method involves creating visual representations of the
social and spatial dimensions of the research setting, such as maps, diagrams, or
charts, to illustrate relationships, patterns, and structures.
Example: A psychologist studying the social dynamics within a psychiatric hospital might
create an ethnographic map showing the layout of the facility, the locations of different units
or wards, and the flow of staff and patients throughout the day. Ethnographic mapping can
help researchers identify spatial factors influencing patient-staff interactions, access to
resources, and the provision of care.
4. Document Analysis: This method involves analyzing written or visual materials
produced within the research setting, such as official documents, organizational
records, personal journals, or media artifacts, to gain insights into cultural practices,
social norms, and historical contexts.
Example: A psychologist investigating the impact of social media on adolescent identity
formation might analyze teenagers' online profiles, posts, and interactions on platforms like
Instagram or TikTok. Document analysis can reveal the ways in which digital technologies
shape self-presentation, social relationships, and identity construction among young people.
5. Ethnographic Photography or Video: This method involves using photography or
video recording to document the everyday life, rituals, and interactions of the
participants within their natural settings.
Example: A psychologist studying family dynamics and parenting practices might use video
recording to capture parent-child interactions during meal times, play activities, or bedtime
routines. Ethnographic photography or video can provide visual evidence of behavioral
patterns, emotional expressions, and nonverbal communication within the family context.
19
Statistics – Unit XI
Qualitative Analysis of Data
6. Ethnographic Writing: This method involves writing detailed field notes, journals,
or ethnographic narratives based on the researcher's observations, experiences, and
reflections during the ethnographic process.
Example: A psychologist conducting research in a community mental health clinic might keep
a reflective journal documenting their thoughts, emotions, and reactions to their interactions
with clients, staff, and the therapeutic environment. Ethnographic writing can capture the
researcher's subjective experiences and interpretations, enriching the qualitative data
collected during the study.
By combining these ethnographic methods, psychologists can conduct in-depth investigations
of social and cultural phenomena, gaining rich, contextualized insights into the complexities
of human behavior and experience within their natural contexts.
Research Tools used in Ethnography
Ethnography employs various research tools and techniques to gather rich, qualitative data
and to analyze the social and cultural dynamics within specific contexts. These tools are
essential for capturing the complexities of human behavior, beliefs, and practices within their
natural settings. Here are some common research tools used in ethnography:
1. Field Notes: Field notes are written records that ethnographers take during participant
observation or fieldwork. These notes capture detailed descriptions of observations,
interactions, conversations, and contextual factors within the research setting. Field
notes often include the researcher's reflections, interpretations, and preliminary
analysis of the data collected.
2. Interview Guides: Interview guides are structured or semi-structured sets of
questions used to guide in-depth interviews with participants. These guides typically
include open-ended questions designed to elicit participants' perspectives,
experiences, beliefs, and behaviors related to the research topic. Interview guides may
also include probes or follow-up questions to explore specific topics in more depth.
3. Audio and Video Recording: Audio and video recording tools are used to capture
verbal and nonverbal communication, interactions, and events within the research
setting. Recording interviews, group discussions, and everyday activities allows
researchers to preserve rich, detailed data for later analysis. Ethnographers must
obtain informed consent from participants before recording any audio or video
material.
20
Statistics – Unit XI
Qualitative Analysis of Data
4. Photography: Photography is often used as a visual research tool in ethnography to
document the physical environment, material culture, and social interactions within
the research setting. Ethnographic photographs can provide visual evidence of cultural
practices, rituals, artifacts, and spatial arrangements. Researchers must consider
ethical considerations and obtain consent when taking photographs of individuals or
sensitive contexts.
5. Mapping and Diagramming Tools: Mapping and diagramming tools are used to
create visual representations of the spatial, social, and temporal dimensions of the
research setting. Ethnographers may use maps, diagrams, or charts to illustrate
relationships, patterns, and structures within the community, organization, or cultural
context being studied. These visual tools help researchers analyze spatial
configurations, social networks, and power dynamics.
6. Document Analysis Tools: Document analysis involves examining written or visual
materials produced within the research setting, such as official documents,
organizational records, personal narratives, or media artifacts. Ethnographers use
document analysis tools to identify patterns, themes, and discourses related to the
research topic. Analyzing documents provides insights into cultural practices, social
norms, historical contexts, and power relations.
7. Transcription Software: Transcription software is used to transcribe audio or video
recordings of interviews, group discussions, or interactions into written text.
Transcripts allow researchers to analyze and code qualitative data more efficiently,
facilitating the identification of themes, patterns, and categories. Transcription
software may include features for time-stamping, speaker identification, and
formatting transcripts according to research conventions.
8. Data Management Software: Data management software is used to organize, store,
and manage qualitative data collected during the ethnographic research process. These
software tools allow researchers to code, categorize, search, and retrieve data
efficiently, facilitating the analysis and interpretation of findings. Data management
software may include features for creating data dictionaries, coding schemes, and
memos to document analytic decisions.
By using these research tools effectively, ethnographers can collect, analyze, and interpret
qualitative data in ways that provide rich insights into the social and cultural dynamics within
specific contexts. These tools enable researchers to explore complex phenomena, uncover
21
Statistics – Unit XI
Qualitative Analysis of Data
patterns and meanings, and generate in-depth understandings of human behavior and
experience within their natural settings.
Steps involved in conducting ethnographic research:
23
Statistics – Unit XI
Qualitative Analysis of Data
NARRATIVE ANALYSIS
Introduction
“Narrative” might be the phenomenon being studied, such as a narrative of illness, or it
might be the method used in a study, such as the procedures of analyzing stories told. As a
method, it begins with the experiences as expressed in lived and told stories of individuals.
Writers have provided ways for analyzing and understanding the stories lived and told.
Czarniawska (2004) defines it here as a specific type of qualitative design in which “narrative
is understood as a spoken or written text giving an account of an event/action or series of
events/actions, chronologically connected”. The procedures for implementing this research
consist of focusing on studying one or two individuals, gathering data through the collection
of their stories, reporting individual experiences, and chronologically ordering the meaning of
those experiences (or using life course stages).
Narrative analysis is one form of qualitative data analysis that it is often used in narrative
inquiry. Narrative inquiry is both a phenomenon and a method where people tell their stories;
narrative researchers explain such experiences by collecting stories and writing narratives of
them. Narrative inquiry provides an opportunity to the researcher access to the personal
experiences of the participant, the storyteller. Storyteller speaks and declares life as
experiences in a narrative form that is called story. Thus, the researcher has an opportunity to
study the subjects in their natural setting and understand the behaviour, actions and feelings
in a whole context.
Defining features of Narrative Analysis
1. Narrative researchers collect stories from individuals (and documents, and group
conversations) about individuals lived and told experiences. These stories may emerge
from a story told to the researcher, a story that is co-constructed between the
researcher and the participant, and a story intended as a performance to convey some
message or point. Thus, there may be a strong collaborative feature of narrative
research as the story emerges through the interaction or dialogue of the researcher and
the participant(s).
2. Narrative stories tell of individual experiences, and they may shed light on the
identities of individuals and how they see themselves.
3. Narrative stories are gathered through many different forms of data, such as through
interviews that may be the primary form of data collection, but also through
observations, documents, pictures, and other sources of qualitative data.
24
Statistics – Unit XI
Qualitative Analysis of Data
4. Narrative stories often are heard and shaped by the researchers into a chronology
although they may not be told that way by the participant(s). There is a temporal
change that is conveyed when individuals talk about their experiences and their lives.
They may talk about their past, their present, or their future.
5. Narrative stories are analyzed in varied ways. An analysis can be made about what
was said (thematically), the nature of the telling of the story (structural), or who the
story is directed toward (dialogic/performance).
6. Narrative stories often contain turning points or specific tensions or interruptions
that are highlighted by the researchers in the telling of the stories.
7. Narrative stories occur within specific places or situations. The context becomes
important for the researcher’s telling of the story within a place.
Shape of a story helps organise information about how people have interpreted events; the
values, beliefs and experiences that guide those interpretations; and their hopes, intentions
and plans for the future. Narratives or stories may:
● Be oral or hand written
● be elicited, for example during an interview, or naturally-occurring
● be very short or long
● be told as a way to share one's biography (life stories)
● focus on events and the meaning of those events for those experiencing them (e.g.
oral histories; auto-ethnographies)
Types of Narratives - Narrative studies can be differentiated along two different lines. One
line is to consider the data analysis strategy used by the narrative researcher. Several analytic
strategies are available for use. Polkinghorne (1995) discusses narrative in which the
researcher extracts themes that hold across stories or taxonomies of types of stories, and a
more storytelling mode in which the narrative researcher shapes the stories based on a
plotline, or a literary approach to analysis.
Another line of thinking is to consider the type of narratives. A wide variety of approaches
have emerged (see, e.g., Casey, 1995/1996).
Biographical study Autoethnography Life history
Oral history
1. A biographical study is a form of narrative study in which the researcher writes and
records the experiences of another person’s life. A detailed description of a person's
life, including their birth, life events and/or death. E.g. Shakespeare's biography.
25
Statistics – Unit XI
Qualitative Analysis of Data
2. Autoethnography is written and recorded by the individuals who are the subject of
the
study. Autoethnography is a form of qualitative research in which an author uses self-
reflection and writing to explore anecdotal and personal experience and connect this
autobiographical story to wider cultural, political, and social meanings and understandings.
Autoethnography is a research method that uses personal experience (“auto”) to describe and
interpret (“graphy”) cultural texts, experiences, beliefs, and practices (“ethno”).
3. A life history portrays an individual’s entire life, while a personal experience story is
a narrative study of an individual’s personal experience found in single or multiple
episodes, private situations, or communal folklore (Denzin, 1989a). Life history
interviewing is a qualitative method of data collection where people are asked to
document their life over a period of time. It is a personal account of their life, in their
own words and using their own personal time lines. Accordingly, they tend to be
selective, contingent upon remembered events that are amenable to being told, be they
fact or fiction.
Earlier, the subjects were asked to describe their lives as such, what it was like to be that
particular person. The purpose of the interview was to capture a living picture of the
disappearing people and way of life. Later, the method was also used to interview criminals
and prostitutes in Chicago. The subjects were asked to tell about their lives. In addition, the
interviewers looked at social and police records, and the society in general in which the
subjects lived.
4. An oral history consists of gathering personal reflections of events and their causes
and effects from one individual or several individuals (Plummer, 1983). Narrative
studies
may have a specific contextual focus, such as stories told by teachers or children in
classrooms or the stories told about organizations (Czarniawska, 2004). Oral history is the
collection and study of historical information about individuals, families, important events, or
everyday life using audiotapes, videotapes, or transcriptions of planned interviews.
These interviews are conducted with people who participated in or observed past events and
whose memories and perceptions of these are to be preserved as an aural record for future
generations. Oral history strives to obtain information from different perspectives and most of
these cannot be found in written sources.).
26
Statistics – Unit XI
Qualitative Analysis of Data
Approaches to Narrative Stories
1. Thematic Analysis in which the researcher identifies the themes “told” by a participant.
in which the meaning shifts to the “telling” and the story can be cast
during a conversation in comic terms, tragedy, satire, romance, or
2. Structural Analysis other forms; For example, in a comedic narrative, the overarching
aim is to surprise/shock or otherwise lead the audience or reader to
be amused.
3. in which the focus turns to how the story is produced (i.e.,
Dialogic/Performance interactively between the researcher and the participant) and
Analysis performed (i.e., meant to convey some message or point).
27
Statistics – Unit XI
Qualitative Analysis of Data
4. Collect information about the context of these stories. Narrative researchers situate
individual stories within participants’ personal experiences (their jobs, their homes), their
culture (racial or ethnic), and their historical contexts (time and place).
5. Analyze the participants’ stories. The researcher may take an active role and “restory” the
storiesintoaframeworkthatmakessense. Restoryingistheprocessofreorganizingthestories into
some general type of framework.
6. Collaborate with participants by actively involving them in the research (Clandinin &
Connelly, 2000). As researchers collect stories, they negotiate relationships, smooth
transitions, and provide ways to be useful to the participants.
Challenges
Given these procedures and the characteristics of narrative research, narrative
research is a challenging approach to use.
The researcher needs to collect extensive information about the participant, and needs
to have a clear understanding of the context of the individual’s life.
It takes a keen eye to identify in the source material that gathers the particular stories
to capture the individual’s experiences.
Active collaboration with the participant is necessary, and researchers need to discuss
the participant’s stories as well as be reflective about their own personal and political
background, which shapes how they “restory” the account.
Multiple issues arise in the collecting, analyzing, and telling of individual stories.
INTERPRETATIVE PHENOMENOLOGICAL ANALYSIS
Introduction - Interpretative phenomenological analysis(IPA) is an approach to
psychological qualitative research with an idiographic focus, which means that it aims to
offer insights into how a given person, in a given context, makes sense of a given
phenomenon. Usually these phenomena relate to experiences of some personal significance,
such as a major life event, or the development of an important relationship. Interpretative
Phenomenological Analysis (IPA) has become a dominant qualitative research methodology
in many academic disciplines.
32
Statistics – Unit XI
Qualitative Analysis of Data
CASE STUDY
Introduction
Case study research involves the study of a case within a real-life, contemporary context or
setting. Although Stake (2005) states that case study research is not a methodology but a
choice of what is to be studied (i.e., a case within a bounded system, bounded by time and
place), others present it as a strategy of inquiry, a methodology, or a comprehensive research
strategy. Case study research is a qualitative approach in which the investigator explores a
real-life, contemporary bounded system (a case) or multiple bounded systems (cases) over
time, through detailed, in-depth data collection involving multiple sources of information and
reports a case description and case themes. The unit of analysis in the case study might be
multiple cases (a multisite study) or a single case (a within-site study).
Defining features
● Case study research begins with the identification of a specific case. This case may
be a concrete entity, such as an individual, a small group, an organization, or a
partnership. At a less concrete level, it may be a community, a relationship, a decision
process, or a specific project (see Yin, 2009). The key here is to define a case that can
be bounded or described within certain parameters, such as a specific place and time.
Typically, case study researchers study current, real-life cases that are in progress so
that they can gather accurate information not lost by time. A single case can be
selected or multiple cases identified so that they can be compared.
● • The intent of conducting the case study is also important. A qualitative case study
can be composed to illustrate a unique case, a case that has unusual interest in and of
itself and needs to be described and detailed. This is called an intrinsic case (Stake,
1995). Alternatively, the intent of the case study may be to understand a specific issue,
problem, or concern (e.g., teenage pregnancy) and a case or cases selected to best
understand the problem. This is called an instrumental case.
● A hallmark of a good qualitative case study is that it presents an in-depth
understanding of the case. In order to accomplish this, the researcher collects many
forms of qualitative data, ranging from interviews, to observations, to documents, to
audiovisual materials. Relying on one source of data is typically not enough to
develop this in-depth understanding.
● The selection of how to approach the data analysis in a case study will differ. Some
case studies involve the analysis of multiple units within the case (e.g., the school, the
33
Statistics – Unit XI
Qualitative Analysis of Data
school district) while others report on the entire case (e.g., the school district). Also, in
some studies, the researcher selects multiple cases to analyze and compare while, in
other case studies, a single case is analyzed.
● A key to understanding analysis also is that good case study research involves a
description of the case. This description applies to both intrinsic and instrumental case
studies. In addition, the researcher can identify themes or issues or specific situations
to study in each case. A complete findings section of a case study would then involve
both a
description of the case and themes or issues that the researcher has uncovered in studying
the case.
● In addition, the themes or issues might be organized into a chronology by the
researcher,
analyzed across cases for similarities and differences among the cases, or presented as a
theoretical model
● Case studies often end with conclusions formed by the researcher about the overall
meaning derived from the case(s). These are called “assertions” by Stake (1995) or building
“patterns” or “explanations” by Yin (2009). I think about these as general lessons learned
from studying the case(s).
Types of Case studies
1. Single Instrumental Case study - The researcher focuses on an issue or concern, and then
selects one bounded case to illustrate this issue.
2.Collective Case Study - the one issue or concern is again selected, but the inquirer selects
multiple case studies to illustrate the issue. The researcher might select for study several
programs from several research sites or multiple programs within a single site. Often the
inquirer purposefully selects multiple cases to show different perspectives on the issue. the
multiple case study design uses the logic of replication, in which the inquirer replicates the
procedures for each case
3. Intrinsic Case Study - in which the focus is on the case itself because the case presents an
unusual or unique situation. This resembles the focus of narrative research, but the case study
analytic procedures of a detailed description of the case, set within its context or
surroundings, still hold true.
Procedure
34
Statistics – Unit XI
Qualitative Analysis of Data
1. First, researchers determine if a case study approach is appropriate for studying the
research problem. A case study is a good approach when the inquirer has clearly
identifiable cases with boundaries and seeks to provide an in-depth understanding of
the cases or a comparison of several cases
2. Researchers need next to identify their case or cases. These cases may involve an
individual, several individuals, a program, an event, or an activity. In conducting case
study research. The case can be single or collective, multi-sited or within-site, and
focused on a case or on an issue (intrinsic, instrumental). In choosing which case to
study, an array of possibilities for purposeful sampling is available.
3. The data collection in case study research is typically extensive, drawing on multiple
sources of information, such as observations, interviews, documents, and audiovisual
materials.
4. The type of analysis of these data can be a holistic analysis of the entire case or an
embedded analysis of a specific aspect of the case. Through this data collection, a
detailed description of the case emerges in which the researcher details such aspects as the
history of the case, the chronology of events, or a day-by-day rendering of the activities of the
case. After this description the researcher might focus on a few key issues not for
generalizing beyond the case, but for understanding the complexity of the case.
5. One analytic strategy would be to identify issues within each case and then look for
common themes that transcend the cases. This analysis is rich in the context of the
case or setting in which the case presents itself. When multiple cases are chosen, a
typical format is to provide first a detailed description of each case and themes within
the case, called a within-case analysis, followed by a thematic analysis across the
cases, called a cross-case analysis, as well as assertions or an interpretation of the
meaning of the case.
6. In the final interpretive phase, the researcher reports the meaning of the case, whether
that meaning comes from learning about the issue of the case (an instrumental case) or
learning about an unusual situation (an intrinsic case)
Challenges
● One of the challenges inherent in qualitative case study development is that the
researcher must identify the case. The case selected may be broad in scope or narrow
in scope
35
Statistics – Unit XI
Qualitative Analysis of Data
● The case study researcher must decide which bounded system to study, recognizing
that several might be possible candidates for this selection and realizing that either the
case itself or an issue, which a case or cases are selected to illustrate, is worthy of
study.
● The researcher must consider whether to study a single case or multiple cases. The
study of more than one case dilutes the overall analysis; the more cases an individual
studies, the less the depth in any single case
● Selecting the case requires that the researcher establish a rationale for his or her
purposeful sampling strategy for selecting the case and for gathering information
about the case. Having enough information to present an in-depth picture of the case
limits the value of some case studies.
36
Statistics – Unit XI
Qualitative Analysis of Data
Grounded Theory
Grounded theory involves inductive guidelines rather than deductive processes. This is very
different from what is often regarded as conventional theory building (sometimes described
as the ‘hypothetico-deductive method’). In the hypothetico-deductive method, theory is
developed from which hypotheses are derived. In turn, these hypotheses may be put to an
empirical test.
● Grounded theory requires that theory should develop out of an understanding of the
complexity of the subject matter. Theories (that is, coding schemes) knit the
complexity of the data into a coherent whole. Primarily, such theories may be tested
effectively only in terms of the fit between the categories and the data, and by
applying the categories to new data.
● In many ways this contrasts markedly with mainstream quantitative psychology
where there is no requirement that the analysis fits all of the data closely – merely that
there are
statistically significant trends, irrespective of magnitude, which confirm the hypothesis
derived from the theory. The unfitting data are regarded as measurement error rather than a
reason to explore the data further in order to produce a better analysis, as it may be in
qualitative research.
● The theory-building process is a continuous one rather than a sequence of critical tests of
the theory through testing hypotheses. In many ways, it is impossible to separate the different
phases of the research into discrete components such as theory development, hypothesis
testing, followed by refining the theory. The data collection phase, the transcription phase and
the analysis phase all share the common intent of building theory by matching the analysis
closely to the complexity of the topic of interest.
Grounded Theory Analysis
1. Comparison - Grounded theory development involves constant comparisons at all
stages of the data collection and analysis process – without comparing categories with
each other and with the data, categories cannot evolve and become more refined:
People may be compared in terms of what they have said or done or how they have
accounted for their actions or events, for example. Comparisons are made of what a
person does or says in one context with what they do and say in another context. So,
for example, it is a common criticism of quantitative research that the researcher
forces observations into ill-fitting categories for the purpose of analysis; in grounded
37
Statistics – Unit XI
Qualitative Analysis of Data
theory the categories are changed and adjusted to fit the data better. This is often
referred to as the method of constant comparisons.
2. Coding/Naming - Grounded theory principles require that the researcher repeatedly
examines the data closely. The lines of data will be numbered at some stage to aid
comparison and reference. In the initial stage of the analysis, the day-to-day work
involves coding or describing the data line-by-line. It is as straightforward as that –
and as difficult. The line is examined and a description (it could be more than one) is
provided by the researcher to describe what is happening in that line or what is
‘represented’ by that line. In other words, a name is being given to each line of data.
These names or codes should be generated out of what is in that particular line of
data. In many ways, describing this as coding is a little misleading, because it implies
a pre-existing system, which is not the case. Others describe the process in slightly
different terms.
3. Categorisation - The analyst has to try to organise these codings. Remember that
codings are part of the analysis process and the first tentative steps in developing
theory. These are the smallest formal units in the grounded theory analysis. While
they may describe the data more-or-less well, by organising them we may increase the
likelihood that we will be able to effectively revise them. This is a sort of reverse
filtering process: we are starting with the smallest units of analysis and working back
to the larger theoretical descriptions. So the next stage is to build the codings or
namings of lines of data into categories. This is a basic strategy in many sorts of
research.
4. Memo Writing - Memo writing describes the aspect of the research in which the data
are explored rather than described and categorised. The memo may be just as one
imagines – a notebook – in which the researcher notes suggestions as to how the
categories may be linked together in the sense that they have relationships and
interdependencies. But the memo does not have to be a purely textual thing. A
diagram – perhaps a flow diagram – could be used in which the key concepts are
placed in boxes and the links between them identified by annotated arrows.
Sometimes the memo is regarded as an intermediary step between the data and the
final written report. As ever in grounded theory, though, in practice the distinction
between the different stages is not rigid. Often the advice is to start memo writing just
38
Statistics – Unit XI
Qualitative Analysis of Data
as soon as anything strikes one as interesting in the data, the coding or categorisation.
The sooner the better would seem to be the general consensus.
5. Theoretical sampling - Theoretical sampling is about how to validate the ideas
developed within the memo. If the ideas in the memo have validity then they should
apply to some samples of data but not to others. The task of the researcher is partly to
suggest which samples the categories apply to and which they should not apply to.
This will help the researcher identify new sources of data which may be used to
validate the analysis to that point. As a consequence of the analysis of such additional
data, subsequent memo writing may be more closely grounded in the data which it is
intended to explain.
6. Literature review - In conventional methodological terms, the literature review is
largely carried out in advance of planning the detailed research. That is, the new
research builds on the accumulated previous knowledge. In grounded theory, the
literature review should be carried out after the memo-writing process is over –
signed, sealed and delivered. In this way, the grounded theory has its origins in the
data collected, not the previous research and theoretical studies. Literature review
should be seen as part of the process of assessing the adequacy of the grounded theory
analysis. If the new analysis fails to deal adequately with the older research then a
reformulation may be necessary. On the other hand, it is feasible that the new analysis
helps integrate past grounded theory analyses.
39
Statistics – Unit XI
Qualitative Analysis of Data
40
Statistics – Unit XI
Qualitative Analysis of Data
Conversational Analysis
Conversation analysis has its intellectual roots in ethnomethodology championed in the 1960s
by the American sociologist Harold Garfinkel (1967). He wanted to understand the way in
which interactions in everyday life are conducted. In particular, ethnomethodologists were
concerned with ordinary everyday conversation.
Harold Garfinkel’s Ethnomethodology – The Methodology by which people make sense of
their everyday interactions.
Goffman’s Dramaturgical approach – Social Interaction is an institution with norms and
obligations for members.
Harvey Sacks - Regarded as the founder of conversation analysis. He was interested in the
telephone calls made to hospital emergency departments. His research strategy involved an
intense and meticulous examination of the detail of conversations. In conversation analysis,
emphasis is placed on the analysis of turn-taking – members of conversations take turns to
speak and these turns provide the basic unit for examining a conversation.
Two conversation turns (such as in the above examples) in sequence are known as ‘adjacency
pairs’ and essentially constitute one of the major analytic features in conversation analysis.
Without the emphasis on adjacency pairs, the structured, turn-taking nature of conversation
would be obscured. A prime objective of conversation analysis is to understand how an
utterance is ‘designed’ to fit in with the previous utterances and the likely nature of
subsequent turns in the conversation.
Telephone conversations illustrate conversation analysis principles well in that they indicate
something of the organized nature of even the simplest of conversational acts:
Person A – Hello Person B - Hello, it’s me
Person A – Oh, Hello Jenny Person B – You have taken a long time to answer my call
It is quite easy to see in this the use of greetings such as Hello to allow for the voice
identification of the speaker. There is also an assumption that the hearer should be able to
recognize the voice. Finally, there is an expectation that the ring of a telephone should initiate
the response fairly rapidly in normal circumstances. It does not take a great deal to figure out
that this is likely to be a call between close friends rather than, say, a business call. This
interpretation may not be sophisticated in terms of the principles of conversation analysis, but
it does say a good deal about the nature of turn-taking in general and especially in telephone
calls.
41
Statistics – Unit XI
Qualitative Analysis of Data
It is one of the assumptions of conversation that the speaker will either indicate to another
speaker that it is their turn to speak or provide the opportunity for another to take their turn.
So, it is incumbent on the speaker to include a ‘transition relevance space’ which provides the
opportunity for another speaker to take over speaking. The key idea is that in conversation
analysis the principles of conversation are regarded as directly governing the conversation.
In conversation analysis the study of how ordinary life conversation is conducted involves the
following stages:
● The recording stage, in which conversation is put on video or audio-only recording
equipment.
● Transcription, in which the recording or parts of the recording are transcribed using
the minutely detailed methods of Gail Jefferson’s transcription system. This system
does not merely include what has been said but, crucially, a great deal of information
about the way in which it has been said.
Jefferson’s Transcription - One popular system for transcribing speech is the system
developed by Gail Jefferson. This has its origins in her work with Harvey Sacks, the
‘founding-parent’ of conversation analysis. The Jefferson system can appear a little confusing
to novices – and not easy for those familiar with it – but using it is a skill which will improve
with practice. Jefferson’s system has no special characters so it can be used by anyone using a
standard computer or typewriter keyboard. some familiar keystrokes have a distinctive
meaning in Jefferson transcription. These keystrokes are used as symbols to indicate the way
in which the words are delivered in the recording. Thus, capital letters may indicate the start
of a sentence or a proper noun, but they may indicate that the speaker has said a word with
considerable emphasis using greater emphasis than the surrounding words.
● Analysis consists of the researcher identifying aspects of the transcription of note for some
reason, then offering suggestions as to the nature of the conversational devices, etc. which
may be responsible for the significant features. But things do not come quite as easily as this
implies.
Stages in Conversation Analysis
1. Mechanical production of the primary database (materials to be analyzed) - Data
recording is done by a machine. A human decides what and when to record, but the recording
is basically unselective, so that what is recorded is not filtered through human thinking
systems, tidied up and the like. This original recording may be returned to at any point. For
42
Statistics – Unit XI
Qualitative Analysis of Data
that reason, the recording remains available continually throughout the analysis for checking
purposes by the researcher or even by others.
2. Transcription - The transcription should be as unsullied by the transcriber as possible.
It is all too easy for a transcriber to make systematic errors, some of which fall into
line with their expectations. There are, of course, several possible ‘hearings’ for any
mechanical recording. Each transcriber needs to be alert to this possibility. Many
regard it as essential that the researcher themselves transcribes the recording. This
ensures the close familiarity that is needed for effective analysis. The transcription
enables the researcher to both confront but also cope with the rich detail of the
conversation.
3. Selection of the aspects of the transcript to be analyzed - There are no formal rules for
this and it can simply be a case of the analyst being intrigued by certain aspects of the
conversation. Others may be interested in particular aspects of an interaction. Just one
adjacency pair (the minimum unit that makes up a conversation) may be sufficient to
proceed.
4. Making sense of/interpreting the conversational period - Researchers are part of the
culture that produced the conversational episode. Hence, they can use their own
common-sense knowledge of language to make sense of the episode. This is
appropriate since it reflects exactly what participants in the interaction do when
producing and responding in the conversation (constructing adjacency pairs). The
relation between different aspects of conversation can then be assessed.
5. Explication of the Interpretation – The researcher’s native or common-sense
understanding of what happens in an episode is clearly a useful resource as we have
seen. Nevertheless, this is insufficient as an explication without bringing the links
between this resource and the detail of the conversational episode together. The
analyst may feel they know what is happening in the conversation, but they need to
demonstrate how their understanding links to the detail of the conversation.
6. Elaboration of the analysis - Once a particular episode has been analyzed, the rest of
the transcription can be used to elaborate on it. The conversationalists may hark back
to the earlier episode and reveal ways in which they understood it. As a consequence,
the analyst may need to reformulate the analysis in some way or even substitute a
completely different analysis.
43
Statistics – Unit XI
Qualitative Analysis of Data
7. Comparison with episodes from other conversations - The analysis process does not
end with a particular transcription and its analysis. It continues to other instances of
conversation which are apparently similar. This is vital because a particular
conversational episode is not considered to be unique since the devices or means by
which a conversational episode is both recognized and produced by the
conversationalists are the same for other conversationalists and conversations.
Advantages
1. Precision – Including any nuances, such as laughter tokens, turn restarts, uhs and ahs
and even silence.
2. Reusability – Transcripts become a public record and can be reanalyzed. Recordings
can be replayed as well.
3. Provide detailed and true data
4. Focuses also on the micro-level conversations.
Disadvantages
1. Time consuming and costly activity – It is difficult to analyze a large body of data.
Conversational Analysis requires specialized training
2. The analytic processes of Conversational Analysis is sensitive. Transcription is a
subjective process.
3. Stereotyping and over-generalization of the conversations.
4. It is possible to make a possible misinterpretation that is out of context.
44
Statistics – Unit XI
Qualitative Analysis of Data
Protocol Analysis
Protocols are participants’ accounts of their thought processes during the performance of a
specific task. Protocol analysis is a method of inferring how humans’ reason and solve
problems, using the protocols collected as data.
Protocol analysis is a set of methods for obtaining reliable information about what people are
thinking while they work on a task. Therefore, it refers to a variety of methods for obtaining
and analysing verbal reports. The researcher simply asks the participant to "think aloud" and
verbalise his or her thoughts as if the participant were alone talking to him/ herself. The
procedure is not conversational, and attempts to minimize social verbal behavior. The
experimenter's role is only to prompt the participant to "please keep talking" if he or she
becomes silent. At the end of the experiment, the participant's verbalizations are transcribed
into text from the tape recording.
Verbal protocol analysis is an underused but potentially valuable qualitative data-collection
tool whereby participants think aloud while engaging in a task or behavior. It has been shown
to provide unique and valuable insight into the cognitive processes that individuals used in a
variety of settings.
Analysis typically proceeds by segmenting the protocols into blocks of text. The size of these
blocks depends on the level at which the data become orderly; the experimenter must decide
ahead of time what the variables of interest are, and these are often based on the theory or
phenomenon being studied. Segmenting is a procedure used to create individual statements
from long and continuous transcripts. Once the transcribed protocols have been segmented
into blocks, the blocks are then randomly reordered and presented out of context to coders
who rate each block based on a scheme devised by the experimenter. The coded blocks are
then reassembled in their original order for analysis, followed by some check on interrater
reliability.
Conducting Verbal Protocol Analysis
Collect concurrent data. Research strongly suggests that data collected in real time are
superior to those collected after the fact; therefore, whenever possible, have participants
vocalize their thoughts as they engage in the task.
Record the data. Early forms of VPA relied on the experimenter’s notes because recording
equipment was not readily available. However, the ubiquity of analog and digital recording
equipment makes recording protocols simple and cost-efficient.
45
Statistics – Unit XI
Qualitative Analysis of Data
Transcribe the data. Although qualitative data are never easy to manage, computer programs
are available to provide assistance, but only when data are fully transcribed.
Plan your work. Have an idea of what you are looking for before you immerse yourself in the
data. As with any research technique, this means drawing from relevant theory, making
specific predictions about what you expect to find, and specifying defensible ways to
determine whether your predictions were met.
Encode the episodes -> check reliability and validity -> Analyze the code patterns.
Advantages
● Protocol Analysis allows researchers to gather data about cognitive processes "on
the spot"; it does not rely on the subject's recollection of a process.
● When combined with video-taping, Protocol Analysis can be used to rapidly
evaluate user-interfaces and to pinpoint areas of cognitive dissonance between the
user's preferred workflow and the on-screen metaphor of the interface.
Disadvantages
Protocol Analysis can capture certain kinds of thinking (linear, workflow), but not all types of
thinking. Protocol Analysis may not completely describe the process that the investigator is
looking for, and may require secondary interviews or "probing". Ericsson and Simon
recommend these secondary data be gathered with retrospective reports, so as not to interfere
with the task itself.
Because some subjects may find the process of thinking aloud to be uncomfortable or
unnatural, they may actually alter their performance of a task during the process of Protocol
Analysis.
46
Statistics – Unit XI
Qualitative Analysis of Data