Social Science and Philosophy Gee2 Prelim
Social Science and Philosophy Gee2 Prelim
3. What is ‘Best’ Evidence? Before discussing what 5. Systematic Reviews At the top of the evidence
counts as ‘best’, it is necessary to define ‘evidence’. It is often hierarchy comes the systematic review. Meta-analysis is a widely used
mistakenly spoken of as if it were a fixed property of a statement. It is strategy for integrating the findings from multiple studies using statistical
more correctly seen as in a three-place relationship. It is of something, methods aimed at increasing the population size and thereby
and it is useful to someone to use as good grounds for accepting some strengthening the reliability of the results. The basic idea is that, if policy
claim. Research results become evidence only when someone decides P has been shown to be effective in achieving the desired goals in several
that they will support the case they are trying to make. But what is RCTs conducted in different places, then there is more confidence that
noticed and considered relevant depends on the thought processes of the policy P really achieves those results.
individual who decides to use it as evidence. In general usage, ‘evidence’
can refer to many types of information. It can refer to the facts in a legal 6. Criticisms of EBP 1: The Claim to Be Objective A
case. It may be expert opinion. It can mean the evidence of our senses, challenge to EBP comes from those who claim that the concepts that are
what we see, hear, etc. used in empirical social research are framed and chosen by particular
groups in society. There is a fear that those in power have a dominant
The need for methodological validity derives from the many sources influence, and this may distort or omit the way the issues might be
of error that can creep into evaluations of policies. understood by less powerful groups. This challenge is of particular
significance in social policy because it so often involves powerful policy-
1. Ethical concerns: Randomly allocating individuals to makers making decisions that affect the most vulnerable in society who
different interventions raises serious ethical and sometimes often have weak political representation—children, those suffering
legal issues to do with informed consent. mental illness, or the disabled, for example.
2. Learning curves: Many interventions may take time to be
perfected. The question then arises as to when evaluations of 7. Criticisms of EBP 2: The Claim to Produce
these should be undertaken. Too soon and even those with Universal Knowledge How universal are the results of social research?
potential are likely to be rejected; too late and ethical A key tenet of EBP is that the findings about causal connections that are
considerations may preclude randomization. established by a well-conducted RCT can be used by others to inform
3. Variable delivery: The delivery of many interventions may their decision-making. As a limit to universalizability, there is some
rely on the skills of the deliverer. Ensuring consistent and proviso of the form that the new population has to be ‘sufficiently
replicable delivery may be difficult leading to concerns about similar’ to that in the RCT. The problem is in determining what is
what, exactly, is being evaluated. ‘sufficiently similar’.
4. Interactions: There may be interactions between the
intervention deliverer and the intervention recipient, which 8. Criticisms of EBP 3: The Preference for RCTs Limits
affect the likelihood of achieving beneficial outcomes. the Questions that are studied But what works is not all that matters.
5. Individual preferences: Individuals may have strong prior To interpret the call for evidence-based policy and practice in these terms
preferences that make their random allocation to groups alone is to disregard a whole set of other important questions in policy
problematic or even unethical. development, like what is going on? What’s the problem? Is it better or
6. Customized interventions: Some interventions may need worse than . . . ? What causes it? What might be done about it? At what
considerable customizing to individuals to achieve best effect. cost? By whose agency? . . . There needs to be research that is
Concerns again rise as to what is being evaluated. descriptive, analytical, diagnostic, theoretical, and prescriptive. That is,
7. Lack of group concealment: Knowledge of group allocation an evidence base to policy in all stages of the policy cycle—in shaping
may lead to changes in behavior or attitudes, which agendas, in defining issues, in identifying options, in making choices of
undermine the unbiased nature of any evaluation. action, in delivering them, and in monitoring their impact and outcomes.
8. Contamination: Understanding by participants of the nature (Solesbury 2001: 8)
of the evaluation may lead to convergence between the groups
diminishing any effect sizes. 9. The Limited Role of Research Evidence in Policy-
9. Lack of blinding: Blinding is difficult or impossible for Making Politics is the art of the possible and acceptable. Policies tend to
many interventions, with the attendant irks of bias being affect many different groups in society, and they often have different
introduced by study subjects’ behavior, compensatory values and views on the merits of the various options available to policy-
activities by external agents, or differential outcomes makers. In practice, making policies involves adjudicating between and
assessment. seeking to reconcile the preferences of many different people. Many have
10. Poor compliance: Individuals allocated to one intervention or sought to list the numerous factors that influence policy-making. Weiss
another may fail to comply with stipulations thus undermining (1977) offers the four Is:
the assessment. (Davies et al. 2000: 256) 5
Information: the range of knowledge and ideas that help
4. Randomized Controlled Trials Historically, society people make sense of the current state of affairs, why
has given weight to the views of experienced practitioners. Doctors who things happen as they do, and which new initiatives will
treat patients, and see them recover or deteriorate, form views about what help or hinder;
works or not. Teachers, too, develop ideas about how best to teach their Interests: i.e. self-interests;
classes on the basis of what has gone well or badly in previous years. Ideologies: philosophies, values, political views;
Philosophers call this line of reasoning ‘post hoc ergo propter hoc’— Institutions: shaping how individuals interpret their own
after this, therefore on account of this. interests and views and affecting the decision process
itself—who gets to speak, who makes the decisions.
The key features of RCTs are, first, a study in which participants are
assigned to an experimental or control group. In a randomized controlled 10. Conclusion While policy-makers have always drawn on
trial, participants are assigned to a group at random (i.e. they have an science for some guidance in formulating policies, EBP is a more
equal probability of being assigned to any group). This increases the systematic approach which follows evidence-based medicine in
probability that any confounding factors that could affect the outcomes emphasizing the importance of policy-makers considering the ‘best
you are studying will be equally distributed between the groups. evidence’. The nature of social reality—the social construction of key
concepts—is one obstacle to generating universally valid findings about
Procedures are controlled, seeking to ensure that all participants in all causal pathways. The complexity of causality in an open system is
study groups are treated the same except for the factor that is unique to another. The causal impact of any policy will be shaped by its
their group. The unique factor is the type of intervention they receive. interactions with other parts of the social system as it is implemented and
When the study involves interactions between a service provider and a this, in turn, will produce varied outcomes in different locations.
service user, as most medical and social interventions do, knowledge of
whether the user is in the experimental or control group can influence the
way the service is administered and how progress is measured, both
consciously and unconsciously. Therefore, ideally, both the person
providing the service and the person evaluating it are ‘blind’, i.e. ignorant
of which group the individual belongs to.
It is a theoretical system based on this simple view of
well-being ECONOMICS
QUIZZES It is all serious measures of well-being incorporate
WELL BEING WEEK 1 objective indicators such as medical care, family
dynamics, accessed to education, play, adequate food,
and hygiene CHILD WELL-BEING
1. Science-value-coordination how to do it and how not
to-is one of the central problems facing philosophers It understand flourishing not as a unified phenomenon
of social science THE PROBLEM OF SCIENCE- but as encompassing several components: a sense of
VALUE COORDINATION autonomy, mastery, purpose, connectedness to people
2. Understand flourishing not as a unified phenomenon WELL-BEING WITH FLOURISHING OR
but as encompassing several components: a sense of EUDAIMONISM
autonomy, mastery, purpose, connectedness to people It refers to a single unified concept that serves its
MAJOR CONSTRUCTS OF WELL-BEING IN purpose in all contexts in which we apply the term
THE SOCIAL SCIENCES INVARIANTISM
3. There is a single term such as ‘well-being’ Variantism and Invariantism states that “well-being is
VARIANTISM AND INVARIANTISM ABOUT a single term” TRUE FALSE
WELL-BEING Subjective satisfaction is understood as the ability to
4. The value philosophers contemplates in well-being is go through one’s day reasonably TRUE FALSE
called ‘prudential’. Prudential value is supposed to The big three theories in philosophy includes
bear a special relationship to us: well-being is not ‘Hedonic Balance’, Well-being is life satisfaction and
merely good; it is also good for us THE Eudaimonism TRUE
PHILOSOPHY-SCIENCE DISCONNECT The value philosophers contemplates in well-being is
5. Mental state theorists, as the name suggest, take our called ‘prudential’ TRUE
mental states, and only them, to constitute our well- Eudaimonism is an endorsement of the balance of the
being. For something to be good, this good to has to many values and priorities in life FALSE
have a special relationship, it has to engage, or
resonate with, or be responsive to the priorities of a
person THEORIES OF PRUDENTIAL GOOD