When a mental shortcut applies previous learning recalled from the unconscious mind
What does the accuracy of intuition depend on?
the validity of the origial learning
the current situation being one where the prior learning is applicable
Are statistical prediction rules more economical than clinical judgment?
What are the 3 possible ways to make a decision (based on SPR)
Method #1: Relying on experience and training to make an intuitive predition
Method #2: Relying wholly on the SPR developed to be used in that situation
Method #3: Taking account of the output of the SPR but possibly modifying it based on professional experience and intuition
What is a fact?
When scientists conducting the same research procedure get the same results
What is a theory?
A convenient way to summarize facts so they can be grasped by our human minds
What is objectivity?
The degree to which qualified people agree on something
What is nomothetic?
That which can be generalized (basic principles
What is idiographic?
That which is unique to an individual
What does science usually come down to?
the personal experience of the scientist
Who were logical positivists?
Revolted against idealism
Goal #1: distinguish between science and metaphysics (the problem of demarcation)
Goal #2: to recontruct all (scientific) knowledge from experiece or sense data (confirmation of theories)
What is demarcation?
the ability of the theory to be falsified or the scientist's ability or willingness to state in advance what would count as falsifying it
What do Popper (Neopositivism) believe?
science is characterized by the fact that its theories are falsifiable
the method of science is to propose bold conjectures and try repeatably to find them false
What is confirmation?
Acceptance of a theory that is most falsifiable, but not falsifiable
What is Kuhn's view of neopositivism?
Neopositivism is not supported by the actual history of science
Dependence of theory choice in science is on factors other than observation and logic
Why are paradigms chosen?
It solves the problem that lead its competitor to crisis
It's more simplistic or has a more accurate empirica fit
Once a paradigm is accepted...
its basic laws and theories are not subjected to testing and used to solved the problems the paradigm encounters
What is data partially determined by?
the paradigm they support
What is the difference between immature and mature sciences?
Mature science has reached the stage where one paradigm at a time dominates research
Immature sciences is where a number of paradigms compete and more time is taken in debate than research
Kuhn suggests the history of science is best understood as...?
A succession of paradigms
What is a research program?
A series of complex theories whose hard core remains the same while auxiliary hypotheses are successively modified, replaced, or amplified in order to account for problematic observations
Lakatos suggests that the history of science is best understood in terms of...?
In terms of competing research programs
When is a research program progressive?
1.) Each new version of the theory (hard core theory plus auxiliaries) preseves the unrefuted content of its predecessor
2.) Each has excess empirical content over its predecessor; it predicts some novel, previously unexpected facts
3.) Some of these predicted facts are corroborated
1&2 = theory progressive
1,2 &3 = theory and empirically progressive
When is a research program degenerating?
When the change from one version to the next accounts at most for the one anomaly for which the change was made, but does not allow for the prediction and discovery of any novel facts
What is a negative heuristic?
the plan to avoid falsification of the hard-core, to direct the tests of the theory against the auxiliary hypotheses and suitable modifications there
What is a positive heuristic?
The development of the auxiliary hypotheses proceeds according to a preconceived plan
What is the difference betweeen immature and mature science (Lakatos)
Immature only has negative heuristics
Mature has both negative and positive heuristics
Why is it rational to continue to work on a degenerating program?
A degenerating program can sometimes be turned around (made progressive again
Competition in the field generally leads to more overall progress
Explain the idea of "hierarchy of science"
One level of science can get support from other levels of science
Interconnection constrains science
How does the interconnection within the hierarchy of science constrain science?
Laws and theories of higher levels have to conform to lower-level laws
Lower levels also have to permit the phenomenon described by the levels above them
What is reductionism?
Dividing an entity into its base parts, and explaining its properties or behavior in terms of the base parts' properties or behavior
One has to consider not only the parts of an entity, but also its ______ with its environment in order to understand it.
The demise of reductionism can be attributed to....:
What is emergence?
The appearance of properties and processes that are only describable by concepts pertaining to a higher level of analysis, which are neither applicable at the lower level nor reducible to (translatable itno) concepts at the lower level.
What is decoupling?
The relative economy of levels in the hierarchy of sciences; each level of the hierarchy of sciences has been stabilized in terms of causation and theory, and the partitions between the sciences are fairly well understood
interactions at the lower levels cannot be predicted by looking at the structure of these levels alone; higher-level variables, which cannot be reduced to lower-level properties or processes, have genuine causal impact. The higher-level system needs to be considered in giving a complete causal account
A naturalistic but non-reductionistic account of entities
Reduction will be possible when....
In the limiting case where B (base) constitutes S (supervenience) under all C's (circumstances) and S (supervenience) is NOT multiply realizable. An example here would be consciousness (S), which is possibly only when there is a certain neural activity
Reduction will NOT be possible when...
There are multiple C's (circumstances) that make a difference to S (supervenience) and the C's (circumstances) cannot be defined in terms of B (base).
or when S is multiply realizable by an infinite set of B's
What is the general purpose of science?
To establish knowledge
Scientific research attempts to...
Simplify the complexity of nature and isolate a particular phenomenon for scrutiny
What does methodology teach science?
Ways to think about the relations between variables
About causes and effects
About conclusions drawn from theory, research, and experience
Scientific Hyptheses attempt to:
explain, predict, and explore specific relations
What is parsimony?
Accept the simplest version or account of the data among the alternatives that are available
Adopting the simplest of competing views of explaining a phenomenon
What is a plausible rival hyptheses?
Other explanations, outside of the hypothesis, that may explain findings
The better the experiment, the fewer the alternatives
What are Findings?
the results that are obtained
What are Conclusions?
The explanation of the findings
What are steps of ruling out rival hypotheses?
selection of subjects
various control groups
What is replication?
Accumuation of multiple investigations
In most research the findings are...
What does methodology have to do with?
What is internal validity?
The extent to which the intervention accounts for the effect
What is history?
Any event occurring in the experiment (unplanned events disrupting administration) or outside the experiment (hisotrical events) that may account for the results
What is maturation?
Processes within the subjects that change over time, such as growing older, strongr, wiser, tired, or bored
What is testing?
When taking a test has an effect on the subsequent performance or learning
What is instrumentation?
Changes in the measuring instrument or measurement procedures over time
What is statistical regression?
The tendency for extreme scores at Time 1 to revert toward the average at Time 2, particularly a problem when subjects are selected because of extreme scores at Time 1
What is selection bias?
the use of different methods for selecting subjects for experimental conditions causing systematic differences in the groups
What is attrition?
Participants dropping out of the study over time
What can affect groups in a study?
combination of history, maturation, and other threats
What is diffusion or imitation of treatment?
When the intervention given to one group is also provided accidentally to all or some subjects of another group
What is the purpose of a control group with random group assignment?
To rule out the threats to internal validity because both groups will share the effects of these influences
What is external validity?
The extent to which the results of an experiment can be generalized or extended outside of the experiment
What are sample characteristics?
How representative of the population is the sample?
To what extent can the results be generalized to another sample that varies in age, race, ethnic background, education, or any other characteristic
What are stimulus characteristics and settings?
To what extent is the effect due to the particulars of the setting, experimenters, interviewers, or other factors in experimental arrangement
What is reactivity of experimental arrangements?
How much did it matter if the subjects knew they were participating in a study
Would the results be the same if the subjects were not aware that they were being studied?
What is multiple treatment interference?
When one treatment is in the context of other treatments, how do you know which one caused the effect?
What are novelty effects?
When the effect depends on the fact that the intervention is administered under conditions that are particularly salient, infrequent, or otherwise novel
What is an obtrusive measure?
When subjects are aware that their performance is being assessed
Concern to external validity b/c awareness that performance is being assessed can alter performance
What is a reactive measure?
When awareness of assessment leads persons to respond differently from how they normally would
What is test sensitization?
The administration of a test may in some way sensitize the subjects so that they are affected differently by the intervention
What is time measurement?
Would the result be the same if the measurement had been taken at another time, especially several months after treatment
Which is more important: internal or external validity?
What is efficacy?
treatment outcomes from controlled studies that are conducted under laboratory-type conditions
What is effectiveness?
treatment outcomes obtained in clinic settings where the usual control procedures are not implemented
What is construct validity?
Did the study test what the researcher meant to test?
What are confounds?
features within the experiment that can interfere with the interpretation
What are attention and contact with clients?
Differential attention across experimental and control groups may be the basis for group differences and threaten constrcut validity
What is the placebo effect?
An apparently effective treatment or intervention that has no active treatment properties that would be expected to produce change for the problem to which it is applied
What are experimenter expectancies?
Unintentional process where the expectancies, beliefs, and desires about the results on the part of the experimenter influence how the subjects perform
What are the cues of the experimental situation?
Seemingly trivial things associated with intervention that may contrubte to the resuls (i.e. info given to subjects prior to their arrival of the experiment
What is statistical conclusion validity?
How well can an investigation detect the effect, and how large is it?
What is a null hypothesis?
There is no statistical difference between the groups; we can reject the NH if we find a statisticaly significant difference, or accept this hypothesis if we do not
What is a Type I Error?
The probability of rejecting the NH when it is true--being too liberal in interpretation
What is a Type II Error?
The probability of accepting the NH when it is false--being too conservative in interpretation
What is power?
The probability of finding a real effect: 1 minus Type II Error
What is low statistical power?
When power is weak
Likelihood of concluding that there are no differences between groups
What is subject heterogeneity?
The greater the heterogeneity of subject characteristics, the less likelihood of detecting a difference between conditions
Either homogenize or control statistically using multivariate regression and correlation methods
What are unreliable measures?
Reliability puts the ceiling on the effect size
What are multiple comparisons and error rates?
The more statistical tests perfomed, the more likely a chance difference will be found even if there are no true differences between conditions
When can interferences in a study be addressed best?
An increase in sensitivity of a test can result in...?
Limited generality of findings
Enhancement of generality of a test can result in...
Decrease in the sensitivity of the test
What is an artifact/bias?
Extraneous influences that may threaten the validity of experiments
What is the Loose Protocol Effect?
When the investigator does not carefully specify the rationale, the scrip, and activities of the experimenter = introduces variability
What are experimenter expectancy effects?
The experimenter may influence how the subject responds through tone of voice, posture, facial expressions, or other cues
What are demand characteristics?
Cues in the experimental situation that may influence how subjects respond
What are subject roles?
Different ways of responding to the experimental cues of the experiment
The good subject
attempting to support what they think is the experimenter's hypothesis
The negativistic subject
Attempting to refute what they think is the experimenter's hypothesis
The apprehensive subject
being concerned that experimental performance will be used to evaluate their abilities, personal characteristics, or opportunities
The faithful subject
attempting to carefully follow the experimental instructions
What are subject selection biases?
the experimental influences that are attributable to the types of subjects who participated in the experiment
What are samples of convenience?
the selection and use of subjects merely because they're available, and not because they are appropriate for the study
How can the loss of subjects affect virtually all aspects of experimental validity?
Changing random composition of the groups and group equivalence (internal validity)
Limiting the generality of findings to a special group who are persistent (external validity)
Raising the prospect that the treatment X special subject characteristics interaction accounts for the conclusions that the investigator would actually like to attribute to the intervenion (external and construct validity)
Reducing sample size and power (statistical conclusion validity)
Where do research ideas usually come from?
What is correlation?
An association between variables at a given point in time, no time sequence established
What is a risk factor?
a correlation in which a time sequence is established
What is a cause?
a change in one variable leads to a change at another variable
What are moderators?
Factors that influence the relationship between variables
What are mediators?
the mechanisms or processes through which a relationship works
What is a theory?
a conceptualization of the phenomenon of interest
Why is theory good?
Brings order to areas where findings are diffuse
Explains causal relationships
Gives a manageable focus to research
Leads to a more effective application of the research to practical probems
Helps us understand a phenomenon
What are operational definitions?
Defining a construct based on the specific operations used in the experiment
What are the advantages of multiple operations?
Allows an investigator to place more confidence in capturing the construct of interest
Name two experimenter variables
IV --> DV
one the researcher manipulates
one the researcher observes to see how it responds to the different IVs
Name two observational variables?
PV --> CV
analogus to an IV
Manipulated by elements outside the researcher's control
Analogus to DV
Observed changes theoretically interpreted to have been in response to changes in the predictor variabl
Name 2 measurement variables
LV --> OV
the construct of interest, typically not directly measureable
the specific measures of the construct
What are true experiments?
Random group assignment
control over the IV
control over internal validity
Strongest basis for drawing causal inferences
What are true experiments conducted in the context of an intervention?
Randomized Controlled Clinical Trials
What is a quasi experiment?
Less control than true experiment
lack of random group assignment
can still yield valid causal inferences
What is case control design?
the variable of interest is studied by selecting cases that vary in the characteristic or experience of interest
can provide important insights
What is a cross-sectional study?
variable of interest is studied by selecting cases that vary in characteristics or experience of interest
make comparisons between groups at a given point in time
What are longitudinal studies?
Make comparisons over an extended period
What is random selection?
There is an equal probability that subjects within the population can be selected
Enhances the generality of the results
What is random assignment?
The probability of each subject appearing in any of the groups is equal
What are nuisance variables?
Characteristics in which the researcher is not interest but could influence the results
random assignment make this less of the problem
What is matching?
grouping subjects together based on their similarity on a particular characteristic
Matching without randomizing leads to...
differential regression to the mean
What is a pretest - posttest design
controls threats to internal validity
brings both the advantages and disadvantages of using a pretest
What are the advantages of using a pretest?
Allows the matching of subj. on one of the variables assessed
Permits evaluation of matched variable in the results
Increases statistical power
Allows the examination of who changed and what proportion of subjects changed in a particular way
Allows evaluation of attrition
What are the disadvantages of a pretest?
There might be a testing effect
What is a posttest only design?
No pretest is given
Less popular in clinical research because of smaller experimental groups
What is a Solomon Four group design?
Gets at whether a pretest influences the results, but takes twice the effort and cost
What are factorial designs?
Allows the simulataneous investigation of two or more IVs in a single experiment
Two or more conditions are administered
What are the characteristics of Factorial Design?
Allows the analysis of interactions (where the effect of one of the IVs or PVs depends on the level of one of the other IVs or PVs)
Good because you can assess the effects of separate variables in a single experiment,
Different variables can be studied with fewer subjects and observations
Can look at interaction effects
Number of groups multiplies quickly
What is the pretest-posttest control group design?
depends directly upon the similarity of the experimental and control groups
threats to validity differ between groups
what are Posttest only design cons?
attributing group differences to the intervention is problematic
Multiple Treatment Design
Each of the different treatments is presented to each subject
Usually done with 2 groups in evaluating the effects of medication