Acknowledging another's technical assistance in publication without that person's permission.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Acknowledging another's technical assistance in publication without that person's permission.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Adding additional research participants because the results collected thus far are not yet statistically significant.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Adding additional research participants because the results collected thus far are not yet statistically significant.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Adding or deleting co-authors to increase chances of acceptance.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Changing the design, methodology or results of a study to please a sponsor.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Changing the design, methodology or results of a study to please a sponsor.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Concealing data or results that contradict one’s own previous research.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Deciding whether to include or exclude data after looking at the impact of doing so on the results.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Deciding whether to include or exclude data after looking at the impact of doing so on the results.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Deliberately delaying reporting results in order to publish findings in a higher impact journal.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Deliberately delaying reporting results in order to publish findings in a higher impact journal.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Drawing strong inferences from statistically significant but underpowered results.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Drawing strong inferences from statistically significant but underpowered results.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Failing to acknowledge significant sources of financial assistance.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Failing to attain appropriate informed consent.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Failing to disclose all potentially relevant conflicts of interest.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Failing to report all of a study’s outcome measures.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Failing to report all of a study’s outcome measures.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

For a researcher, how important is choosing a sample size before running a study?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important are decisions in data collection, analysis, and reporting in affecting how likely a research will find a significant effect?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important are research ethics to you?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important is it for you to avoid questionable research practices?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important is it that results from a psychology study are counterintuitive (e.g., different from what you would expect)?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important is it to consider the impact of questionable research practices on science?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important is it to make data publicly available so that results can be verified by other researchers?

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How important is it to report studies that "don't work out?"

• Not At All Important<br>1
• 2
• 3
• 4
• 5
• 6
• Very Important<br>7

How would you describe yourself? (Choose one or more of the following)

• Asian or Asian American
• Caucasian
• African American
• Hispanic or Latino
• Other

I am completely rational.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I am confident in my judgments.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I am not always honest.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I avoid listening.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I can't make up my mind.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I don't gossip.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I have doubted my ability as a lover.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I have said something bad about a friend.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I have taken advantage of someone.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I know why I like things.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I like psychology.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I never cover up mistakes.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I never regret my decisions.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I never take things.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I sometimes tell lies.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I sometimes try to get even.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I think psychological research is similar to research in fields like chemistry, physics, or biology.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I think psychological research is similar to research in fields like philosophy, literature, or modern languages.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I think psychology is a “soft” science.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

I trust the results of studies done by psychologists.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

In what doctoral program are you?

• Brain and Behavior
• Clinical
• Counseling
• School

In what year are you currently in your program?

• First Year
• Second Year
• Third Year
• Fourth Year
• Fifth Year
• Sixth Year

It is important for a research to report all measures and experimental conditions that were included in a study.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

It's hard to shut off a disturbing thought.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

Overlooking or ignoring others’ questionable research practices.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Overlooking or ignoring others’ research misconduct.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Please create for yourself a unique identifier that will allow us to link your data throughout the duration of this study; you will be assessed on these data three times total.Please make a unique identifier that includes three parts: (1) Your mother's maiden name, (2) Your hometown, and (3) the year in which you were born. For example, if your mother's maiden name were Jones, you are from Cleveland, and you were born in 1990, your identifier would be JonesCleveland1990. This will then be your identifier for the remainder of the study.Whenever you provide this unique identifier, please click "Continue".

Providing a biased peer review of a manuscript submitted to a journal for publication in order to delay its publication so as to benefit one’s own research.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Publishing results of a single study as several articles simply to increase the number of publications derived from the research (the so-called “salami slicing” problem).

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Publishing results of a single study as several articles simply to increase the number of publications derived from the research (the so-called “salami slicing” problem).

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Questionable research practices have a considerable negative impact on science.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

Re-use of one’s own previously published data, results, or analysis without citation.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Re-use of one’s own previously published ideas or words without citation, such as parts of a literature review section, introduction or methodology, but without re-using data, results, or analysis.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Re-use of one’s own previously published ideas or words without citation, such as parts of a literature review section, introduction or methodology, but without re-using data, results, or analysis.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Refusing to provide experimental data to a co-author.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Refusing to share data or materials with other researchers to prevent questions about the quality of your work from being raised.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Replication of research is only a problem in the field of psychology.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

Reporting an unexpected result as having been hypothesized from the start.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Reporting an unexpected result as having been hypothesized from the start.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Researchers who perform replication studies are not qualified to conduct psychological research.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

Rounding off a p value simply to make results seem more significant, such as by reporting a p value of .044 to be p = .04.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Rounding off a p value simply to make results seem more significant, such as by reporting a p value of .044 to be p = .04.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Selective reporting of subgroups, outcomes, and time points.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Selective reporting of subgroups, outcomes, and time points.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Selectively discussing only studies that supported the hypothesized result(s).

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Selectively discussing only studies that supported the hypothesized result(s).

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Stopping collecting data earlier than planned because the hypothesized result already had been attained.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Stopping collecting data earlier than planned because the hypothesized result already had been attained.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Studies that receive a lot of media attention are often reliable.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

Submitting a manuscript in which the sponsor was involved in data analysis and/or manuscript preparation without disclosing the sponsor’s role.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Submitting research for publication without permission from all authors.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

The field of psychology has problems replicating results.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

The incentive structure in psychological research can undermine the broader goals of science.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

The results from studies with low statistical power are, by definition, incorrect.

• Strongly Disagree<br>1
• 2
• 3
• 4
• 5
• 6
• Strongly Agree<br>7

To enhance chances of publication, violating the ideal of “replace, reduce, refine” regarding the use of research animals.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

To enhance chances of publication, violating the ideal of “replace, reduce, refine” regarding the use of research animals.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Use of others’ ideas, words, images, or other materials without citation.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

What is your age in years?

What is your gender?

• Male
• Female
• Other

What is your highest academic degree?

• B.A.
• M.A.
• M.S.
• M.D.
• Ph.D.
• J.D.
• Other

Withholding publication specifically to please a sponsor.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7

Withholding relevant details of methodology or results in publication.

• Completely Indefensible<br>1
• Moderately Indefensible<br>2
• Somewhat Indefensible<br>3
• Neither Defensible nor Indefensible<br>4
• Somewhat Defensible<br>5
• Moderately Defensible<br>6
• Completely Defensible<br>7