|
|||||||
| Psychology [Psy.D. / Ph.D.] For discussion of PsyD or PhD issues. | RSS: |
![]() |
|
|
Thread Tools | Display Modes |
|
|
#1 |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
SDN Members don't see this ad. (About Ads)
http://chronicle.com/blogs/percolato...it-finds/30255 |
|
|
|
|
|
#2 |
|
Ph.D. Student
|
I doubt it will stop those opposed to LGBT families from pushing this junk study. We'll be hearing this citation for years, but at least a smackdown is on the books.
|
|
|
|
|
|
#3 |
|
1K Member
Join Date: Jan 2007
Posts: 1,898
|
Agreed with roubs here. I still have students citing old research they overheard "somewhere" about effects of x, y, or z, even though it's been proven bunk many, many decades later.
__________________
My doctor says that I have a malformed public-duty gland and a natural deficiency in moral fiber, and that I am therefore excused from saving Universes. |
|
|
|
|
|
#4 |
|
3K Member
|
Don't get me wrong, obviously the study was flawed and the peer review process was not properly implemented. However, it sounds like the auditor they selected had pre-existing biases against the article in question. Was he really the appropriate person for that job?
__________________
"Now, I am not a professional psychologist, but I am an amateur psychologist." - Peggy Hill |
|
|
|
|
|
#5 | |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
|
|
|
|
|
|
|
#6 |
|
3K Member
|
He said that he had already found the study flawed and disagreed with its results before he did the audit.
|
|
|
|
|
|
#7 | |
|
1K Member
Join Date: Jan 2007
Posts: 1,898
|
Quote:
Of course, had the entire process been anonymous from the get-go, then perhaps there would have been fewer questions re: who was scratching who's back and who didn't do a proper job of reviewing, so on & so forth. |
|
|
|
|
|
|
#8 | |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
But does that really constitute "bias," or a good editorial eye which caught the flaws ignored by peer review? He can't be wrong! He looks so adorable in that little biking outfit! |
|
|
|
|
|
|
#9 | ||
|
1K Member
Join Date: Jan 2007
Posts: 1,898
|
Quote:
Quote:
|
||
|
|
|
|
|
#10 |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
What a dunce I are. I read the article on Friday, then put it aside and posted it yesterday. I guess we can see what kind of retention I'm working with here.
I guess I don't know what journal "editorial board members" do exactly (i.e. does each member read each and every article prior to publication?). It seems that there could be circumstances under which he could have read the article prior to the audit and developed an opinion at that time. And I don't think his previous paper constitutes a form of bias, rather, it's an empirical study of bias. As for rejecting "conservative religiosity," I guess that's my bias too... |
|
|
|
|
|
#11 | |
|
Ed Psych PhD student
|
I completely agree that the original article is seriously methodologically flawed (that said, you can say that for a lot of journal articles) and deserves some strong dose of criticism. I am surprised it was published giving the huge methodological flaws.
That being said, I did have to seriously side-eye this comment made about a review article published in the journal. Quote:
That's a systematic review. They are a) pretty common and b) often quite useful (I may be biased as an author of a couple, but they do help synthesize research, especially if the body of research doesn't yet lend itself well to statistical meta-analysis). Pointing out the limitations of small convenience samples in a body of research is also a perfectly justified criticism and again a common one in systematic reviews and meta-analyses. (Of course, the authors shouldn't have billed it as a meta if they didn't actually do statistical meta-analysis). ETA: Upon looking over the review in question, I see that it a) is never billed as a meta-analysis and b) isn't a great systematic review by my standards for systematic reviews, although it's not totally awful (IMO, of course).
__________________
"The next question in life, no matter what happened, is 'What are you going to do now?'"--Barbara Hall Last edited by futureapppsy2; 07-31-2012 at 12:14 PM. |
|
|
|
|
|
|
#12 | |
|
1K Member
Join Date: Jan 2007
Posts: 1,898
|
Quote:
|
|
|
|
|
|
|
#13 |
|
Senior Member
|
Its like the whole vaccination debacle. I still hear people talking about it too even though there was huge media surrounding its debunking.
|
|
|
|
|
|
#14 |
|
Ed Psych PhD student
|
Here's a response by the original study's author to the audit. It also notes the findings of the UT investigation, namely that there was no academic fraud or misconduct involved in the study (which isn't an endorsement of its methodological soundness or lack thereof). FYI, for those interested.
http://chronicle.com/blogs/percolato...ew-paper/30644 Last edited by futureapppsy2; 09-07-2012 at 02:51 AM. |
|
|
|
|
|
#15 |
|
Member
Join Date: Nov 2011
Posts: 94
|
I don't understand how his study got IRB approval unless someone was just skimming. The potential for "group harm" should have been very obvious.
|
|
|
|
|
|
#16 | |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
|
|
|
|
|
|
|
#17 |
|
Member
Join Date: Nov 2011
Posts: 94
|
Well like I was saying, it's still unethical because that research is harmful to gay people, which I think is a vulnerable population. For example, the results are being used by anti-gay activists to stigmatize and discriminate against gay people. This is "group harm" and it's unethical and also against federal regulations. The IRB should have caught that in its review of the study. Most universities require all employees and staff to train on this information as a part of CITI, so even UT should know it's unethical.
|
|
|
|
|
|
#18 | |
|
Senior Member
|
Quote:
Anyway, an underlying issue is that this kind of research is really an odd way to go about the entire political discussion. Straight parents don't have to pass a test to have kids, and half of them are below average in skill. Analogously, there are systemic problems with single-parent homes (due primarily to other factors, like income etc, that have nothing to do with the actual makeup of of the parental units) but no one says we should take kids away from single-parent homes, and we all see why that would be a stupid idea. So, why is an analysis of the comparison even important, either way? Clearly, both sides are trying to prove a political/moral/ideological point that completely misses another essential component. |
|
|
|
|
|
|
#19 |
|
Member
Join Date: Nov 2011
Posts: 94
|
|
|
|
|
|
|
#20 |
|
3K Member
|
1) IRBs approve protocols, not outcomes. If it reaches a point where they start trying to approve the outcomes of a study before publishing, expect violent rioting.
2) A case might be made for COI but this growing assumption that a COI inherently means bias is also dangerous thinking. It makes it a concern, yes. It does not mean research should not be done/published, nor should it mean any research with a COI should just be discounted. People need to read the literature and be smart about it, and the process should be open and facilitate it. 3) Lots of research "could" be used to stigmatize and discriminate. The fact that it demonstrates something bad about a group is an awful reason not to publish something. For one, the whole disparities literature goes away. Women don't do as well in math courses? Well too bad, we can't research it or try to come up with ways to stop it because someone might use it to discriminate against women when hiring for technical jobs.... I'm a staunch advocate for gay marriage/gay rights/etc. The article was terrible and should not have made it through peer-review on methodological grounds. It should have been relegated to some 12th tier newsletter never to be heard from again (if published at all). Extraordinary claims (which, in the face of existing literature, this was) require extraordinary evidence and this article doesn't provide anything approaching on that. Saying we can't publish anything that "might" be used for political gain is a far, far, far more dangerous form of bias than what is suggested here. For one - it just means any moderately intelligent person would just conclude that no matter how much research is out there showing gay parents are equal or better than others, that research should not be taken seriously (because any negative findings are "required" to be suppressed). |
|
|
|
|
|
#21 |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Perhaps I'm just restating what others have already said:
I think that the study's lack of rigor, when coupled with the overt political agenda of its funding source, contributes to a perception that an outcome disfavorable to gays was a goal of conducting the research. |
|
|
|
|
|
#22 |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
On another note:
Here's a gay family documentary, which may or may not be screening in a town near you: http://www.R2Lmovie.com/ |
|
|
|
|
|
#23 | |
|
Senior Member
|
Quote:
While I think it is unrealistic to think that any researcher is truly disinterested and objective in regards to the desired results, if you're studying politically charged issues, it's probably wise to have someone from the other side provide some feedback on your methodology. If your going to publish research in these areas, It's probably wise to publish a review/critique/counterpoint in the same issue. Last edited by ClinicalABA; 09-07-2012 at 09:27 AM. |
|
|
|
|
|
|
#24 |
|
Senior Member
|
This is a slippery slope. While I don't think it's the case, and this study does not show it to be the case, what if there really was some harmful effect of same-sex parenting? If there was an empirically sound, scientifically rigorous study designed to identify this effect, would you not want it to be done? The truth is the truth, and as empiricists we should want it to be discovered. The fact that my observations and desires are that same-sex parenting is not harmful (and may be beneficial in some cases) does not trump my position that we need to get as close to the objective truth as possible through empirical study. Turn your position around- if I wanted to do the same study because I was certain children raised by same-sex parents turned out better, should I not be able to do that study? If I did that study, and found the opposite to be true, should I ignore those results?
|
|
|
|
|
|
#25 | ||
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
Quote:
Edit: Arg. Proofreading errors a-go-go. Last edited by wigflip; 09-07-2012 at 09:25 AM. |
||
|
|
|
|
|
#26 | |
|
Senior Member
|
Quote:
). I was being a little pollyannish there, but wouldn't it be cool to have researchers of different ideologies agree on the methodology ahead of time? It really isn't that uncommon to pass along a manuscript to a colleague for review. Why not email the proposal to researcher on the "other side" for some feedback? The documents presumably already exist (e.g. HSRB application). I think your product would be better if you could say that "someone who doesn't believe that LGBT folks should be afforded full citizenship under the law, thinks they're "immoral" or pathological, etc" endorsed your methods before you did the study. At the very least, you could mention any of the concerns in the discussion section. In uber-phantasy land, you could run the study with both methodologies and compare the results.
|
|
|
|
|
|
|
#27 | ||
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
Quote:
|
||
|
|
|
|
|
#28 | |
|
Member
Join Date: Nov 2011
Posts: 94
|
Quote:
|
|
|
|
|
|
|
#29 | |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
What discretion do reputable journal editors already use when deciding: a) Which manuscripts to reject outright and which to pass along for peer-review b) Who to choose for review (i.e. friend or foe of PI? I've seen it done) c) How to respond to those reviews and the authors' changes d) Whether to overrule/ignore reviewers' recommendations outright I just want to acknowledge that there are many subjective areas when it comes to publication. |
|
|
|
|
|
|
#30 |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
I think this is one of the best comments on this thread. And a convincing argument for why academics who turn down their noses on interacting with the popular media are really doing a disservice to their areas of expertise and the populations they study.
|
|
|
|
|
|
#31 |
|
3K Member
|
S***storm indeed.
I've said much of my piece, so I will leave it at this. 1) If we are going to suppress all negative outcomes on a topic, we are no longer a legitimate source of information. Thus, anyone publishing a paper showing gay individuals make fine parents cannot be taken seriously. 2) Many fields will be virtually shut down and any disparities that exist can no longer be studied under such a system. So forget about trying to alleviate education gaps, etc. I maintain a collective agreement among scientists to entirely forego even an attempt at objectivity and just embrace the most extreme form of bias is utterly insane and a recipe for disaster. Wigflip is correct in pointing out that the scientific review process is inherently subjective. We should be trying to minimize those things rather than telling editors "It is now official, you can only publish papers that support x point of view". Even the pharmaceutical industry we love to call out for its bias does not take such an extreme view. Individuals doing legitimate research on gay parenting then become the new pharmaceutical companies. Everything they say would need to be viewed with suspicion. |
|
|
|
|
|
#32 | |
|
Member
Join Date: Nov 2011
Posts: 94
|
Quote:
|
|
|
|
|
|
|
#33 |
|
3K Member
|
If its methodologically sound, than absolutely we let it be published. Though I have never seen any research with those outcomes that was not enormously flawed. Until then, we just focus on plugging holes in the peer-review process that lets garbage like this slip through, and call it out for the junk that it is on the occasions that it does get through.
To do anything else means we aren't scientists. It means we are Fox News. |
|
|
|
|
|
#34 | |
|
1K Member
|
Quote:
|
|
|
|
|
|
|
#35 | |
|
Member
Join Date: Nov 2011
Posts: 94
|
Quote:
http://www.sciencedirect.com/science...77953612004480 Limitations are now placed on genetics research because it's being used by eugenicists to prove that some ethnicities are biologically superior to other groups. Was this the wrong decision because it limits science and the search for truth? I think it's the only ethical decision because the research was being used as a weapon. This is common sense for non-scientists. We can't have zero limitations and just go crazy and researching whatever topic we want under the sun because some topics will be used by bad people to harm good people. As ethical scientists we are obligated to be aware of that and withhold research to protect vulnerable populations at risk, and to continue monitoring societal reactions to our findings. Last edited by crim84; 09-07-2012 at 04:23 PM. |
|
|
|
|
|
|
#36 |
|
3K Member
|
I don't think we're going to agree here. I've certainly read the Belmont Report and taken CITI training, I have no idea why you are so focused on that - this isn't an undergrad research methods class! I've never met anyone who felt these issues are as black and white as you seem to believe - including IRB members, and a friend who specializes in bioethics. I just read (well..skimmed) the article you posted and even that doesn't come anywhere near concluding "Its unethical to even start a research project that could possibly lead to a conclusion that a stigmatized group might have lower (worse) scores on some relevant outcome measure".The basic message seems to be that we need to be very cautious in doing so, be sure to frame it appropriately, and it raises questions about informed consent. I agree with everything in it. Its also FAR removed from what you have said in this thread. I've also never seen anything in the CITI training or Belmont Report that comes remotely close to what you have said. Those also basically say we need to be careful and responsible and consider the broader context. Such documents are vague for a reason and certainly at no point do they say "You cannot publish anything that doesn't support x view".
I maintain that in your world: 1) Disparities get worse over time, not better. Mostly because we can't do legitimate work to figure out how to resolve them. 2) Scientists publishing the good work on these issues will not be respected or trusted. For perfectly understandable reasons. I'm certainly not saying go buckwild, run a garbage study, and conclude your paper with "Hitler was right". I am saying that banning any and all research on certain topics because it "might" be used to hurt someone is far, far, far more dangerous and in no way what the Belmont Report or anything else I've seen is saying. Last edited by Ollie123; 09-07-2012 at 05:04 PM. |
|
|
|
|
|
#37 | |
|
Member
Join Date: Nov 2011
Posts: 94
|
Quote:
|
|
|
|
|
|
|
#38 |
|
Neuropsychology Fellow
|
Just a quick aside--I'd personally be cautious about using phrases such as "not the real family" in this context, as it could be seen as disparaging, and depends entirely on how the individuals involved define and view "family." You could perhaps more accurately convey the message by saying "biological parents" instead of "real family," as I'm sure many adopted individuals would indeed consider their adopting parents to be their real families.
Last edited by AcronymAllergy; 09-20-2012 at 06:03 AM. |
|
|
|
|
|
#39 |
|
Senior Member
|
|
|
|
|
|
|
#40 | |
|
Senior Member
Join Date: Mar 2007
Posts: 244
|
Quote:
That's like comparing children of bitterly divorced parents to children of happily married parents and saying "see, divorce is always bad!" You're ignoring the existence of a) married parents who hate each other and make their kids miserable, b) parents who divorced amicably and still co-parent effectively, and c) parents who divorced and moved on to happy remarriages, thus setting a better example for their kids. I feel like an intro Research Methods student could have spotted those methodological flaws. On the first day of class. While still reviewing the syllabus. |
|
|
|
|
|
|
#41 | |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
Quote:
|
|
|
|
|
|
|
#42 | |
|
Senior Member
|
Quote:
I think the ones behind that one were from the family research counsel who should probably be beaten to death by true researchers for soiling the name.
__________________
To live means to suffer, because the human nature is not perfect and neither is the world we live in. |
|
|
|
|
|
|
#43 |
|
Senior Member
|
This thread goes a long way in supporting my theory that a lot of psychologists simply need to read more philosophy. You lads and lasses debate the littoral zone to death.
|
|
|
|
|
|
#44 |
|
1K Member
Join Date: Oct 2010
Posts: 1,555
|
|
|
|
|
|
|
#45 | |
|
Senior Member
|
To clarify...
Quote:
With that in mind, yes social scientists also often debate issues that sway in public opinion. We do so as a means of finding what the ultimate objective truth of a matter is. While philosophers may be satisfied with reasonable arguments, scientists seek proof. Once it was reasonable to say that the earth was flat and the earth was the center of the universe, and it was controversial to say otherwise. |
|
|
|
|
|
|
#46 |
|
Senior Member
|
Although I probably should have just warned everyone not to feed the troll.
|
|
|
|
|
|
#47 |
|
Ph.D. Student
|
|
|
|
|
|
|
#48 |
|
Senior Member
|
Sorry, I was what the frat stars might call "buzzed" when I posted that last night. Come to think of it, I dunno how I even drifted into this thread.
I was struck by the vitriol spewed at the original study--like people are "scientists" only if they subscribe to certain cultural norms (in this case, being gay-parent-friendly). For a psychologist to act like such a setup is undeniably beneficial and only rubes would think otherwise strikes me as non-scientific and, on a more profound level, non-philosophical, the latter case being much more egregious an error, IMO. I haven't read either the original paper or the rebuttal or the rebuttal's rebuttal, but there's a lot more at play here than critiquing a methodology. Everyone has their dogma, the pro- and anti-gay-parenting alike, and I noticed a lot of hand-wringing about what "should" be done on sensitive topics like this without much explanation as to whether there is a "should," whether we can know what this "should" is, or how to go about doing it. The whole notion of gay-parenting is a pretty recent phenomenon when considering the ~100,000 years of our species' existence, so I don't think it tragic by any stretch for people to investigate its effects or hold some skepticism about it. Nothing is sacred in science, provided the methodology is kosher. As to what that methodology is...well...that's a whole other discussion. I can confirm it involves philosophy! |
|
|
|
|
|
#49 | |
|
Senior Member
|
Quote:
|
|
|
|
|
|
|
#50 | |
|
Neuropsychology Fellow
|
Quote:
|
|
|
|
|
![]() |
| Bookmarks |
«
Previous Thread
|
Next Thread
»
| Thread Tools | |
| Display Modes | |
|
|
All times are GMT -7. The time now is 10:08 PM.





). I was being a little pollyannish there, but wouldn't it be cool to have researchers of different ideologies agree on the methodology ahead of time? It really isn't that uncommon to pass along a manuscript to a colleague for review. Why not email the proposal to researcher on the "other side" for some feedback? The documents presumably already exist (e.g. HSRB application). I think your product would be better if you could say that "someone who doesn't believe that LGBT folks should be afforded full citizenship under the law, thinks they're "immoral" or pathological, etc" endorsed your methods before you did the study. At the very least, you could mention any of the concerns in the discussion section. In uber-phantasy land, you could run the study with both methodologies and compare the results.





Linear Mode

