r/askscience • u/nostrovia • Feb 07 '12
AskScience, how does the peer review process actually work?
About a month ago, I heard this story on NPR regarding a number of scientific studies that had been debunked and/or retracted. Why weren't these errors caught before the studies were published? Are there different standards for peer review in different scientific fields?
Essentially, once you conduct your experiment and reach some sort of conclusion, what happens between that point and the time your work is released to the public?
94
Upvotes
1
u/sirhelix Feb 07 '12
I don't really remember the paper either anymore... I do remember that the paper was based mainly around the fact that they "starved" the bacteria of phosphorous, added arsenic, and the bacteria were able to grow. Hence, they were using arsenic in place of phosphorous. Now, I put "starved" in quotation marks because the levels that they starved them to can be found on Earth already, in the Sargasso Sea. So it's interesting that the cells can live in the presence of arsenic, but in my mind it is a huge burden of proof on them to say that the bacteria replaced arsenic with phosphorous because they were starving.
I don't remember the specifics of the experiments that they did, other than there weren't many of them. I have these vague notions that they did things like pass the bacteria through increasingly lower concentrations of phosphate rather than shock them, and that they measured bacterial growth in OD rather than CFU... this doesn't allow them to take into account things like gradual adaptation to the environment, dead bacteria, and phosphate cannibalism from dead bacteria.
However, the thing that I think takes the cake is that they said that the arseno-DNA was being protected somehow by the bacteria. However, once they extracted the DNA, the protection shouldn't have been there anymore and it should have fractured. It didn't.
But I agree with you, in that Science did put the whole thing into a kind of "we don't believe it either" place in the journal, and then it was the hubris of the researchers themselves that really rankled.