Comments on Choosing Priors: Double-Yolk Bayesian Egg TypePad 2018-03-01T23:30:22Z Blog Administrator https://blog.revolutionanalytics.com/ tag:typepad.com,2003:https://blog.revolutionanalytics.com/2018/03/bayesian-egg/comments/atom.xml/ Deep Mukhopadhyay commented on 'Choosing Priors: Double-Yolk Bayesian Egg' tag:typepad.com,2003:6a010534b1db25970b01bb09f9be99970d 2018-03-08T14:56:49Z 2018-03-21T21:42:17Z Deep Mukhopadhyay https://sites.temple.edu/deepstat/ Dear Alexander, To make a long story short : The local fdr value near z=3.4 is locfdr(z,nulltype = 0)\$fdr approx... <p>Dear Alexander, To make a long story short : The local fdr value near z=3.4 is locfdr(z,nulltype = 0)\$fdr approx .2; thus, Fdr value is half of it. (see Exercise 2.3: http://statweb.stanford.edu/~ckirby/brad/LSI/chapter2.pdf).​</p> <p>However, the main message of Prof. Efron, I guess, is something much deeper than just computing some FDR numbers (for mere thresholding!). There is something much more serious at stake: How can we operationalize Bayes theorem for data analysis in the 21st century? How can we distill a sensible prior that we can defend? How can we uncover the blind spots of the conventional wisdom-based prior? A casual “go-as-you-like” attitude in prior-building can potentially undermine the whole statistical findings (compare the accuracy of [Bayesian] Presidential election forecast in 2008 and 2016 by Nate Silver).<br /> </p> Alexander Konstantinidis commented on 'Choosing Priors: Double-Yolk Bayesian Egg' tag:typepad.com,2003:6a010534b1db25970b01b8d2e06896970c 2018-03-07T09:57:54Z 2018-03-07T15:50:22Z Alexander Konstantinidis I am sorry I have mispelled Mr. Efron's name as Effort. <p>I am sorry I have mispelled Mr. Efron&#39;s name as Effort.</p> Alexander Konstantinidis commented on 'Choosing Priors: Double-Yolk Bayesian Egg' tag:typepad.com,2003:6a010534b1db25970b01b7c9561d05970b 2018-03-07T09:55:11Z 2018-03-07T15:50:22Z Alexander Konstantinidis Thank you for this wonderful article. I read Bradley Effort’s article Bayes’ Theorem in the 21st Century” that you recommend... <p>Thank you for this wonderful article. I read Bradley Effort’s article Bayes’ Theorem in the 21st Century” that you recommend but I had a problem following his reasoning and I would greatly appreciate if you could help me.</p> <p>Mr. Effort present a case where 6,033 cases are examined and 28 out of them have a z score higher than 3.4. He then make the following statements: **“The determining fact here is that if indeed all the genes were Null, we would expect only 2.8 z-values exceeding 3.40, that is, only 10% of the actual number observed.<br /> This brings us back to Bayes. Another interpretation of the FDR algorithm is that the Bayesian probability of nullness given a z-value exceeding 3.40 is 10%.”**</p> <p>To begin with the probability of z &gt; 3.4 is 0.00034 in the standard normal distribution. Therefore we would expect on average 6,033 x 0.00034 = 2.03 genes out of the 6,033 genes to have z &gt; 3.4 assuming that all of those were Null. Why Mr. Effort raises this number to 2.8?</p> <p>Now let’s assume that 2.8 is the correct value and continue with Mr. Effort’s argument. Mr. Effort says that the “Bayesian probability of nullness given a z-value exceeding 3.40 is 10%.” How he defines the Bayesian probability in this case? In general the Bayesian Theorem states that P(A|B) = P(A) * P(B|A)/P(B), where A and B are Events. How he defines A and B in this context and how he assigns probabilities to them?</p> <p>I took a different tack and reasoned as follows: Given Null to be true the probability p of an observation with z &gt; 3.4 is p = 0.00034. Then the number of observations with z &gt; 3.4 under the Null when the Sample is 6,033 can be viewed as the number of Successes in 6,033 trials where each Success has probability 0.00034. This number is modeled by the Binomial Distribution with p = 0.0034 and size = 6,033. Using the Binomial Distribution one can show that the probability of observing 28 cases with z &gt; 3.4 in a Sample of 6,033 examples is practically zero and certainly much less than 10%.</p> <p>I would greatly appreciate your response.<br /> </p>