The Old Evidence Problem

I’m in the middle of writing up a post sketching a some ideas I have about Bayesian inference in order to stir up a hornet nest – in particular to prod the hornet queen, David Chapman. In the process, I ran across this old blog post by Andrew Gelman discussing this (pdf) paper by Bandyopadhyay and Brittan criticizing one form of Bayesianism – in particular the form espoused by E.T. Jaynes. One of the issues they bring up is called the old evidence problem:

Perhaps the most celebrated case in the history of science in which old data have been used to construct and vindicate a new theory concerns Einstein. He used Mercury’s perihelion shift (M) to verify the general theory of relativity (GTR). The derivation of M is considered the strongest classical test for GTR. However, according to Clark Glymour’s old evidence problem, Bayesianism fails to explain why M is regarded as
evidence for GTR. For Einstein, Pr(M) = 1 because M was known to be an anomaly for Newton’s theory long before GTR came into being. But Einstein derived M from GTR; therefore, Pr(M|GTR) = 1. Glymour contends that given equation (1), the
conditional probability of GTR given M is therefore the same as the prior probability of GTR; hence, M cannot constitute evidence for GTR.

Oh man, do I have some thoughts on this problem. I think I even wrote a philosophy paper in undergrad that touched on it after reading Jaynes. But I’m going to refrain from commenting until after I finish the main post because I think the old evidence problem illustrates several points that I want to make. In the mean time, what do *you* think of the problem? Is there a solution? What do you think of the solution Bandyopadhyay and Brittan propose in their paper?

Edit: Here’s a general statement of the problem. Suppose we have some well know piece of evidence E. Everyone is aware of this evidence and there is no doubt, so P(E)=1. Next, suppose someone invents a new theory T that perfectly accounts for the evidence – it predicts is with 100% accuracy so that P(E|T)=1. Then by Bayes’ rule we have P(T|E)=P(E|T)P(T)/P(E) = P(T), so the posterior and prior are identical and the evidence doesn’t actually tell us anything about T.

Ketchup and Artistic Effectiveness

When we say art is “good” or “bad” what we mean is that it is “effective” or “ineffective” at things that are better or worse to be effective at.

This “effective at what” thing divides art up into species. Maybe phylums. It’s a bigger category than genre, because it doesn’t have anything to do with superficial content, it has to do with priorities and methods.

Continue reading “Ketchup and Artistic Effectiveness”

Considerations on reasoning by anecdote

This post is thinking out loud, catalyzed by some stuff Rev said on Twitter. Partially digested, so quality is low, but I think the topic is important.

Anecdotes are much-maligned as sources of reliable information. “Anecdote is not the plural of data!”

Perhaps too maligned. Anecdotes *from a trusted source* – that part is necessary – can often answer a hidden query much more effectively than systematically collected data.

For example, if I look up crime rates while deciding whether to move to a new city, implicitly I am asking “Will my probability of being victimized rise when I move to this city?” But the crime stats don’t directly tell you that. Maybe there are tons of violent incidents per capita, but basically all of them are gang-related and geographically isolated. Or maybe this city is reporting “incidents” and the other city is reporting “criminal charges”, or one city decided to use geometric means for some bizarre reason. Or one of 100 other such stories, many of which aren’t easy to rule out especially if you didn’t even think of them in the first place. Of course, in receiving the stats from some authority like law-enforcement or a social science researcher, it’s a huge leap to even trust the source to be honest in the first place!

On the other hand, consider a friend in the candidate city who tells you they’ve been mugged and they know two others who have. Not a huge sample, but one targeted to your reference class with much better precision than any systematically gathered data. There are sources of bias here too (maybe your friend has a habit of midnight strolls through Flea Bottom) but they are usually easier to notice and correct for. With systematically collected data, on the other hand, it is especially true that you don’t know what you don’t know.*

There are huge failure modes involved in reasoning via anecdote, which the biases & heuristics literature goes into in great detail. I will not recapitulate them, on the assumption that readers are familiar with them. The evidence type that is consistently worst is the filtered anecdote. This is the one that all your friends are sharing on Facebook. “Fundamentalist embroiled in bear-baiting scandal.” You are hearing about this because somebody doesn’t like fundamentalists, and for no other reason. Zero epistemic content.

I think I am fonder of reasoning by anecdote now because I’ve been burned quite a few times by data that turned out to be (a) lies, (b) filtered accidentally, (c) filtered deliberately, (d) misinterpreted. I am now a bit paranoid about the trustworthiness of authoritative sources of information, so I’m much more interested in the relevant experiences of trusted friends and family.

It occurs to me that this entire post is meant as a gentle criticism of the way I perceive previous-me and my audience to be likely to think, not to the way most people think. This has characteristics of a bravery debate.

So to avoid bravery debate framing, here is a table showing the tradeoffs.

Pros Cons




Trustworthiness easier to verify

Subject to suite of cognitive biases

Small sample ∴ weak evidence


Data Systematic

Sometimes randomized to avoid bias

Large sample ∴ strong evidence

Questionable relevance

More difficult to interpret


Trustworthiness harder to verify

Formic metaethical handwringing

Sisters, ethics and metaethics have been challenged of late by findings of Leafcutter IV’s caste of natural philosophers. There can hardly be an intellectual caste that has not heard these findings, but let us summarize them briefly.

Sea voyages by mobile colonies have brought to light the curious geographic distribution of non-hymenopteral species, a distribution that hints at their common ancestry in a time of differently-positioned continents. For example, one finds a “belt” of fern species across the southeastern continent which, if the continent were rotated 60 degrees clockwise, ends up continuous with a similar such belt on the southwestern continent though the species are subtly different.

Meanwhile, we find a fossil record of arthropods going back to the Cretaceous, which is continuous with itself and with modern arthropods such as ourselves. In addition, evidence from the mammalian species such as whales shows “vestigial” bones serving no function for aquatic life, but homologous to similar such bones in land mammals such as camels.

These and other lines of evidence compel the belief that all life on earth, including (most controversially) Myrmecia regnans itself, shares a common ancestor in the distant past. The explanation offered by Leafcutter IV’s natural philosopher subjects is that species change by (1) random birth differences (in M. regnans, between Queens and between drones), (2) filtered by the non-random vicissitudes of life, death, and reproduction. This process has come to be called “differential regicide”.

It is not our purpose to argue in detail for this view of natural history; rather, we take it as given and point out consequences for metaethics.

Before these insights became widely known, philosopher castes had developed a special distaste for what Grasshewer XIII’s thinkers memorably called “nature fealty”. As they put it:

It often happens that we read some tract upon the topic of how fealty should be done to our Queens and their subjects, wherein the authors after a series of statements using the copula ‘is’ and speaking of states of affairs in nature, march effortlessly and without explanation into an imperious ‘must’. We must realize that the connection never follows as a matter of course but is to be argued for.

However, in formulating the case against nature fealty, Grasshewer XIII’s subjects did not reckon on how their principle might undermine the foundations of ethics in an age in which the factual origin of M. regnans’s moral feeling is beginning to be perceived.

To take a concrete example: no duty is so sacred to a caste of myrmides as that of defending their Monarch. Many ethical philosophers would call this obvious or at least axiomatic: any argument you might use to defend it would rely on axioms if anything less certain than the imperative of defending one’s Queen.

It is also easy to perceive how such a heritable sense of duty, instilled by birth in the proto-minds of elements and in the minds of the castes they supervene on, promotes the survival of Royal Lineages with strong senses of duty. We grant that this is a mere speculation on the origin of such a sense, yet it is a powerfully plausible one. Let us take it, as well, as a given.

Now the challenge which the new natural philosophy poses to ethics is to say why such an understanding does not essentially explain away Royal fealty. After all, if fealty only happens to be the most sacred duty in our minds, put there by accident by the more or less anarchic forces of differential regicide, then how can we possibly say that fealty is legitimate in any non-arbitrary sense? We could, by sheer historical accident, have gone the way of the solitary albatrosses, in which case our moral law would put the interests of a single element ahead of loyalty to any Monarch! Such imaginings are not pleasant, and frankly reek of sedition.

It is obvious that no caste of philosophers would actually endorse such a vulgar ethic, and that the eternal values of fealty and self-sacrifice remain strong. What has been dissolved, however, is the sense among philosophers that the moral law can be justified on its own terms.

Previous to our understanding of the roots of fealty in differential regicide, we could hold out hope that fealty was the result of some process of universal reason, such that any account of fealty would be intrinsically motivating. (Such argument types are common as regards matters of simple rationality: for example, anyone who understands the meaning of modus ponens cannot fail to wish not to violate it.)

Now it appears we must be content with an explanation of why elements and castes do show fealty that does not, itself, motivate fealty. This leaves the task of motivating fealty for another argument to perform, but such arguments are wanting in plausibility.

Two Patterns

I describe two patterns here, one from the domain of the social, the other from the domain of the sacred. I discuss them together because they are of the same shape; the shape, or form, that they share is also shared with the human self.

Holy Ground

This is the visual form of the shape: [my drawing, adapting Christopher Alexander, A Pattern Language (1977), Pattern 66: Holy Ground (p. 334)]


Continue reading “Two Patterns”

Ask Tosomitu About House Elves

I’m going to interpret Daniel’s first question narrowly (or else we’ll be here all day), as “Is it more or less ethical to create a house elf, relative to a human?” where by ‘house elf’ I mean a conscious, sentient being of approximately human intelligence with a psychology built around an essential need to serve humans and the enjoyment of doing so. (See Harry Potter and the Chamber of Secrets.)

Continue reading “Ask Tosomitu About House Elves”

Variations on a theme: heroic protectiveness

Tiffany Aching has heroic protectiveness:

All witches are selfish, the Queen had said. But Tiffany’s Third Thoughts said: Then turn selfishness into a weapon! Make all things yours! Make other lives and dreams and hopes yours! Protect them! Save them! Bring them into the sheepfold! Walk the gale for them! Keep away the wolf! My dreams! My brother! My family! My land! My world! How dare you try to take these things, because they are mine!

Sometimes, there is danger in the world – the welfare of things and people beyond oneself is threatened. Depending on how globalized your society is, it could be a threat to a family, tribe, institution (like a school or large workplace), city, country, planet, or universe.

A hero is someone who:

  1. observes this threat, where others fail to notice it or ignore it;
  2. does their best to eliminate this threat, where others accept it or hope that someone else will eliminate it.

Continue reading “Variations on a theme: heroic protectiveness”

The NPOV Strikes Again

From Wikipedia (

Planned Parenthood receives about a third of its money in government grants and contracts (about $360 million in 2009). By law, federal funding cannot be allocated for abortions, but some opponents of abortion have argued that allocating money to Planned Parenthood for the provision of other medical services “frees up” funds to be re-allocated for abortion.

“Some opponents”.

As the saying goes, all money is green. In other words, money is fungible – a concept Wikipedia helpfully links to. If you give me a $10 bill and tell me not to spend it on booze, what are you really saying? That that particular serial-numbered bill should not be used in a liquor store? Okay, I’ll use the two fivers in my wallet for booze, and spend “your” $10 on the food I was eventually going to have to get anyway. And what about electronic money? Dreams about dreams.

Literally the ONLY constraint “no federal funds for abortions” puts on Planned Parenthood, is that the dollar sum of their non-abortion services must be greater than or equal to the dollar sum of federal Title X money received (assuming no other donors restrict where their dollars go). It obligates them to play a little accounting shell game, but in the counterfactual world where PP does not receive federal money, they almost certainly perform fewer abortions; thus, federal funding causes more abortions to occur.

(No comment implied on whether that is good or bad. It is certainly bad from the point of view of abortion opponents this provision is supposed to mollify.)

Ideological Agriculture, Preamble (An Excerpt From the Sermon of a Known Lunatic)

In this most exciting of times – as your god is reawakening, as the portents of conflict appear in the east and the west, at our cities’ edges and at their centers – it is increasingly vital for a true believer such as yourself to be prepared for the worst sort of situation. I’m speaking, of course, of those times you find yourself in dire need of your god’s intervention but without the necessary tools to request it.

It matters not how well you know the ritual, whether your altar is pristine, nor whether your knives and sconces are sharpened and lit – if you haven’t a good offering to bleed dry before the ever-watchful eyes of your divine master, your cries simply will not reach him. We know this, since it follows the oldest laws of humanity, passed down to us from the old ones in the most ancient times. We know that a thing of value must be destroyed when we commune with the divine; it allows us to open the otherwise sealed channel. And while we know this is inconvenient, we cannot help it; it is simply the way our world works. As such, as members of the devout we should never find ourselves without something of value on hand, should occasion for sacrifice arise.

Continue reading “Ideological Agriculture, Preamble (An Excerpt From the Sermon of a Known Lunatic)”