Posts Tagged ‘probability’

Headway

Saturday, 7 January 2017

My paper on indecision is part of a much larger project. The next step in that project is to provide a formal theory of probability in which it is not always possible to say of outcomes either that one is more probable than another or that they are equality likely. That theory needs to be sufficient to explain the behavior of rational economic agents.

I began struggling actively with this problem before the paper on indecision was published. What I've had is an evolving set of axiomata that resembles the nest of a rat. I've thought that the set has been sufficient; but the axiomata have made over-lapping assertions, there have been rather a lot of them, and one of them has been complex to a degree that made me uncomfortable. Were I better at mathematics, then things might have been put in good order long ago. (I am more able at mathematics than is the typical economist, but I wish that I were considerably still better.) On the other hand, while there are certainly people better at mathematics than am I, no one seems to have accomplished what I seek to do. Economics is, after all, more than its mathematics.

What has most bothered me has been that complex axiom. There hasn't seemed much hope of resolving the general over-lap and of reducing the number of axiomata without first reducing that particular axiom. On 2 January, I was able to do just that, dissolving that axiom into two axiomata, each of which is acceptably simple. Granted that the number of axiomata increased by one, but now that the parts are each simple, I can begin to see how to reduce their overlap. Eliminating that overlap should either pare or vindicate the number of axiomata.

I don't know whether, upon getting results completed and a paper written around them, I would be able to get my work published in a respectable journal. I don't know whether, upon my work's getting published, it would find a significant readership. But the work is deeply important.

Nihil ex Nihilo

Tuesday, 6 December 2016

In his foundational work on probability,[1] Bernard Osgood Koopman would write something of form α /κ for a suggested observation α in the context of a presumption κ. That's not how I proceed, but I don't actively object to his having done so, and he had a reason for it. Though Koopman well understood that real-life rarely offered a basis for completely ordering such things by likelihood, let alone associating them with quantities, he was concerned to explore the cases in which quantification were possible, and he wanted his readers to see something rather like division there. Indeed, he would call the left-hand element α a numerator, and the right-hand element κ the denominator.

He would further use 0 to represent that which were impossible. This notation is usable, but I think that he got a bit lost because of it. In his presentation of axiomata, Osgood verbally imposes a tacit assumption that no denominator were 0. This attempt at assumption disturbs me, not because I think that a denominator could be 0, but because it doesn't bear assuming. And, as Koopman believed that probability theory were essentially a generalization of logic (as do I), I think that he should have seen that the proposition didn't bear assuming. Since Koopman was a logicist, the only thing that he should associate with a denominator of 0 would be a system of assumptions that entailed a self-contradiction; anything else is more plausible than that.

In formal logic, it is normally accepted that anything can follow if one allows a self-contradiction into a system, so that any conclusion as such is uninteresting. If faced by something such as X ∨ (Y ∧ ¬Y) (ie X or both Y and not-Y), one throws away the (Y ∧ ¬Y), leaving just the X; if faced with a conclusion Y ∧ ¬Y then one throws away whatever forced that awful thing upon one.[2] Thus, the formalist approach wouldn't so much forbid a denominator of 0 as declare everything that followed from it to be uninteresting, of no worth. A formal expression that no contradiction is entailed by the presumption κ would have the form ¬(κ ⇒ [(Y ∧ ¬Y)∃Y]) but this just dissolves uselessly ¬(¬κ ∨ [(Y ∧ ¬Y)∃Y])
¬¬κ ∧ ¬[(Y ∧ ¬Y)∃Y]
κ ∧ [¬(Y ∧ ¬Y)∀Y]
κ ∧ [(¬Y ∨ ¬¬Y)∀Y]
κ ∧ [(¬YY)∀Y]
κ
(because (X ⇔ [X ∧ (Y ∨ ¬Y)∀Y])∀X).

In classical logic, the principle of non-contradiction is seen as the bedrock principle, not an assumption (tacit or otherwise), because no alternative can actually be assumed instead.[3]. From that perspective, one should call the absence of 0-valued denominators simply a principle.


[1] Koopman, Bernard Osgood; The Axioms and Algebra of Intuitive Probability, The Annals of Mathematics, Series 2 Vol 41 #2, pp 269-292; and The Bases of Probability, Bulletin of the American Mathematical Society, Vol 46 #10, pp 763-774.

[2] Indeed, that principle of rejection is the basis of proof by contradiction, which method baffles so many people!

[3] Aristoteles, The Metaphysics, Bk 4, Ch 3, 1005b15-22.

Strong Independence in Decision Theory

Thursday, 21 July 2016

In the course of some remarks on Subjective Probability by Richard C. Jeffrey, and later in defending a claim by Gary Stanley Becker, I have previously given some explanation of the model of expected-utility maximization and of axiomata of independence.

Models of expected-utility maximization are so intuïtively appealing to some people that they take one of these models to be peculiarly rational, and deviations from any such model thus to be irrational. I note that the author of a popular 'blog seems to have done just that, yester-day.[0]

My own work shows that quantities cannot be fitted to preferences, which pulls the rug from under expected-utility maximization, but there are other problems as well. The paradox that the 'blogger explores represents a violation of the strong independence axiom. What I want to do here is first to explain again expected-utility maximization, and then to show that the strong independence axiom violates rationality.


A mathematical expectation is what people often mean when they say average — a probability-weighted sum of measures of possible outcomes. For example, when a meteorologist gives an expected rainfall or an expected temperature for to-morrow, she isn't actually telling you to anticipate exactly that rainfall or exactly that temperature; she's telling you that, given observed conditions to-day, the probability distribution for to-morrow has a particular mean quantity of rain or a particular mean temperature.

The actual mathematics of expectation is easiest to explain in simple cases of gambling (which is just whence the modern, main-stream theories of probability itself arose). For example, let's say that we have a fair coin (with a 50% chance of heads and a 50% chance of tails); and that if it comes-up heads then you get $100, while if it comes-up tails then you get $1. The expected pay-out is .5 × $100 + .5 × $1 = $50.50 Now, let's say that another coin has a 25% chance of coming-up heads and a 75% chance of coming-up tails, and you'd get $150 for heads and $10 for tails. Its expected pay-out is .25 × $150 + .75 × $10 = $45 More complicated cases arise when there are more than two possible outcomes, but the basic formula is just prob(x1m(x1) + prob(x2m(x2) + … + prob(xnm(xn) where xi is the i-th possible outcome, prob(xi) is the probability of that i-th possible outcome, and m(xi) is some measure (mass, temperature, dollar-value, or whatever) of that outcome. In our coin-flipping examples, each expectation is of form prob(headspayout(heads) + prob(tailspayout(tails)

One of the numerical examples of coin-flips offered both a higher maximum pay-out ($150 v $100) and a higher minimum pay-out ($10 v $1) yet a lower expected pay-out ($45 v $50.50). Most people will look at this, and decide that the expected pay-out should be the determining factor, though it's harder than many people reälize to make the case.

With monetary pay-outs, there is a temptation to use the monetary unit as the measure in computing the expectation by which we choose. But the actual usefulness of money isn't constant. We have various priorities; and, when possible, we take care of the things of greatest priority before we take care of things of lower priority. So, typically, if we get more money, it goes to things of lower priority than did the money that we already had. The next dollar isn't usually as valuable to us as any one of the dollars that we already had. Thus, a pay-out of $1 million shouldn't be a thousand times as valuable as a pay-out of $1000, especially if we keep in-mind a context in which a pay-out will be on top of whatever we already have in life. So, if we're making our decisions based upon some sort of mathematical expectation then, instead of computing an expected monetary value, we really want an expected usefulness value, prob(x1u(x1) + prob(x2u(x2) + … + prob(xnu(xn) where u() is a function giving a measure of usefulness. This u is the main-stream notion of utility, though sadly it should be noted that most main-stream economists have quite lost sight of the point that utility as they imagine it is just a special case of usefulness.

A model of expected-utility maximization is one that takes each possible action aj, associates it with a set of probabilities {prob(x1|aj),prob(x2|aj),…,prob(xn|aj)} (the probabilities now explicitly noted as conditioned upon the choice of action) and asserts that we should chose an action ak which gives us an expected utility prob(x1|aku(x1) + prob(x2|aku(x2) + … + prob(xn|aku(xn) as high or higher than that of any other action.

If there is a non-monetary measure of usefulness in the case of monetary pay-outs, then there is no evident reason that there should not be such a measure in the case of non-monetary pay-outs. (And, likewise, if there is no such measure in the case of non-monetary pay-outs, there is no reason to suppose one in the case of monetary pay-outs, where we have seen that the monetary pay-out isn't really a proper measure.) The main-stream of economic theory runs with that; its model of decision-making is expected-utility maximization.

The model does not require that people have a conscious measure of usefulness, and certainly does not require that they have a conscious process for arriving at such a measure; it can be taken as a model of the gut. And employment of the model doesn't mean that the economist believes that it is literally true; economists across many schools-of-thought regard idealizations of various sorts as approximations sufficient for their purposes. It is only lesser economists who do so incautiously and without regard to problems of scale.


But, while expected-utility maximization may certainly be regarded as an idealization, it should not be mistaken for an idealization of peculiar rationality nor even for an idealization of rationality of just one variety amongst many. Expected-utility maximization is not rational even if we grant — as I would not — that there is some quantification that can be fitted to our priorities.

Expected-utility maximization entails a proposition that the relevant expectation is of potential outcomes which are taken themselves to be no better or worse for being more or less probable. That is to say that what would be the reälized value of an outcome is the measure of the outcome to be used in the computation of the expectation; the expectation is simply lineär in the probabilities. This feature of the model follows from what is known as the strong independence axiom (underscore mine) because Paul Anthony Samuelson, having noticed it, conceptualized it as an axiom. It and propositions suggested to serve in its stead as an axiom (thus rendering it a theorem) have been challenged in various ways. I will not here survey the challenges.

However, the first problem that I saw with expected-utility maximization was with that lineärity, in-so-far as it implies that people do not benefit from the experience of selecting amongst discernible non-trivial lotteries as such.[1]

Good comes from engaging in some gambles as such, exactly because gambling more generally is unavoidable. We need practice to gamble properly, and practice to stay in cognitive shape for gambling. Even if we get that practice without seeking it, in the course of engaging in our everyday gambles, there is still value to that practice as such. A gamble may become more valuable as a result of the probability of the best outcome being made less probable, and less valuable as a result of the best outcome becoming more certain. The value of lotteries is not lineär in their probabilities!

It might be objected that this value is only associated with our cognitive limitations, which limitations it might be argued represented a sort of irrationality. But we only compound the irrationality if we avoid remedial activity because under other circumstance it would not have done us good. Nor do I see that we should any more accept that a person who needs cognitive exercise to stay in cognitive shape is thus out of cognitive shape than we would say that someone who needs physical exercise to stay in physical shape is thus out of physical shape.


[0 (2016:07/22)] Very quickly, in a brief exchange, he saw the error, and he's corrected his entry; so I've removed the link and identification here.

[1] When I speak or write of lotteries or of gambling, I'm not confining myself to those cases for which lay-people normally use those terms, but applying to situations in which one is confronted by a choice of actions, and various outcomes (albeït some perhaps quite impossible) may be imagined; things to which the term lottery or gamble are more usually applied are simply special cases of this general idea. A trivial lottery is one that most people would especially not think to be a lottery or gamble at all, because the only probabilities are either 0 or 1; a non-trivial lottery involves outcomes with probabilities in between those two. Of course, in real life there are few if any perfectly trivial lotteries, but a lot of things are close enough that people imagine them as having no risk or uncertainty; that's why I refer to discernible non-trivial lotteries, which people see as involving risk or uncertainty.

Dying Asymptotically

Thursday, 2 July 2015

It seems as if most economists do not know how to handle death.

What I here mean is not that they don't cope well with the deaths of loved ones or with their own mortality — though I suspect that they don't. What I mean is that their models of the very long-run are over-simply conceived and poorly interpretted when it comes to life-spans.

In the typical economic model of the very long-run, agents either live forever, or they live some fixed span of time, and then die. Often, economists find that a model begins to fit the real world better if they change it from assuming that people live that fixed amount of time to assuming that people live forever, and some economists then conclude that people are irrationally assuming their own immortality.

Here's a better thought. In the now, people are quite sure that they are alive. They are less sure about the next instant, and still less sure about the instant after that. The further that they think into the future, the less their expectation of being alive … but there is no time at which most people are dead certain that their lives will have ended. (If I asked you, the reader, how it might be possible for you to be alive in a thousand years, chances are that you could come up with some scenario.)

On the assumption that personalistic probabilities may be quantified, then, imputed probabilities of being alive, graphed against time, would approach some minimum asymptotically. My presumption would be that the value thus approached would be 0 — that most people would have almost no expectation of being alive after some span of years. But it would never quite be zero.

While I'm sure that some models will only work on the assumption that people impute absolute certainty to being alive forever, I suspect that an awful lot of models will work simply by accepting that most people embrace neither that madness nor the madness of absolute certainty that they will be dead at some specific time. Other models may need a more detailed description of the probability function.

As I've perhaps said or implied somewhere in this 'blog; I don't think that real-life probabilities are usually quantified; I would therefore be inclined to resist adopting a model with quantified probabilities, though such toys can be very useful heuristics. The weaker notion that probabilities are an incomplete preördering would correspond to some weaker notion than an asymptotic approach, but I haven't given much thought to what it would be.

Fifth Rejection and Sixth Attempt

Sunday, 30 November 2014

My short article was rejected by one journal yester-day, and submitted to another in the wee hours of this morning. And, yes, that's just how the previous entry began.

This time, an editor at the rejecting journal informed me that an unnamed associate editor felt that the article didn't fit the purposes of the journal. I got no further critique from them than that. (It should be understood that, as many submissions are made, critiquing every one would be very time-consuming.)

With respect to my paper on indecision, I had some fear that I would run out of good journals to which I might submit it. With respect to this short article, I have a fear that I might run out of any journal to which I might submit it. It just falls in an area where the audience seems small, however important I might think these foundational issues.

Fourth Rejection and Fifth Attempt

Tuesday, 11 November 2014

My short article was rejected by one journal yester-day, and submitted to another in the wee hours of this morning.

At the journal that rejected it, the article was approved by one of the two reviewers, but felt to be unsuited to the readership of the journal by the other reviewer and by the associate editor. Additionally, the second reviewer and the associate editor suggested that it be made a more widely ranging discussion of the history of subjectivist thought, which suggestion shows some lack of appreciation that foundational issues are of more than historical interest, and that the axiomata invoked by the subjectivists are typically also invoked by logicists. (I say appreciation rather than understanding, because the reviewer briefly noted that perhaps my concern was with the logic as such.)

I made three tweaks to the article. One was to make the point that axiomata such as de Finetti's are still the subject of active discussion. Another was to deal with the fact that secondary criticism arose from the editor's and the objecting reviewer's not knowing what weak would mean in reference to an ordering relation. The third was simply to move a parenthetical remark to its own (still parenthetical) paragraph.

The journal that now has it tries to provide its first review within three months.

Third Rejection and Fourth Attempt

Friday, 29 August 2014

As expected, my brief paper was quickly rejected by the third journal to which I sent it. The rejection came mid-day on 19 July; the editor said that it didn't fit the general readership of the journal. He suggested sending it to a journal focussed on Bayesian theory, or to a specific journal of the very same association as that of the journal that he edits. I decided to try the latter.

On the one hand, I don't see my paper as of interest only to those whom I would call Bayesian. The principle in question concerns qualitative probability, whether in the development of a subjectivist theory or of a logicist theory, and issues of Bayes' Theorem only arise if one proceeds to develop a quantitative theory. On the other hand, submitting to that other journal of the same association was something that I could do relatively quickly.

I postponed an up-date here because I thought that I'd report both rejections together if indeed another came quickly. But, so far, my paper remains officially under review at that fourth journal.

The paper is so brief — and really so simple — that someone with an expertise in its area could decide upon it minutes. But reviewing it isn't just a matter of cleverness; one must be familiar with the literature to feel assured that its point is novel. A reviewer without that familiarity would surely want to check the papers in the bibliography, and possibly to seek other work.

Additionally, a friend discovered that, if he returned papers as quickly as he could properly review them, then editors began seeking to get him to review many more papers. Quite reasonably, he slowed the pace of at which he returned his reviews.

Just a Note

Thursday, 12 June 2014

Years ago, I planned to write a paper on decision-making under uncertainty when possible outcomes were completely ordered neither by desirability nor by plausibility.

On the way to writing that paper, I was impressed by Mark Machina with the need for a paper that would explain how an incompleteness of preferences would operationalize, so I wrote that article before exploring the logic of the dual incompleteness that interested me.

Returning to the previously planned paper, I did not find existing work on qualitative probability that was adequate to my purposes, so I began trying to formulating just that as a part of the paper, and found that the work was growing large and cumbersome. I have enough trouble getting my hyper-modernistic work read without delivering it in large quantities! So I began developing a paper concerned only with qualitative probability as such.

In the course of writing that spin-off paper, I noticed that a rather well-established proposition concerning the axiomata of probability contains an unnecessary restriction; and that, over the course of more than 80 years, the proposition has repeatedly been discussed without the excessiveness of the restriction being noted. Yet it's one of those points that will be taken as obvious once it has been made. I originally planned to note that dispensibility in the paper on qualitative probability, but I have to be concerned about increasing clutter in that paper. Yester-day, I decided to write a note — a very brief paper — that draws attention to the needlessness of the restriction. The note didn't take very long to write; I spent more time with the process of submission than with that of writing.

So, yes, a spin-off of a spin-off; but at least it is spun-off, instead of being one more thing pending. Meanwhile, as well as there now being three papers developed or being developed prior to that originally planned, I long ago saw that the original paper ought to have at least two sequels. If I complete the whole project, what was to be one paper will have become at least six.

The note has been submitted to a journal of logic, rather than of economics; likewise, I plan to submit the paper on qualitative probability to such a journal. While economics draws upon theories of probability, work that does not itself go beyond such theories would not typically be seen as economics. The body of the note just submitted is only about a hundred words and three formulæ. On top of the usual reasons for not knowing whether a paper will be accepted, a problem in this case is exactly that the point made by the paper will seem obvious, in spite of being repeatedly overlooked.

As to the remainder of the paper on qualitative probability, I'm working to get its axiomata into a presentable state. At present, it has more of them than I'd like.

Notions of Probability

Wednesday, 26 March 2014

I've previously touched on the matter of there being markèdly differing notions all associated with the word probability. Various attempts have been made by various writers to catalogue and to coördinate these notions; this will be one of my own attempts.

[an attempt to discuss conceptions of probability]

Quantifying Evidence

Friday, 12 August 2011
The only novel thing [in the Dark Ages] concerning probability is the following remarkable text, which appears in the False Decretals, an influential mixture of old papal letters, quotations taken out of context, and outright forgeries put together somewhere in Western Europe about 850. The passage itself may be much older. A bishop should not be condemned except with seventy-two witnesses … a cardinal priest should not be condemned except with forty-four witnesses, a cardinal deacon of the city of Rome without thirty-six witnesses, a subdeacon, acolyte, exorcist, lector, or doorkeeper except with seven witnesses.⁹ It is the world's first quantitative theory of probability. Which shows why being quantitative about probability is not necessarily a good thing.
James Franklin
The Science of Conjecture: Evidence and Probability before Pascal
Chapter 2

(Actually, there is some evidence that a quantitative theory of probability developed and then disappeared in ancient India.[10] But Franklin's essential point here is none-the-less well-taken.)


⁹ Foot-note in the original, citing Decretales Pseudo-Isidorianae, et Capitula Angilramni edited by Paul Hinschius, and recommending comparison with The Collection in Seventy-Four Titles: A Canon Law Manual of the Gregorian Reform edited by John Gilchrist.

[10] In The Story of Nala and Damayanti within the Mahābhārata, there is a character Rtuparna (aka Rituparna, and mistakenly as Rtupama and as Ritupama) who seems to have a marvelous understanding of sampling and is a master of dice-play. I learned about Rtuparna by way of Ian Hacking's outstanding The Emergence of Probability; Hacking seems to have learned of it by way of V.P. Godambe, who noted the apparent implication in A historical perspective of the recent developments in the theory of sampling from actual populations, Journal of the Indian Society of Agricultural Statistics v. 38 #1 (Apr 1976) pp 1-12.