For many horseplayers, handicapping is first of all a mental game. Of course it becomes very visceral and far from Platonic when you place your money on this horse or that, but I tend to think it’s the mental challenge that keeps you coming back.
Harvey Pack said horseplayers should keep a record. So I did. His joke, and it is not going to jump off the page as it does in his telling, is that, you ask a bettor how he is doing, and he will say “I am just about even” and you will know he is down. Pack said the emphasis of his own playing style was to enjoy the game and not lose money, which seems noble enough for my neighborhood.
The backdrop for these pages in the last year has been the considerable uptake in interest in Artificial Intelligence in the popular press and elsewhere. The link between technology and magic has been stated elsewhere by better than me, but the ability to predict the future, and, let’s face it, that is one of the big promises of AI and machine learning, would really confirm technology’s magic power. But I have been down this road before.
In fact, when I served in the hardware trade press one of my beats was neural networks. These flowered and then failed in the 1990s [what followed is now called ‘the AI Winter’]. New and improved, they are at the heart of the AI and machine learning rebirth today. In the 1990s the funding for this came from the Defense Dept, and that group’s disenchantment with the technology was in part behind its trip to the technology gulag. You see, the neurals could come up with decisions but they couldn’t tell you why. That was a problem when the major decision they were asked to perform was the launch of nuclear war. there were other reasons for neurals’ issues in the past, not the least of which paucity of data – the reverse of the problem today.
So I watch machine learning developments, and try to learn what I can – but having seen this overhyped in the past, have one eye out for history to repeat.
Machine learning is probably is not as easy as software vendors say.
Like horseshoes, car repair or what have you predicting outcomes is not as easy as it looks. A problem of machine learning is over fitting. That’s when a learning model function is too closely fit to a limited set of data points. Having many many factors is not necessarily a successful path to fruition, data scientists are learning, much as their horse handicapping brethren have over time.
This brings me to a brief consideration of 2016 book Algorithms to Live By by a Brian Christian and Tom Griffiths. It takes a look at computer science and the algorithms that drive programs. It takes a little further leap by suggesting that you could organize your life according to algorithms. We’ll keep it simple here, focusing on the authors’ discussion of heuristics and overfitting.
Overfitting. There are always potential errors or noise in data, they remark. Machine learning models can fit patterns that appear in the data, but these patterns can be phantom. This is well known in machine learning but there are always new learners that will learn it for themselves.
Biostatisticians Robert Tibshirani they write came up with an algorithm to cope with the over abundance of fits - it’s called the lasso and it applies penalties to weight different factors to set out which are the ones that have a truly big impact on the results of an equation. [p.161]These authors see analogies in nature: “Lliving organisms get a certain push toward simplicity almost automatically, thanks to the constraints of time memory energy and attention.” Now we’re getting around to the part that moves their narration from algorithms to heuristics.
THAT PORTION OF THIS POST IS TO BE CONTINUED.
Heuristics are more useful than detailed formulas. This is what I found in the last year on this site that you have to come up with something that’s workable rather than something that’s perfec this brings to mind a couple of outages perfection is the enemy of completion and one that I invented myself whatever we do is going to be doable
The conversation with myself in this last year on this blog has been about systematizing handicapping. From the start the feeling (gained from reading the experienced experts) was that class, speed, form, distance and pace are the overarching key elements of a horseplayer’s handicapping heuristic. [Yet another side note here: the best of work in that regard can be undone by bad wagering strategy. ]
A side note: Google Home. As I composed this post, I turned to my trusty friend Google Home, which sits on my kitchen table and responds when I ask to hear Tampa Red, find out the score of the Red Sox game or learn about the weather in Louisville, Kentucky. “Hey, Google, What is the difference between an algorithm and a heuristic?” The answer blew my mind and follows here:
An algorithm is a clearly defined set of instructions to solve a problem, Heuristics involve utilising an approach of learning and discovery to reach a solution. So, if you know how to solve a problem then use an algorithm. If you need to develop a solution then it's heuristics.
This was its summary of a page on StackOverflow. I’d challenge anyone to find a more succinct representation of the gist of this page than Google managed. LINK TO FOLLOW
Today, the U.S. Senate, that August Body, declared “Ada Lovelace Day”. With the picture above we honor the first programmer, who was also in her day noted as a punter.