High Algorithm - Biased Synopsis

Good time to read, dear users of Habr!

The article is devoted to the book “High Algorithm”, Pedro Domingos (Pedro Domingos), the translation of the book “The Master Algorithm” by the

author and the main theme of the book is to use machine learning for search for means of combating diseases.

In the prologue, the author shows the existing applications of machine learning.
Machine learning is a technology that builds itself. This is a new
phenomenon in our world.
Learning algorithms - artifacts that create other artifacts

In the first chapter, the author describes the increasing complexity of software algorithms - spatial, temporal, human (the ability to detect errors).
Learning algorithms are those that create other algorithms that are trained on the basis of data.
The controversial thesis is given:
Someday the inevitable will happen: the learning algorithms will become an indispensable intermediary and power will be concentrated in them
The second chapter provides the central hypothesis of the book:
All knowledge — past, present, and future — can be extracted from the data using one universal learning algorithm.
Arguments from the fields of neurobiology, evolution, physics, statistics, and computer science are given.
As Isaiah Berlin remarked, some thinkers are like foxes and know many different things, and some are hedgehogs who know one thing, but important
The universal learning algorithm is an incredibly powerful weapon against Monster Difficulty.
A list of five identified types of machine learning is given:
The search for the High Algorithm is difficult, but they are revived by the rivalry of various scientific schools operating in the field of machine learning. The most important of them are symbolists, connectionists, evolutionists, Bayesians and analogists.
For symbolists, intellect is reduced to the manipulation of symbols - this is how mathematicians solve equations, replacing one expression with another
For connectionists, learning is what the brain does, and therefore they believe that this organ should be reproduced by reverse engineering.
Evolutionists believe that the mother of learning is natural selection.
Bayesians are primarily concerned with uncertainty.
For analogists, the key to learning is to find similarities between different situations and thereby logically derive other similarities.
Further, in five chapters, the main methods for each type of approach are considered, after which the author describes his own way of combining them based on Markov's logical networks:
To summarize, the unified machine learning algorithm to which we arrived uses the Markov logical network as a representation, the a posteriori probability as an evaluation function, and the genetic search in combination with gradient descent as the optimizer in it
The tenth chapter describes the advantages in a world equipped with good learning algorithms.

Why abstract biased? Because I took the described algorithms as a basis, but instead of compressing them into one, I suggested building a pipeline out of them :)

Also popular now: