hinton

And I really doubt that people like Andrew Ng or Geoff Hinton or Sebastian Thrun were asked to invert binary trees....

It is always impressive to me how both Professor LeCun, Bengio & Hinton stuck to their guns and worked on these problems while others were not so interested.

Tangential nitpick: one (very minor) nit I have with Prof LeCun's presentations is that I don't see him give more credit to Hinton and Schmidhuber.

I did some work putting RBMs on a GPU partly because I'd seen Hinton talk showing starting with a low level description and feeding it forwards, but always ended up with highly unstable networks myself.

I know that Google has been doing a lot of research into that, but that has been focused heavily on producing lyrics for rap battles (Geoffrey Hinton is known as Grandmaster BackProp in the rap community).

I see no mention of it, but I'd be surprised if they didn't use some form of knowledge distilling [1] (which Hinton came up with, so really no excuse), to condense a large neural network into a much smaller one.

One of my professors (who had worked with Vapnik back when we didn't know if support vector machines were a good idea) said that he didn't use ANN too much because probably Hinton was the only one who knew how to used them.

Rupert Murdoch has already made many of the points that Les Hinton discussed in this speech, but I think the most interesting item was his claim that click-oriented ads are relatively worthless, compared to simple display advertising on quality news sites like the WSJ.

Geoffrey Hinton gave results to this effect in a talk about "Dark Knowledge" [1].

In fact, Geoff Hinton explicitly advocates an approach of "try things, keep what works, and figure out how it relates to the brain".

I think Hinton deserve a lot of merit for being "stubborn" enough to find grants for a field that a lot of people have serious doubts about.

What I think Murdoch and Hinton are really attacking is not news content being made available for free, but the internet revealing that news isn't actually "content" at all.

Notice too that all 3 (Hinton, LeCun, and Bengio) worked directly together at some point, and collaborated often beyond that.

A voting system like HackerNews wouldn't work, because Geoff Hinton's vote should count for a lot more than my vote.

Hugo Larochelle's youtube course [2], Geoff Hinton's Coursera course [3], and Nando's youtube Deep Learning course [4] are all very good.