0 Replies Latest reply on Sep 21, 2016 7:02 AM by seanc4s

    Denoising autoencoders

    seanc4s

      I have this extra simple denoising autoencoder algorithm that you might like to check out:

      http://www.freebasic.net/forum/viewtopic.php?f=7&t=25052

      It's based on random projections using the fast Walsh Hadamard transform (WHT).

      There is alternative code and information about the WTH here: http://www.jjj.de/fxt/

      The connect between the WHT and central limit theorm: https://archive.org/details/bitsavers_mitreESDTe69266ANewMethodofGeneratingGaussianRando_2706065

      I hope AMD has good WHT code for its GPUs!  Actually nVidia used information I gave them about the WHT and its applications for some of its GPU gems without crediting me ( a number of years ago). Okay so let's talk to AMD.

       

      There are some good ideas about how to use such a net in this video by Hinton:

      https://youtu.be/VIRCybGgHts

       

      This forum is exceptionally difficult to use.  I won't continue here.  You should try out Numenta's forum to see how to do things far better:

      https://discourse.numenta.org/