Posts

Open Data for Deep Learning

https://deeplearning4j.org/opendata#open-data-for-deep-learning Here you’ll find an organized list of interesting, high-quality datasets for machine learning research. We welcome your contributions for curating this list! You can find other lists of such datasets  on Wikipedia , for example. Recent Additions Open Source Biometric Recognition Data Google Audioset : An expanding ontology of 632 audio event classes and a collection of 2,084,320 human-labeled 10-second sound clips drawn from YouTube videos. Uber 2B trip data : Slow rollout of access to ride data for 2Bn trips. Natural-Image Datasets MNIST: handwritten digits : The most commonly used sanity check. Dataset of 25x25, centered, B&W handwritten digits. It is an easy task — just because something works on MNIST, doesn’t mean it works. CIFAR10 / CIFAR100 : 32x32 color images with 10 / 100 categories. Not commonly used anymore, though once again, can be an interesting sanity check. Caltech 101 : Pictures o...

Jaccard Similarity vs Cosine Similarity

https://datascience.stackexchange.com/questions/5121/applications-and-differences-for-jaccard-similarity-and-cosine-similarity Jaccard Similarity is given by  s i j = p p + q + r s i j = p p + q + r where, p = # of attributes positive for both objects q = # of attributes 1 for i and 0 for j r = # of attributes 0 for i and 1 for j  Whereas, cosine similarity =  A ⋅ B ‖ A ‖ ‖ B ‖ A ⋅ B ‖ A ‖ ‖ B ‖  where A and B are object vectors. Simply put, in cosine similarity, the number of common attributes is divided by the total number of possible attributes. Whereas in Jaccard Similarity, the number of common attributes is divided by the number of attributes that exists in at least one of the two objects. And there are many other measures of similarity, each with its own eccentricities. When deciding which one to use, try to think of a few representative cases and work out which index would give the most usable results to achieve your objective. The Cosine inde...

The Black Magic of Deep Learning - Tips and Tricks for the practitioner

via: https://nmarkou.blogspot.co.uk/2017/02/the-black-magic-of-deep-learning-tips.html I've been using Deep Learning and Deep Belief Networks since 2013. I was involved in a green field project and I was in charge of deciding the core Machine Learning algorithms to be used in a computer vision platform. Nothing worked good enough and if it did it wouldn't generalize, required fiddling all the time and when introduced to similar datasets it wouldn't converge. I was lost. I then caught wind from Academia, the new hype of Deep Learning was here and it would solve everything. I was skeptical, so I read the papers, the books and the notes. I then went and put to work everything I learned.  Suprisingly, it was no hype, Deep Learning works and it works well. However it is such a new concept (even though the foundations were laid in the 70's) that a lot of anecdotal tricks and tips started coming out on how to make the most of it (Alex Krizhevsky covered a lot of them ...