Neural Networks

Have a great idea for an article?

We're always looking for guest contributors or article suggestions. Shoot us an email at blog@intoli.com, we would love to hear yours!

Understanding Neural Network Weight Initialization

Choosing Weights: Small Changes, Big Differences There are a number of important, and sometimes subtle, choices that need to be made when building and training a neural network. You have to decide which loss function to use, how many layers to have, what stride and kernel size to use for each convolution layer, which optimization algorithm is best suited for the network, etc. With so many things that need to be decided, the choice of initial weights may, at first glance, seem like just another relatively minor pre-training detail, but weight initialization can actually have a profound impact on both the convergence rate and final quality of a network.

Continue reading

Predicting Hacker News article success with neural networks and TensorFlow

Hacker News Title Tool Enter a potential title for a Hacker News submission below to see how likely it is to succeed or to be flagged dead. Once you play around a bit you can read on to learn how exactly these predictions are made. Background Submitting an article to Hacker News can be a little stressful if you’ve invested a lot of time in writing it. An article’s success really hinges upon getting the initial four or five votes that will push it on to the front page where it can reach a broader audience.

Continue reading

How to Run a Keras Model in the Browser with Keras.js

This article explains how to export weights from a Keras model written in Python and import them to a Keras.js model in JavaScript. As you likely already know by the virtue of visiting this page, Keras.js is a JavaScript framework for running pre-trained Keras neural network models in the browser. In the rest of the article, we will install the correct version of Keras and export the weights of a trained sample network, and then discuss how to use those weights to perform a prediction with Keras.

Continue reading