A.I, Data and Software Engineering


Continue training big models on less powerful devices

It would not be a surprise that you may not have a powerful expensive machine to train a complicate model. You may experience the problem of not enough memory during training in some epoch. This article demonstrates a simple workaround for this. The problem Training deep learning models requires a lot of computing power. For most laptop and desktop today, you can still train the models but it can...

MLP for implicit binary collaborative filtering

multi-layer perception

In this post, we demonstrate Keras implementation of the implicit collaborative filtering. We also introduce some techniques to improve the performance of the current model, including weight initialization, dynamic learning rate, early stopping callback etc. The implicit data For demonstration purposes, we use the dataset generated from negative samples using the technique mentioned in this post...

Fast uniform negative sampling for rating matrix

Petamind A.I

Sometimes, we want to reduce the training time by using a subset of a very large dataset while the negative samples outnumbers the positive ones, e.g. word embedding. Another situation when we deal with implicit data. In this case, we may need to populate new data for negative values. This post demonstrates how to generate data for training using uniform negative sampling. The data Originally...

Predict coronavirus deaths by days

As the pandemic is going on with an increasing number of deaths daily, let create a simple model to predict the deaths caused by 2019-nCoV (Wuhan Coronavirus). The 2019-nCoV death data I grab the death toll data from World Meters website. DateDaily DeathsFeb. 889Feb. 786……Jan. 2416Jan. 238 Plot the data Firstly, we transform the table into a Pandas data frame. 123 death_toll =...

Common Loss functions and their uses – quick note


Machines learn by means of a loss function which reflects how well a specific model performs with the given data. If predictions deviate too much from actual results, loss function would yield a very large value. Gradually, with \(optimization\) function, parameters are modified accordingly to reduce the error in prediction. In this article, we will quickly review some common loss functions and...

A.I, Data and Software Engineering

PetaMinds focuses on developing the coolest topics in data science, A.I, and programming, and make them so digestible for everyone to learn and create amazing applications in a short time.

Pin It on Pinterest