A.I, Data and Software Engineering


Create and distribute your python package

python package

This is a quick guide for create and generate distribution package of your python project so that others can install, import and use in their projects. Prerequisites: You will need the following tools installed in your computer: Python (2.x/3.x)PipAPI key for uploading your package to distribution platform, such as test.pypi.org. After install python, you can install pip by using: 12 curl -o get...

Fast uniform negative sampling for rating matrix

Petamind A.I

Sometimes, we want to reduce the training time by using a subset of a very large dataset while the negative samples outnumbers the positive ones, e.g. word embedding. Another situation when we deal with implicit data. In this case, we may need to populate new data for negative values. This post demonstrates how to generate data for training using uniform negative sampling. The data Originally...

Generate data on the fly – Keras data generator

keras data generator

Previously, we train our model using the pre-generated dataset, for example, in the recommender system or recurrent neural network. In this article, we will demonstrate using a generator to produce data on the fly for training a model. Keras Data Generator with Sequence There are a couple of ways to create a data generator. However, Tensorflow Keras provides a base class to fit dataset as a...

One-hot encoding matrices demonstration

movie lens automation

This post will demonstrate onehot encoding for a rating matrix, such as movie lens dataset. One-hot encoding Previously, we introduced a quick note for one-hot encoding. It is a representation of categorical variables as binary vectors. It is a group of bits among which the legal combinations of values are only those with a single high (1) bit and all the others low (0) Rating matrix If you are...

A really Cool data visualization: 3d globe in 2d space


While generating data in 3d space for manifold learning, I went across a problem of distributing points evenly on a sphere. It is a non-trivial problem but found a good enough solution for such placement. Interestingly, it ends up with a really cool animation effect when I decided to implement it on a mobile app. Figure 1: First animation effect: Rotation The algorithm There are two qualitatively...

A.I, Data and Software Engineering

PetaMinds focuses on developing the coolest topics in data science, A.I, and programming, and make them so digestible for everyone to learn and create amazing applications in a short time.

Pin It on Pinterest