A.I, Data and Software Engineering

CategoryResearch

Movielens automation- Process and export

Movie lens is a popular collection of datasets for recommender systems. This post introduces a python script to process the movie lens datasets, generate a negative sample, and transforms the datasets into SVM light format. The format is also known as libfm format used in many factorization machines. Movie Lens datasets Movie lens icon on Amazon MovieLens is a web-based recommender...

Dimension, Dimension, Dimension – Reshape your data

The most basic yet important thing when working with data array is its dimensions. This article will cover several data shapes and reshaping techniques. Why need reshaping data Imagine that you are starving and suddenly given a piece of delicious food. You may try to put it all in your mouth (Fig 1a) and find out it cannot help your hunger. So, you decided to arrange your food so that it not only...

Word2vec with TensorFlow 2.0 – a simple CBOW implementation

petamind

In TensorFlow website, there is a good example of word embedding implementation with Keras. Nevertheless, we are curious to see how it looks like when implementing word2vec with PURE TensorFlow 2.0. What is CBOW In the previous article, we introduced Word2vec (w2v) with Gensim library. Word2vec consists of two-layer neural networks that are trained to reconstruct linguistic contexts of words. The...

New TensorFlow 2.0 vs 1.X – Quick note

petamind

TensorFlow 2.0 is out! Get hands-on practice at TF World, Oct 28-31. TensorFlow Ads Since the TF2.0 API reference lists have already been made publicly available, TF2.0 is still in RC.2 version. It is expected that the final release will be made available in the next few days (or weeks). What’s new in TF2.0: The obvious different – The version. In Colab, you can force using 2.0 by:...

Save, restore, visualise Graph with TensorFlow v2.0 & KERAS

petamind

TensorFlow 2.0 is coming really soon. Therefore, we quickly show some useful features, i.e., save and load a pre-trained model, with v.2 syntax. To make it more intuitive, we will also visualise the graph of the neural network model. Benefits of saving a model Quick answer: to save time, easy-share, and fast deploy. A SavedModel contains a complete TensorFlow program, including weights and...

A.I, Data and Software Engineering

PetaMinds focuses on developing the coolest topics in data science, A.I, and programming, and make them so digestible for everyone to learn and create amazing applications in a short time.

Categories