It would not be a surprise that you may not have a powerful expensive machine to train a complicate model. You may experience the problem of not enough memory during training in some epoch. This article demonstrates a simple workaround for this. The problem Training deep learning models requires a lot of computing power. For most laptop and desktop today, you can still train the models but it can...
Create bipartite graph from a rating matrix
As deep learning on graphs is trending recently, this article will quickly demonstrate how to use networkx to turn rating matrices, such as MovieLens dataset, into graph data. The rating data We use rating data from the movie lens. The rating data is loaded into rdata which is a Pandas DataFrame. This article demonstrates how to preprocess movie lens data. After processing, the rdata should look...
A.I in agriculture – Fruit Grading with Keras (part 2)
In part 1, we introduced fruit classification with pure python implementation. In this part, we will use the Keras library instead. What is Keras Keras is an open-sourceneural-network library written in Python. It is capable of running on top of TensorFlow, Microsoft Cognitive Toolkit, Theano, or PlaidML. Designed to enable fast experimentation...
AI in agriculture: fruit grading (Part 1)
During a meet up last month, a friend told me about the current project on a farm in New Zealand. They want to build a system to grade their fruits and AI is the technology they are looking for. It inspired me to write about how machine learning can help in solving such a problem. Fig 1: Apple grading The grading task Given an apple, we need to sort it to correct category in three available...
An example to Graph Convolutional Network
In my research, there are many problems involve networks of different types, e.g. social network, online-trading networks, crowd-sourcing, etc. I was so happy to find a new powerful tool for my research, the graph convolutional network, which applies deep learning on graph structures. Graph convolutional network (GCN) Graph convolutional network (Src: Thomas Kipf) There is currently no official...