A.I, Data and Software Engineering


Continue training big models on less powerful devices

It would not be a surprise that you may not have a powerful expensive machine to train a complicate model. You may experience the problem of not enough memory during training in some epoch. This article demonstrates a simple workaround for this. The problem Training deep learning models requires a lot of computing power. For most laptop and desktop today, you can still train the models but it can...

Generate data on the fly – Keras data generator

keras data generator

Previously, we train our model using the pre-generated dataset, for example, in the recommender system or recurrent neural network. In this article, we will demonstrate using a generator to produce data on the fly for training a model. Keras Data Generator with Sequence There are a couple of ways to create a data generator. However, Tensorflow Keras provides a base class to fit dataset as a...

deep learning: Linear Autoencoder with Keras

autoencoder schema

This post introduces using linear autoencoder for dimensionality reduction using TensorFlow and Keras. What is a linear autoencoder An autoencoder is a type of artificial neural network used to learn efficient data codings in an unsupervised manner. The aim of an autoencoder is to learn a representation (encoding) for a set of data, typically for dimensionality reduction, by training the network...

Quick Benchmark Colab CPU GPU TPU (XLA-CPU)


If you ever wonder about the performance differences between CPU, GPU, and TPU for your machine learning project, this article shows a simple benchmark for these three. Memory Subsystem Architecture Central Processing Unit (CPU), Graphics Processing Unit (GPU) and Tensor Processing Unit (TPU) are processors with a specialized purpose and architecture. CPU: A processor designed to solve every...

TF2.0 Warm-up exercises (forked from @chipHuyen Repo)

Petamind A.I

Heard of Ms @huyen chip for her notable yet controversial travelling books back in the day. I enjoy reading but I am not really into travel memoirs. Nevertheless, she did surprise everyone by her achievements by getting in Stanford, teaching TensorFlow, and then became a computer/data scientist. Her story is definitely very inspiring. For ones who don’t know about Ms Huyen, I added an...

A.I, Data and Software Engineering

PetaMinds focuses on developing the coolest topics in data science, A.I, and programming, and make them so digestible for everyone to learn and create amazing applications in a short time.

Pin It on Pinterest