Le Nguyen The Dat

~ Data Science & Engineering

All Posts

2018

Moving to Medium

Hi there, if you are one of the 5 random people who have been reading my blog here, you probably realized that it has not been updated for over a year now. I...

2017

Data team workflows

Introduction Choosing the right tools and workflows that fit well with your team is a critical task but oftentimes get overlooked. This article demonstrat...

Engineering thought: how to move fast?

What is “moving fast”? Speed is relative. It is hard to measure, especially when there is hardly anything similar to compare with. In engineering, it doe...

2015

Minimal Data Science #4: Winning a Data Science challenge

Introduction This is the fourth post (and quite possibly the last) of my Minimal Data Science blog series, the previous posts can be located here: leng...

My OS X Setup

This is my OS X setup. There are many like it, but this one is mine. Alfred v2 - alfredapp.com I have been using Alfred for a good while as a Spotlight alte...

The data team.

What are they, where do they fit in? The data team is probably the most impactful team in your entire company. Their products either directly help the key...

Minimal Data Science #3: Handwritten Digit Recognition with Convolutional Neural Network

Introduction This is the third post of my Minimal Data Science blog series, the previous posts can be located here: lenguyenthedat.github.io/minimal-da...

Poker 101.

Note: I am not a pro poker player - I love statistics and calculating probabilities however. I also love playing Texas hold’em Poker with friends as well a...

Google Analytics Referral Spam.

/rant If you are using or planing to use Google Analytics for visitors tracking purpose on your website, you probably want to have another closer look int...

My favorite technical blogs.

Tech Companies / Startups Engineering: Instagram Airbnb Netflix Etsy Programming / Software Engineering: The Changelog Coding Horror Mach...

Docker cache and apt-get update.

If you ever run into such error below when building your Docker image… E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/l/linux/linux-libc-d...

SEA Games History.

In light of the current SEA Games 2015 in Singapore, below is a Tableau Public’s vizualization of all SEA Games Results since the first ever SEA Games 1959 (...

Singapore Bus request visualized - SG BusLeh App.

A vizualization of SG BusLeh app’s anonymous data set from 2015-06-03 to 2015-06-05, powered by Tableau Public. Singapore Bus request visualized: Bonus...

Minimal Data Science #2: Avazu CTR Prediction with Scikit-learn and Amazon Machine Learning

TL;DR: Results, Pros and Cons Introduction This is the second post of my Minimal Data Science blog series, the first post can be located at lenguyenthedat.g...

Dexter vs Breaking Bad (IMDB score over Episodes & Seasons).

A vizualization of 2 favorite TV Shows of mine: Breaking Bad & Dexter - Powered by Tableau Public, data parsed from IMDB into the following gists: Breaki...

Redshift Error: exceeded the maximum number of cursors allowed to be open concurrently.

Encountered this bug trying to integrate Tableau with Amazon Redshift the other day, figured I should note it down somewhere… Root cause: Basically sta...

Google AdSense API with Python.

Following my last blog post on Youtube Analytics API, this post will be about Google AdSense (Management) API. Prerequisites: You will need python 2.7 and...

Youtube Analytics API with Python.

In the past few days, I’ve been working on retrieving data from various Google Products with their APIs, I figured it would be helpful (at least for myself!)...

Minimal Tmux Cheatsheet.

It’s important to use tmux to run time-consuming scripts on remote servers, especially when they are critical and/or my internet connection is not very relia...

Fixing Luit's `Segmentation fault` error with GBK encoding.

Been trying to decode some Chinese datasets as a part of my work lately, I came accorss this problem. Normally everything works just fine on my Mac OS X 10.1...

Drawing country geological map with Python.

Being someone who never worked with map / geo data before, it’s quite a challenge for me at first. My objective was to play around with maps, its coordinate ...

Write your resume the programmer's way

Came across this gem - jsonresume.org while trying to update my resume and I decided to give it a try. Turned out, it was very easy to setup and to use on OS...

2014

Storing historical data within your relational database

Problem description: We have a table named products with 2 columns: product_id and stock. We wants to record stock movement for all products, but storing a...

Using Gource to visualize multiple git repositories at once

Dat at Zalora from Dat Le on Vimeo. Below are the steps to generate the above clip. Reference: Gource and GourceMashups Generate gource log file fo...

Moving away from blogger

That’s it, I’ve had enough. Blogging with Blogger is simply inefficient and annoying as hell. I’m glad I made this decision. Below are the steps that I’...

Plotting your own gmail pattern with Python

So, one day I was wondering about my email sending pattern… Source code for your personal use: gmail-plot.

Minimal Data Science #1: Classify StarCraft 2 players with Python Pandas and Scikit-learn

Forewords This is the first in a data science blog series that I’m writing. My goal for this series is not only sharing, tutorializing, but also, making pe...

Managing User Privileges with Amazon Redshift / PostgreSQL

Managing user privileges within a system is always a hard problem in general. In particular, it’s even a harder problem for PostgreSQL Database, especial...

Building a Full Data Warehouse Solution on the cloud with Amazon Web Service

Below are the main reasons why I choose Amazon Web Service (AWS):No upfront cost (although, if you plan to use AWS for long enough, it's always better to pay...

Create a downstream PostgreSQL Database with dblink

Ran into this request just today, in short, we need to create a downstream Database for our Data Warehouse for better scalability, security, and performance ...

Redcat

Started off as an experiment: 1-man job, single-node Redshift cluster, a bunch of tables for some big joins...Redcat is now expanding into a 6-node...

Use MySQL with SSH Tunnelling, AutoSSH

Just some notes for myself:Apparently SSH Tunnelling works better than SSL for secure connection with MySQL server...AutoSSH is to keep SSH session always al...

Parsing config files in Haskell with Yaml

Sample config files:app: port: 9000 limit: 100db: host: "my.database.com" port: 5439 user: "admin" database: "mydb"s3: bucket: "my-s3-bucket" access:...

When Disk Utility couldn't repair your Hard Drives anymore

$ diskutil list # To list all your connected HDD $ sudo fsck_hfs -rf /dev/disk2s99 # To repair your disk2s99, # this mig...

Dumping Oracle DB's Table into CSV with sqlplus...