About 2 months ago, I started migrating my entire personal stack onto Kubernetes from regular virtual servers. So what has happened in the meantime? Have I freed up more operation maintenance time to do more interesting data science development work yet? Unfortunately the answer is no, at least for now. It turns out that migrating… Continue reading Onto Kubernetes – Part 2
Tag: Data Science
Technical Debt vs. Mortgage: A Data Science Homeowner’s Guide
(I used chatGPT to help me make the written content more “engaging” and “LinkedIn-like”, so keeping the 2 versions below for comparison purpose.) [ChatGPT rewritten version] Building a minimal viable product (MVP) in data science is like buying your first home with the maximum mortgage. It’s often necessary to move quickly and show business value… Continue reading Technical Debt vs. Mortgage: A Data Science Homeowner’s Guide
Onto Kubernetes
I have always been told that using Kubernetes is too complex and overkill for most purposes. That has put me off for years, before I finally decided to take the plunge into the Kubernetes world 2 months back, embarking on a mission to migrate my entire personal stack onto Kubernetes. The tip-over point for me… Continue reading Onto Kubernetes
3 Micro Learnings Over the Weekend
3 micro learnings over this weekend : (1) cloudpickle works better than pickle in storing trained sklearn models Have you ever proudly saved a trained sklearn model to be used for serving elsewhere, only for it to complain of missing imports or classes when you try to load it? Other than making the imports or… Continue reading 3 Micro Learnings Over the Weekend
New additions to family – Traefik and Airflow
Added Traefik and Airflow to the family of services behind my personal websites. Traefik – an amazing modern reverse proxy that integrates extremely well with docker containers, saving me a lot of troubles in manual configurations (looking at you nginx). Traefik makes it trivially simple to redirect internet traffic to multiple Dash docker containers, by… Continue reading New additions to family – Traefik and Airflow
FIRE planner
Built a new dashboard to help you plan financially for your potential FIRE (financial independence retire early). Link to dashboard : https://cheeyeelim.com/apps/fireplanner It takes a few inputs to help you visualize your (+ your partner’s) personal cash flows throughout your lifetime. Besides simple income and expense adjustments, it also simulates housing/mortgage and child-related expenses. Unfortunately,… Continue reading FIRE planner
Infrastructure and framework behind my personal websites
I decided to set up my own website at the end of 2020. 3 years later, I run 2 websites backed by multiple supporting services (see image below), all set up and operated by myself. My goals are (1) to set up a robust infrastructure that can ensure my websites/services are always up, and (2)… Continue reading Infrastructure and framework behind my personal websites
Excel + Office Scripts
If you have worked with Excel automation in the past, you may have painful memories working with complex Excel functions or VBA codes. Recently I realized newer versions of Excel support Office Scripts, which changes my impression of Excel automation completely. Some highlights of Excel + Office Scripts: ✔️ Can be run on the cloud,… Continue reading Excel + Office Scripts
Makefile
A small titbit to share today, the Makefile. A Makefile can be used to define sets of commonly used commands to save time and to ensure the commands run in the correct order with needed pre-requisites. For example, you can define a list of build-related commands under a target called “build”. Then next time you… Continue reading Makefile
Rocket League reinforcement learning-trained bot
As a passionate gamer, I have been reading about the Rocket League Nexto cheat situation with keen interest (https://kotaku.com/rocket-league-machine-learning-cheating-nexto-bot-1849980593). For those unfamiliar with games, Rocket League is a competitive online game where players control cars to play football. Someone has built a bot trained via reinforcement learning, and offered it as a cheating solution to… Continue reading Rocket League reinforcement learning-trained bot