Zhenlin Wang - WritingNotes on machine learning systems, AI engineering, and the practical edge between research ideas and shipped software.https://criss-wang.com/Model Iteration Series: Validating Model Infrahttps://criss-wang.com/writing/software/model-iteration-infra/https://criss-wang.com/writing/software/model-iteration-infra/The system and product side of concernsSat, 27 Jul 2024 07:00:00 GMTModel Iteration Series: Validating Model Researchhttps://criss-wang.com/writing/software/model-iteration-research-validation/https://criss-wang.com/writing/software/model-iteration-research-validation/The first line of defense to robust model iterationThu, 11 Jul 2024 07:00:00 GMTModel Iteration Series: Introhttps://criss-wang.com/writing/software/model-iteration-intro/https://criss-wang.com/writing/software/model-iteration-intro/An overview of industry-level model iteration procedureSat, 01 Jun 2024 07:00:00 GMTTesting in Machine Learninghttps://criss-wang.com/writing/blogs/mlops/ml-testing/https://criss-wang.com/writing/blogs/mlops/ml-testing/A holistic approach to evaluate machine learning codeFri, 19 Apr 2024 07:00:00 GMTPrompt Engineering Whitebookhttps://criss-wang.com/writing/blogs/llm/prompt-engineering/https://criss-wang.com/writing/blogs/llm/prompt-engineering/A copy of what I learned and gathered about prompting, both from online and from workWed, 20 Mar 2024 07:00:00 GMTA good Python projecttemplate to use as starting pointhttps://criss-wang.com/writing/software/build-a-complete-python-project/https://criss-wang.com/writing/software/build-a-complete-python-project/A summary of many masterminds' projects styleThu, 14 Mar 2024 07:00:00 GMTWriting Quality Code for Machine Learninghttps://criss-wang.com/writing/blogs/temp/write-quality-code-for-ml/https://criss-wang.com/writing/blogs/temp/write-quality-code-for-ml/Draft notes on proof-of-concept ML code, separation of concerns, configuration, legacy models, and type/documentation hygiene.Sat, 09 Mar 2024 00:00:00 GMTMLOps Post Training Considerationshttps://criss-wang.com/writing/blogs/mlops/ml-post-training/https://criss-wang.com/writing/blogs/mlops/ml-post-training/An Overview of how to design a full-stack Deep Learning SystemFri, 08 Mar 2024 08:00:00 GMTUnderstanding Distributed Training in Deep Learninghttps://criss-wang.com/writing/blogs/mlops/distributed-training/https://criss-wang.com/writing/blogs/mlops/distributed-training/What's important in industry AND research, not taught in school???Mon, 04 Mar 2024 08:00:00 GMTSome Tricks in Real-world Machine Learning Engineeringhttps://criss-wang.com/writing/blogs/temp/some-tricks-in-real-world-mle/https://criss-wang.com/writing/blogs/temp/some-tricks-in-real-world-mle/Draft notes on feature engineering, notebook conversion, missing values, scaling, and categorical encoding.Sat, 02 Mar 2024 00:00:00 GMTQuantization in Deep Learninghttps://criss-wang.com/writing/blogs/mlops/quantization/https://criss-wang.com/writing/blogs/mlops/quantization/A must-know technique to save your computation resourcesFri, 23 Feb 2024 08:00:00 GMTDL Training: An in-depth discussionhttps://criss-wang.com/writing/blogs/mlops/ml-training/https://criss-wang.com/writing/blogs/mlops/ml-training/Training can be hard a lot of time. But the bottlenecks varyMon, 19 Feb 2024 08:00:00 GMTFine-tuning in LLMhttps://criss-wang.com/writing/blogs/temp/fine-tuning-in-llm/https://criss-wang.com/writing/blogs/temp/fine-tuning-in-llm/Draft notes on LoRA, prompt tuning, adapter tuning, RLHF, and DPO.Mon, 19 Feb 2024 00:00:00 GMTStarting your AI/ML Project: from research to engineeringhttps://criss-wang.com/writing/blogs/mlops/project-considerations/https://criss-wang.com/writing/blogs/mlops/project-considerations/Things you need to do before starting a real-world AI/ML engineering projectSat, 17 Feb 2024 08:00:00 GMTTesting Machine Learning Systemshttps://criss-wang.com/writing/blogs/temp/testing/https://criss-wang.com/writing/blogs/temp/testing/Draft notes on software tests, model evaluation, and model behavior tests.Sat, 17 Feb 2024 00:00:00 GMTDeep Learning System Design - A Checklist (Part II)https://criss-wang.com/writing/blogs/mlops/deep-learning-system-design-2/https://criss-wang.com/writing/blogs/mlops/deep-learning-system-design-2/An Overview of how to design a full-stack Deep Learning SystemSat, 10 Feb 2024 08:00:00 GMTDeep Learning System Design - A Checklist (Part I)https://criss-wang.com/writing/blogs/mlops/deep-learning-system-design-1/https://criss-wang.com/writing/blogs/mlops/deep-learning-system-design-1/An Overview of how to design a full-stack Deep Learning SystemFri, 09 Feb 2024 08:00:00 GMTNeural Network Applied: Optimizer Selectionhttps://criss-wang.com/writing/blogs/mlops/nn-optimizers/https://criss-wang.com/writing/blogs/mlops/nn-optimizers/Choose a good optimization strategy is as important as selecting the right modelFri, 15 Dec 2023 08:00:00 GMTNeedle: High-performance DL Systemhttps://criss-wang.com/writing/projects/needle/https://criss-wang.com/writing/projects/needle/A Deep Learning framework with customized GPU and CPU backend in C++ and PythonSat, 29 Jul 2023 00:00:00 GMTMotion Prediction with Guided Diffusionhttps://criss-wang.com/writing/projects/diffusion/https://criss-wang.com/writing/projects/diffusion/Researched and developed a classifier-free guidance-based latent diffusion model for autonomous vehicle motion forecasting using UNet and Transformer as backbonesSat, 04 Mar 2023 00:00:00 GMTStarlink Trackinghttps://criss-wang.com/writing/projects/starlink-trajectory/https://criss-wang.com/writing/projects/starlink-trajectory/A small D3.js-powered Satellite Tracking visualizationSun, 13 Nov 2022 00:00:00 GMTTravel Plannerhttps://criss-wang.com/writing/projects/travel-planner/https://criss-wang.com/writing/projects/travel-planner/A GPT-powered web application to help users automate travel plan suggestion, generation and archivingTue, 30 Aug 2022 00:00:00 GMTTwitch+https://criss-wang.com/writing/projects/twitch-plus/https://criss-wang.com/writing/projects/twitch-plus/A Search & Recommendation Engine for Twitch Streaming Video ResourcesTue, 30 Aug 2022 00:00:00 GMTAbouthttps://criss-wang.com/writing/zhenlin-wang/https://criss-wang.com/writing/zhenlin-wang/About Me I\'m Zhenlin Wang Criss . I graduated as an MS student from Machine Learning Department @ Carnegie Mellon University https://www.ml.cmu.edu/ . I have a strong passion for ...Sat, 20 Aug 2022 22:21:26 GMTCode Analyzerhttps://criss-wang.com/writing/projects/code-analyzer/https://criss-wang.com/writing/projects/code-analyzer/C++ based code static program analyzerTue, 25 Jan 2022 00:00:00 GMTMore on Model Deploymenthttps://criss-wang.com/writing/blogs/temp/more-on-model-deployment/https://criss-wang.com/writing/blogs/temp/more-on-model-deployment/Placeholder draft note preserved from the previous repository.Mon, 01 Nov 2021 00:00:00 GMTVariational Inferencehttps://criss-wang.com/writing/blogs/prob-and-stats/variational-inference/https://criss-wang.com/writing/blogs/prob-and-stats/variational-inference/A useful inference method for distributional approximationThu, 14 Oct 2021 07:00:00 GMTStats in ML: Dirichlet Distributionhttps://criss-wang.com/writing/blogs/prob-and-stats/dirichlet/https://criss-wang.com/writing/blogs/prob-and-stats/dirichlet/A 'popular' distribution not widely knownWed, 21 Jul 2021 07:00:00 GMTAn overview of Hidden markov model and its algorithmshttps://criss-wang.com/writing/blogs/prob-and-stats/hidden-markov-models/https://criss-wang.com/writing/blogs/prob-and-stats/hidden-markov-models/Learning stochastic process with more detailsTue, 22 Jun 2021 07:00:00 GMTSmartMall Discounted Electronic Shoppinghttps://criss-wang.com/writing/projects/smartmall/https://criss-wang.com/writing/projects/smartmall/A robust online shopping app with various middlewares serving the microservices architectureMon, 03 May 2021 00:00:00 GMTEnsemble Models: Boosting Techniqueshttps://criss-wang.com/writing/blogs/supervised/ensemble-2/https://criss-wang.com/writing/blogs/supervised/ensemble-2/You know XGBoost, but do you KNOW XGBoost?Thu, 04 Feb 2021 08:00:00 GMTVariational Autoencoder (VAE)https://criss-wang.com/writing/blogs/prob-and-stats/variational-autoencoder/https://criss-wang.com/writing/blogs/prob-and-stats/variational-autoencoder/Combine variational inference with representation learningWed, 03 Feb 2021 08:00:00 GMTEnsemble Models: Bagging Techniqueshttps://criss-wang.com/writing/blogs/supervised/ensemble-1/https://criss-wang.com/writing/blogs/supervised/ensemble-1/Gather all we have!Mon, 01 Feb 2021 08:00:00 GMTReinforcement Learning - Theoretical Foundations: Part IV https://criss-wang.com/writing/blogs/rl/reinfocement-4/https://criss-wang.com/writing/blogs/rl/reinfocement-4/RL Continued - Value Function ApproximationThu, 28 Jan 2021 08:00:00 GMTReinforcement Learning - Theoretical Foundations: Part V https://criss-wang.com/writing/blogs/rl/reinfocement-5/https://criss-wang.com/writing/blogs/rl/reinfocement-5/RL Continued - Policy GradientWed, 20 Jan 2021 08:00:00 GMTEnsemble Models: Overviewhttps://criss-wang.com/writing/blogs/supervised/ensemble-0/https://criss-wang.com/writing/blogs/supervised/ensemble-0/Using the power of publicMon, 18 Jan 2021 08:00:00 GMTReinforcement Learning - Theoretical Foundations: Part III https://criss-wang.com/writing/blogs/rl/reinfocement-3/https://criss-wang.com/writing/blogs/rl/reinfocement-3/RL Continued - Model-free algorithmsThu, 07 Jan 2021 08:00:00 GMTReinforcement Learning - Theoretical Foundations: Part II https://criss-wang.com/writing/blogs/rl/reinfocement-2/https://criss-wang.com/writing/blogs/rl/reinfocement-2/RL Continued - Dynamic ProgrammingTue, 05 Jan 2021 08:00:00 GMTReinforcement Learning - Theoretical Foundations: Part I https://criss-wang.com/writing/blogs/rl/reinfocement-1/https://criss-wang.com/writing/blogs/rl/reinfocement-1/Finally the most intriguing part (to me)Mon, 04 Jan 2021 08:00:00 GMTGradient Descent Algorithm and Its Variants!https://criss-wang.com/writing/blogs/mlops/gradient-descent/https://criss-wang.com/writing/blogs/mlops/gradient-descent/The most important technique in neural networks (as of now)Fri, 13 Nov 2020 08:00:00 GMTSQL: Going into Applications with MySQL and MongoDBhttps://criss-wang.com/writing/blogs/sql/sql-3/https://criss-wang.com/writing/blogs/sql/sql-3/Going back to the technical details of what and how for popular SQL and NoSQL dbmsFri, 04 Sep 2020 07:00:00 GMTThe Data Mining Triology: III. Analysishttps://criss-wang.com/writing/blogs/data/exploratory-data-analysis/https://criss-wang.com/writing/blogs/data/exploratory-data-analysis/Let the plot fly ~Thu, 03 Sep 2020 07:00:00 GMTSQL: Index and Optimizationhttps://criss-wang.com/writing/blogs/sql/sql-2/https://criss-wang.com/writing/blogs/sql/sql-2/A short guide on optimizing query performancesMon, 31 Aug 2020 07:00:00 GMTSQL: Pick up the Basic within a dayhttps://criss-wang.com/writing/blogs/sql/sql-1/https://criss-wang.com/writing/blogs/sql/sql-1/The best way to get the memory back is by looking at the code themselvesSat, 15 Aug 2020 07:00:00 GMTCLI-nichttps://criss-wang.com/writing/projects/cli-nic/https://criss-wang.com/writing/projects/cli-nic/Java-based medical resource management applicationFri, 07 Aug 2020 00:00:00 GMTDatabase: Introhttps://criss-wang.com/writing/blogs/data/database-introduction/https://criss-wang.com/writing/blogs/data/database-introduction/A brief introduction to database systemWed, 01 Jul 2020 07:00:00 GMTA Regex Tutorialhttps://criss-wang.com/writing/software/regex/https://criss-wang.com/writing/software/regex/Learn to process string operations in an efficient waySat, 13 Jun 2020 07:00:00 GMTA fundamental course for Data Engineeringhttps://criss-wang.com/writing/blogs/data/big-data-guidelines/https://criss-wang.com/writing/blogs/data/big-data-guidelines/All you need for understanding industrial-level dataFri, 01 May 2020 07:00:00 GMTApache Spark: Only the simple answerhttps://criss-wang.com/writing/blogs/data/big-data-spark/https://criss-wang.com/writing/blogs/data/big-data-spark/Some conceptual understanding of spark and big data. Honestly, this just scratches the surfaceMon, 13 Apr 2020 07:00:00 GMTRecommender Systems: III. Deep-learning Methodshttps://criss-wang.com/writing/blogs/recom-sys/recommender-3/https://criss-wang.com/writing/blogs/recom-sys/recommender-3/Applications of Deep learning in recommender systemsSun, 05 Apr 2020 07:00:00 GMTRecommender Systems: II. Factorization Machinehttps://criss-wang.com/writing/blogs/recom-sys/recommender-2/https://criss-wang.com/writing/blogs/recom-sys/recommender-2/Matrix factorization will save us from sparsitySat, 04 Apr 2020 07:00:00 GMTRecommender Systems: I. Content-Based Filtering And Collaborative Filteringhttps://criss-wang.com/writing/blogs/recom-sys/recommender-1/https://criss-wang.com/writing/blogs/recom-sys/recommender-1/Welcome to the world the recommendersWed, 01 Apr 2020 07:00:00 GMTDimension Reduction: Life savershttps://criss-wang.com/writing/blogs/mlops/dimentionality-reduction/https://criss-wang.com/writing/blogs/mlops/dimentionality-reduction/We must dispel the curse of dimensionality!Wed, 04 Mar 2020 08:00:00 GMTUnsupervised Learning: Measures about Clusteringhttps://criss-wang.com/writing/blogs/unsupervised/unsupervised-learning/https://criss-wang.com/writing/blogs/unsupervised/unsupervised-learning/We have clusters, and then?Sat, 15 Feb 2020 08:00:00 GMTClustering: Apriorihttps://criss-wang.com/writing/blogs/unsupervised/clustering-5/https://criss-wang.com/writing/blogs/unsupervised/clustering-5/Association Rule realized via inferenceTue, 11 Feb 2020 08:00:00 GMTClustering: Affinity Propagationhttps://criss-wang.com/writing/blogs/unsupervised/clustering-4/https://criss-wang.com/writing/blogs/unsupervised/clustering-4/Affinity: voting with democracySun, 09 Feb 2020 08:00:00 GMTClustering: DBSCANhttps://criss-wang.com/writing/blogs/unsupervised/clustering-3/https://criss-wang.com/writing/blogs/unsupervised/clustering-3/Graphical methods continued...Thu, 06 Feb 2020 08:00:00 GMTClustering: Hierachial, BIRCH and Spectralhttps://criss-wang.com/writing/blogs/unsupervised/clustering-2/https://criss-wang.com/writing/blogs/unsupervised/clustering-2/The nitty-gritty of 'brute-force'Wed, 05 Feb 2020 08:00:00 GMTClustering: K Means and Gaussian Mixture Modelshttps://criss-wang.com/writing/blogs/unsupervised/clustering-1/https://criss-wang.com/writing/blogs/unsupervised/clustering-1/The basic models for clusteringSat, 01 Feb 2020 08:00:00 GMTAn overview of Big Data Analyticshttps://criss-wang.com/writing/blogs/data/data-analytics/https://criss-wang.com/writing/blogs/data/data-analytics/Know what data analysis is and forThu, 02 Jan 2020 08:00:00 GMTA brief Intro to A/B Testinghttps://criss-wang.com/writing/blogs/mlops/ab-testing/https://criss-wang.com/writing/blogs/mlops/ab-testing/A Recap of Fundamental Concept: A/B Testing Fri, 20 Dec 2019 08:00:00 GMTThe Data Mining Triology: II. Cleaninghttps://criss-wang.com/writing/blogs/data/data-cleaning/https://criss-wang.com/writing/blogs/data/data-cleaning/The first step when you get some data: clean it up!Sun, 01 Sep 2019 07:00:00 GMTThe Data Mining Triology: I. Preparationhttps://criss-wang.com/writing/blogs/data/data-preparation/https://criss-wang.com/writing/blogs/data/data-preparation/Know how to get data from various sources and load them successfullySun, 25 Aug 2019 07:00:00 GMTTopic Modeling with Latent Dirichlet Allocationhttps://criss-wang.com/writing/blogs/supervised/topic-modeling/https://criss-wang.com/writing/blogs/supervised/topic-modeling/LDA using a great yet less popular distrbutionSun, 21 Jul 2019 07:00:00 GMTHyperparameter Tuninghttps://criss-wang.com/writing/blogs/mlops/hyperparam-tuning/https://criss-wang.com/writing/blogs/mlops/hyperparam-tuning/Unicorn is when your horn outshines othersTue, 25 Jun 2019 07:00:00 GMTFeature Selection & Model Selectionshttps://criss-wang.com/writing/blogs/mlops/feature-and-model-selections/https://criss-wang.com/writing/blogs/mlops/feature-and-model-selections/A rudimentary method forgotten by many practitioners nowadaysTue, 04 Jun 2019 07:00:00 GMTSome Supervised Learning Modelshttps://criss-wang.com/writing/blogs/supervised/supervised-learning/https://criss-wang.com/writing/blogs/supervised/supervised-learning/So, give me a taste of supervised learningSat, 01 Jun 2019 07:00:00 GMTRegression Models: GAM, GLM and GLMMhttps://criss-wang.com/writing/blogs/supervised/regressions-3/https://criss-wang.com/writing/blogs/supervised/regressions-3/A brief introduction to generalized regressionThu, 30 May 2019 07:00:00 GMTModel Validations and Performance Evaluatorshttps://criss-wang.com/writing/blogs/mlops/validation/https://criss-wang.com/writing/blogs/mlops/validation/How to determine if a model is truly goodWed, 29 May 2019 07:00:00 GMTRegression Models: Logistic Regressionhttps://criss-wang.com/writing/blogs/supervised/regressions-2/https://criss-wang.com/writing/blogs/supervised/regressions-2/Logit Model: the simple becomes the powerfulMon, 13 May 2019 07:00:00 GMTRegression Models: Linear Regression and Regularizationhttps://criss-wang.com/writing/blogs/supervised/regressions-1/https://criss-wang.com/writing/blogs/supervised/regressions-1/Shallow and Deep Linear RegressionSat, 11 May 2019 07:00:00 GMTMyPalhttps://criss-wang.com/writing/projects/mypal/https://criss-wang.com/writing/projects/mypal/A Relationship Management SystemWed, 08 May 2019 00:00:00 GMT