Building a GPU Home Server for AI Want to build a GPU home server for running quantized models? Here’s some tips and tricks for setting up the server. Components Overview GPUs RTX 3090: Two R...
Building a GPU Home Server for AI
Notes on Gradient Decent
Intro: Gradient descent is a first order optimisation algorithem used for finding for the local minimum of a real-valued function \(\min_x f(x)\) with respect to the variable \(x\). Usually the fu...
Code and Coffee Meeetup - Notes on LLM tokenizers
What is a Tokenizer? How do they affect the training of large language models? These are lecture notes from AI Code and Coffee meetup on (2024-03-06) (https://www.facebook.com/events/1058526405447...
Deploying Llama2 on A100 GPUs using vLLM
Meta’s Llama2 is a state of the art open weight, large language model that you can host yourself and use for commercial purposes. It’s open sourced weights and permissive commercial licensing mean ...
Using GPT4 to generate git logs for OpenSource projects in the style of conventional commits via a terminal
Git commit logs can be tedious to write… but are useful for long term maintenance and code audit. They are especially useful for triaging production issues after a release e.g. a menu component ...
ML in PL Workshop, Generative methods in drug discovery, a practical introduction
Last weekend, I had the opportunity to attend a fascinating workshop on generative methods in drug discovery. The workshop was led by two experts in the field - Stanislaw Jastrzebski, CTO and Chi...
Setting up PyTorch Development for Mac M1/M2 ARM
Want to build pytorch on an M1 mac? Running into issues with the build process? This guide will help you get started. There are issues with building PyTorch on Mac M1/M2 ARM devices due to conflic...
Setting up PyTorch Development in Docker Compose for Ubuntu 22.04
There’s a fantastic docker-compose setup by cresset which takes care of most of the setup for you. However, if you encounter an error message indicating that Docker is unable to utilize the NVIDIA ...
How to f*ck up with crypto currencies
Loosing your wallet, getting hacked, falling for a scam, sending money to a wrong address - there are many ways to mess up with cryptocurrencies. While the Bitcoin protocol is quite well establishe...
Python syspath management
Python sys.path Management When working with Python, it’s common to import modules from different directories and locations. The sys.path variable plays a crucial role in determining the search pa...
Recently Updated