Home
Cancel
avatar
R&D software Engineer

Deploying Llama2 on A100 GPUs using vLLM

Meta’s Llama2 is a state of the art open weight, large language model that you can host yourself and use for commercial purposes. It’s open sourced weights and permissive commercial licensing mean ...

Using GPT4 to generate git logs for OpenSource projects in the style of conventional commits via a terminal

Git commit logs can be tedious to write… but are useful for long term maintenance and code audit. They are especially useful for triaging production issues after a release e.g. a menu component ...

ML in PL Workshop, Generative methods in drug discovery, a practical introduction

Last weekend, I had the opportunity to attend a fascinating workshop on generative methods in drug discovery. The workshop was led by two experts in the field - Stanislaw Jastrzebski, CTO and Chi...

Setting up PyTorch Development for Mac M1/M2 ARM

Want to build pytorch on an M1 mac? Running into issues with the build process? This guide will help you get started. There are issues with building PyTorch on Mac M1/M2 ARM devices due to conflic...

Setting up PyTorch Development in Docker Compose for Ubuntu 22.04

There’s a fantastic docker-compose setup by cresset which takes care of most of the setup for you. However, if you encounter an error message indicating that Docker is unable to utilize the NVIDIA ...

How to f*ck up with crypto currencies

Loosing your wallet, getting hacked, falling for a scam, sending money to a wrong address - there are many ways to mess up with cryptocurrencies. While the Bitcoin protocol is quite well establishe...

Python syspath management

Python sys.path Management When working with Python, it’s common to import modules from different directories and locations. The sys.path variable plays a crucial role in determining the search pa...

Fun with ssh reverse tunnels

How to ssh into a server with a changing ip address Problem: I have a linux machine behind a firewall, with a changing ip address. I need to be able ssh into it Solution: Setup a reverse ssh tunn...