Skip to content

Posts · page 2

LLMs - First Major Murder

StackOverflow has published recently its latest stats about usage - and apparently, starting with the public access on ChatGPT, the service’s usage has decreased with ~50%. Everybody has rushed in saying that probably the Internet will start forgetting what SO did over this whole time, but I doubt this is the case. Actually, these stats will probably pump back as ChatGPT is not able to answer the latest tech trends and it shouldn’t - it needs new training data, traning data which is now becoming harder to fetch than it was before (see the reddit drama). (source with some nice graphs)

 · 2 min read

Migrating a Legacy PHP App

Recently, I’ve been working on an old hobby project as I needed to rehost it somewhere else. This website serves something like 10k unique users / day and it’s completely community driven - our users interact on the website through comments, forum posts, a chat widget (self-stored) and the content they’re providing (movie subtitles). I’ll just guide you through the entire process. Initial landscape The initial architecture was pretty simple:

 · 13 min read

Fixing 400 Bad Request - Cookie too large error for Nginx Ingress

In some scenarios when integrating with an Identity Provider (IdP) - Keycloak, Auth0, or any similar solution - a 400 error may occur in Nginx due to the size of the request and/or cookie (headers). To solve this issue, some additional configuration for your Nginx ingress is required. Nginx Ingress is one of the resources used in Kubernetes to receive external requests and direct them to the appropriate service in the Kubernetes cluster. It merely acts as an nginx deployment in your cluster - so, x pods running nginx with a config file that can inherit values. It’s available in 2 flavors: one is free (community edition), the other one is the enterprise version.

 · 3 min read

Remapping tilde on MacOS for a Logitech INT keyboard

Just as the title states, I had this pity situation where I bought a Logitech MX Keys Mini keyboard and tried to use it on any of my MacBooks. All cool and fancy, but the layout I could find for the external keyboard is INT and I’m used to working on US ones. And having the tilde/grave (~/`) key right next to Z is not something a programmer can really get used to.

 · 2 min read

Using GPT-Neo on an M1 under MacOS 12

I’ve tried to spin off tensorflow locally and play with GPT-Neo on my M1 mac. Found some official reference online beforehand, so my intentions should have been supported out of the box without any headaches. Buuut, apparently this doesn’t totally apply for MacOS 12 (Monterey). That’s why I’ve fixed the process and I’m documenting it (for myself) down below. Setting up the env Steps: install xcode & brew MiniForge3 (don’t use Anaconda) -> download the arm64 sh from GitHub setup conda for your shell (fish in my case) create a new virtualenv with conda and switch on it set up tensorflow + tensorflow-metal for GPU (in case you plan to use it afterwards) install jupyter install happytransformer and use it for generating text leveraging EleutherAI/gpt-neo Some detailed steps 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 # set up conda for fish ~/miniforge3/bin/conda init fish # create and use a new env conda create --name tf python=3.9 conda activate tf # install tensorflow deps conda install -c apple tensorflow-deps # base tensorflow + metal plugin python -m pip install tensorflow-macos python -m pip install tensorflow-metal # install jupyter, pandas and whatnot conda install -c conda-forge -y pandas jupyter Installing transformers For this one, we’ll have to accomplish 2 different things:

 · 3 min read