I’ve been diving into AI engineering concepts and recently I’ve been working with an AI model from huggingface, and using LocalAI, qdrant, and python to develop a simple Q and A chatbot, that can return information from any pdf file! I got started by following Zen Van Riel’s excellent course in the Skool community. If you’re interested in learning AI engineering, I highly recommend checking out his community: AI Engineer on Skool. ...
The WSL2 GPU Adventure: What I Learned While Trying to Accelerate an LLM So I went on this adventure trying to get GPU acceleration working with my local AI model. I thought it would be straightforward – install some drivers, update a config file, and boom: speed boost. But like most things in tech, reality had other plans. The Setup I started with a pretty solid machine: AMD Ryzen 7 CPU (with integrated graphics) NVIDIA RTX 3070 Ti GPU Windows 11 with WSL2 running Debian LocalAI and Qdrant in Docker containers The CPU-only version was already working fine. The model responded to queries, the vector database stored embeddings properly – everything functioned. Just… slower than I wanted. ...
This leads to exponential growth, in a short time frame. Very simply put, Alex Hormozi talks about how long it takes to learn a skill, and the fact that it usually doesn’t take that long. perhaps 20 hours to master most skillsets. The issue is, as Hormozi highlights, it takes years to begin the first hour. My thesis, simply put, is that it the first hour or two of doing any new skill will be really hard. Downright miserable at times. But you need these first few hours to become comfortable. Then the next couple hours will be a breeze. ...
people operate because of a perceived optionality, due to social media. the internet makes people think they have more options than they actually do. But this causes them to hesitate, because there may be something better out there in the future. better jobs, better relationships, better opportunities … we are constantly searching for something better. funnily enough we are not necessarily built for having many options, it causes us to freeze. it causes us to hesitate. ...