also at beehaw

  • 0 Posts
  • 36 Comments
Joined 2 years ago
cake
Cake day: June 15th, 2023

help-circle










  • So I’m no expert at running local LLMs, but I did download one (the 7B vicuña model recommended by the LocalLLM subreddit wiki) and try my hand at training a LoRA on some structured data I have.

    Based on my experience, the VRAM available to you is going to be way more of a bottleneck than PCIe speeds.

    I could barely hold a 7B model in 10 GB of VRAM on my 3080, so 8 GB might be impossible or very tight. IMO to get good results with local models you really have large quantities of VRAM and be using 13B or above models.

    Additionally, when you’re training a LoRA the model + training data gets loaded into VRAM. My training dataset wasn’t very large, and even so, I kept running into VRAM constraints with training.

    In the end I concluded that in the current state, running a local LLM is an interesting exercise but only great on enthusiast level hardware with loads of VRAM (4090s etc).


  • Personally, I almost wish Obsidian didn’t expose a folder structure - but the program is flexible enough to enable hiding the file browser, so that works for me.

    Since TiddlyWiki doesn’t even mess about with the concept of folders, imo that forces users to dive in and really think about how they’re connecting notes through linking - which helps build a sort of mental roadmap through their notes. Roam and Logseq are similar, I believe.



  • I started my wiki in TiddlyWiki, which by default means links and search were the only way to find notes. When I moved to Obsidian, I tried sorting everything into PARA-style folders, but… it’s way too much maintenance to mess about sorting everything so I’ve quit caring. I operate exclusively through links and search.

    Everything is still in the folders but going back to a mostly-flat folder structure is on my to-do list. Since I’m already not using them to navigate my notes, though, I’m not in too big a hurry.


  • I have a separate folder in my vault called “mobile-sync” and set up Resilio Sync on my NAS + iPhone to sync just that folder. 90% of the time I’m on my phone and want to interact with my vault it’s because I want to jot down thoughts, so I use 1Writer hooked up to the sync folder to write the note, then open Resilio Sync to sync it. Due to the iOS stuff it won’t sync in the background, but the “create note -> sync it” workflow is ok for my needs.




  • I’d think about it at a high level and then get more granular. What are your favorite riced screenshots? What parts of them particularly appeal to you? On the other hand, are there things about your setup that bother you? Then, take what you like and don’t like and let that guide you in customization.

    I am pretty opinionated, so I care about changing little things. Examples of little things I tweaked when installing KDE recently:

    • made the digital clock display on one line instead of two
    • removed blur from lockscreen
    • hid user info + switch user options from lockscreen

    For me the rest of the visual adjustments came from picking color schemes, fonts, icons, and wallpapers I like.


  • That’s helpful; this sounds like a docker issue or qBit issue then. The default qBit location for torrents is /downloads, but you’d need to make sure to point it towards the container volume mapping you’re setting up in docker.

    my relevant qBittorrent compose volume mapping is as follows:

        volumes:
          - /volume1/shared/torrents:/data/torrents
    

    Personally, I don’t separate my torrent downloads by type; I use incoming & completed folders. Here’s how I set up my qBittorrent config:

    Original Value New Value
    Session\DefaultSavePath=/downloads/ Session\DefaultSavePath=/data/torrents/1_completed/
    Session\TempPath=/downloads/incomplete/ Session\TempPath=/data/torrents/2_incoming/
    Downloads\SavePath=/downloads/ Downloads\SavePath=/data/torrents/1_completed/
    Downloads\TempPath=/downloads/incomplete/ Downloads\TempPath=/data/torrents/2_incoming/