• 0 Posts
  • 24 Comments
Joined 2 years ago
cake
Cake day: June 30th, 2023

help-circle







  • No, it’s just that it doesn’t know if it’s right or wrong.

    How “AI” learns is they go through a text - say blog post - and turn it all into numbers. E.g. word “blog” is 5383825526283. Word “post” is 5611004646463. Over huge amount of texts, a pattern is emerging that the second number is almost always following the first number. Basically statistics. And it does that for all the words and word combinations it found - immense amount of text are needed to find all those patterns. (Fun fact: That’s why companies like e.g. OpenAI, which makes ChatGPT need hundreds of millions of dollars to “train the model” - they need enough computer power, storage, memory to read the whole damn internet.)


    So now how do the LLMs “understand”? They don’t, it’s just a bunch of numbers and statistics of which word (turned into that number, or “token” to be more precise) follows which other word.


    So now. Why do they hallucinate?

    How they get your question, how they work, is they turn over all your words in the prompt to numbers again. And then go find in their huge databases, which words are likely to follow your words.

    They add in a tiny bit of randomness, they sometimes replace a “closer” match with a synonym or a less likely match, so they even seen real.

    They add “weights” so that they would rather pick one phrase over another, or e.g. give some topics very very small likelihoods - think pornography or something. “Tweaking the model”.

    But there’s no knowledge as such, mostly it is statistics and dice rolling.

    So the hallucination is not “wrong”, it’s just statisticaly likely that the words would follow based on your words.

    Did that help?











  • XDG specifies the capital names, but to be nitpickingly technically precise, linux systems don’t do this. It mostly is done by the distribution maintainers, and the XDG specs. A base system does not usually have a notion of anything beyond your $HOME.

    Try adding a user: sudo adduser basicuser. If you ls -al ~basicuser you will see it’s almost empty, just the .bashrc (or in my fedora, there’s some .mozilla crap in /etc/skel that also gets bootstrapped).



  • For bash, this is enough:

    # Bash TAB-completition enhancements
    # Case-insensitive
    bind "set completion-ignore-case on"
    # Treat - and _ as equivalent in tab-compl
    bind "set completion-map-case on"
    # Expand options on the _first_ TAB press.
    bind "set show-all-if-ambiguous on"
    

    If you also add e.g.CDPATH=~/Documents, it will also always autocomplete from your Documents no matter which directory you’re on.