• 1 Post
  • 20 Comments
Joined 2 years ago
cake
Cake day: June 19th, 2023

help-circle



  • It cannot “analyze” it. It’s fundamentally not how LLM’s work. The LLM has a finite set of “tokens”: words and word-pieces like “dog”, “house”, but also like “berry” and “straw” or “rasp”. When it reads the input it splits the words into the recognized tokens. It’s like a lookup table. The input becomes “token15, token20043, token1923, token984, token1234, …” and so on. The LLM “thinks” of these tokens as coordinates in a very high dimensional space. But it cannot go back and examine the actual contents (letters) in each token. It has to get the information about the number or “r” from somewhere else. So it has likely ingested some texts where the number of "r"s in strawberry is discussed. But it can never actually “test” it.

    A completely new architecture or paradigm is needed to make these LLM’s capable of reading letter by letter and keep some kind of count-memory.


  • IIRC most successful VCs invest very early and get out often early-ish too. The real enshittification that dangers the actual position of the company often happen much later. At that point the company is traded publicly and there’s a large anonymous body of shareholders - they only care about profits. VCs are actually a little smarter and care about longer time frames as in that early stage often much larger (relative) growth rates are possible.

    At a late stage (think Google, Twitter, Facebook, Reddit etc today) growth is much more difficult. How could Google grow today? They’ve saturated the search market years ago. So the only way of making more money is by sucking more money out of their existing user base. And they absolutely need to do it, as there’s huge pressure on the managerial class to do it, because the shareholders demand it. If the managerial class doesn’t do this (because often some older idealistic people know it would compromise the quality of the product), or they aren’t capable of doing it - they will get replaced by people who are more willing or capable - even if it’s detrimental for the company when viewed longer-term. VCs i would argue care all about profits, “but”. (they are smart enough to see the big picture. They are also small enough or “few enough” that they can communicate among themselves in order to agree on a more wise plan. That’s why they often get out once most of the possible (easy) growth has been achieved. They either know that now growth is much more difficult, or that the company’s value is much more stagnant - ow might decrease even. They can get out and invest their money in other more promising endeavours.

    The shareholders of large publicly traded companies are not that coordinated as they cannot really agree on anything other than just “growth”. More sophisticated strategies would have to be negotiated (and communicated) among thousands. The only unifying bond among shareholders is that they want profits. Think about it: many shareholders often don’t even know what companies they own as they are often part of other investment packages. Maybe you’re retirement plan has invested in stocks of 50 different companies, or 10 different fonds that have invested in others still. That is a form of dilution (?). It’s very difficult to communicate any strategy more sophisticated than “profits”. (a side effect is also that many people have invested indirectly or wothout knowing in endeavours that make their life more shitty/expensive when they retire - without knowing it.) There isn’t enough nuance in the wants of the masses as to want any more sophisticated strategy than simply “growth”. That’s why only short term growth can be thought.

    Of course sometimes also large companies can grow 2.5x or something like that. But it’s rare and takes more time. The exception makes the rule here. Early stage growth that VCs bank on is much more explosive i think. More like 10x or 100x.

    EDIT: sorry i typed this on mobile and it shows.







  • Meine Empfehlung: Kauf dir auf ebay/kleinanzeigen einen alten ipod classic. Auf den Rockbox installieren und voilà: Du kannst direkt Ordner mit Musik drauf erstellen und fast alle gängigen audioformate dort abspielen. Kein dummes iTunes mehr notwendig.

    ich hab seit etwa 3-4 Jahren wieder einen und immer noch nicht die 160GB mit ogg-dateien voll. (bin etwa bei nem Drittel). Falls ich wirklich mal keinen Platz habe, oder die Festplatte kaputt geht kann ich so ein upgrade-kit bestellen und die Festplatte durch mehrere microSD-cards ersetzen. Ich bin so glücklich seit ich wieder ein Gerät habe, das nur für Musik und nichts anderes ist. Auf dem Telefon Musik hören fand ich immer nervig. Da muss ich ständig zwischen anderen apps und Musik hin und her wechseln und bin auswerfen abgelenkt weil ich auf dem Gerät noch tausend andere Sachen mache.

    Ich mag Apple nicht. aber das einzige Produkt, was sie mal gemacht haben, dass ich mochte ist auch heute noch ausgezeichnet: der iPod classic.





  • Could be. But I would want to have the option. As a middle-ground the second axis (e.g. up/down) could be reserved to special functions only.

    • I could imagine the typical search-field that pops up to quickly search for an application could instead be further up and activating it would simply move the screen up and focus the search field at once.
    • a status-bar that only appears when needed could just exist slightly over the current screen (it would move sideways with the screen) and viewing it would move the screen slightly up.






  • Es gibt auch Studien, dass Fahrradfahrer mit Helmen unbewusst riskanter fahren und von Autofahrern auch riskanter behandelt werden. So im Sinne von “hab / hat ja einen Helm, kann also nicht so viel passieren”.

    Das andere ist: Wenn in einer Gesellschaft die Zahl der Radfahrer zunimmt, nimmt natürlich auch die Anzahl an Fahrradunfällen zu. Das ist dann natürlich eine Entwicklung, die auffällt und medial diskutiert wird. Am Ende ist immer jemand verantwortlich. Als Verkehrsminister/-senator willst du nicht da stehen müssen wenn Leute doch Beschuldigten durch Nichtstun Menschenleben zu gefährden.

    Mehr Fahrradstreifen wären wirklich sinnvoll in Berlin. Aber die jetzige Regierung wälzt das Problem natürlich lieber auf die Fahrradfahrer ab. Ein schlechter Witz.