This is very up to chance. Sometimes the VPN works, sometimes it doesn't. Sometimes it's fine on the home Internet, but fails on the cell data, sometimes it's otherwise. And it is fine if you're somewhat tech savvy and okay with tinkering with settings, but a huge pain for the older relatives.
What is your opinion on this? While I think it is interesting to catalogue the use of LLMs (I still really dislike the term "AI" being used for next token prediction) in the open source projects, using even a permissive AI policy to switch projects is taking it too far. There's even `curl` on the list.
I wouldn't recommend trying if you don't like it already. In order for the twist to have any impact the game needs to pretend to be something else and the developer have chosen it to be a visual novel with 0 substance. It would be cute anime girls yapping about nothing in the most non interesting way possible for a couple of hours before anything worth your attention happens. I'm somewhat of an anime slice of life trash enjoyer and even I couldn't force myself to watch a full let's play of this part (even with commentary adding something to latch to) and had to skip a half of it to get to the twist faster. Doesn't worth it.
To be honest, I'm getting tired of a "laptop" in every one of these clickbait titles turning out to be $3000 Macbook. Sure, it's impressive to achieve this degree of the LLM compression, but I really don't like that the title implies local LLM becomes a viable for an average person with the actual hardware being out of reach for 99%.
I enjoy them because I have a reasonably beefy laptop (non-Mac, though, so I can't try out this particular project), and it's nice to see what you can do with laptops in this space.
I think, though, maybe consider your biases? Whenever I see a headline like this, I absolutely don't assume it's going to run on any random laptop. I don't even expect it to run well, or at all, on my laptop (for stuff that isn't Mac-only, that is), which has an iGPU. I'm generally a big LLM/AI skeptic, but I find your brand of cynicism/dismissal to be kinda boring and uninteresting.
You can probably go lower than $3000, I expect, ime, an M1 max with 64GB ram to have similar performance, and you can find such one used with less than $2000 or so probably.
In any case, I do not think that the range of people that have an M1/2/3/4 max macbook is that narrow, eg people who may do video editing or who benefit from having one of the fastest multicore laptops. It is handy to be able to do work with a machine you already may own for separate reasons, though it is definitely more to the side of a "pro device" than "basic consumer device".
I ran full version of this model without any swapping on cluster of 2x $3000 laptops (strix halo zbook 128GB) at about 20 tokens per second.
I would say it is in reach for normal person. If anything buying it was great investment, it is work tool, I will probably sell it for more than what I bought it for :)
..and to think $2=3k is basically a minimum to really use local LLMs effectively, with prices definitely rising globally. Most people will just stick with online services for LLMs.
"Mate, what on Earth is this absolute shithousery."
is either handwritten or Grok! It's definitely a problem that you can get typecast by your own blog. I mean, I kinda quit updating mine around the time my strategy was in rapid flux and the landing page doesn't make sense at all.
Back in 2017-8 I've got a four consequent top ups of an equivalent of $50 each (so a total of $200) from an unknown source. After that I've got a call from a resident cell number saying I've got a $200 fine for watching porn that I laughed off and hung up. I thought it was a scam to make me pay the "fine" with the money I've just got and then call the operator, tell them they "mistakenly" paid for the wrong number (four times for $50, lol) and get the money back. So I sat there and waited for the money to be recalled... but it never happened.
My theory is that it was exactly then I was changing operators while keeping my number, so the scammers tried complaining to the wrong one and failed. Not that I had any objections for the 2 years of free calls and data this got me but this still is a bit of mystery to me.
> The disappearance of these kinds of interactions from day-to-day life – in pubs, restaurants, shops, queues, on public transport – is striking.
> We are losing a basic human skill. The ability to speak to others and understand them is being compromised.
I fail to see how these two ideas are connected. How is my ability to speak and listen to the people I care about—my parrnts, my friends, my spouse and kids—hindered by my unwillingness to talk to a complete stranger in a supermarket line? I don't hate or hold any ill feelings towards them, it's just that I'm more comfortable being to myself and I have only so much capacity to talk and too many people in the city I live in. I would understand if the article was focused on the reluctancy to bond with people in more or less stable groups (at work or at school) but I don't buy the "strangers" argument.
reply