Immersion, unfortunately.

You put yourself in a situation where nobody understands you in your native language, nothing helpful for your daily life is written in your native language, and you must constantly try to comprehend and produce the target language if you want to accomplish even basic tasks.

If you can't up and move, then studying a language with a lot of cultural export helps a bit, if you can get into the habit of switching all of your media consumption to the target language. It's not the same, though.

I guess that's the only way. Thanks for the advice.

Instead of English, howbout L Exists ForAll N?

Anyways I have slept maybe almost quite enough, and identified that feeling of depth from your

"Problems(/strategies) humans found but overlooked"

As coming from AI and (unaugmented) humans making different tradeoffs (related to rational inattention..?)

On your side, did you lose all respect for Graeber and his recommenders, or did you gain newfound respect for your own ADHD. Lol

This is from like a year ago.

Yeah, this is absolutely not what anyone reasonable is thinking about when they say recursive self-improvement.

I'd say it's much closer to the concept of continual learning, but I'm only a few pages deep and haven't groqued it fully yet.

I think me just means neural network models RLed to Chain of Thought reasoning? The thinking tokens are the symbolic bit.

Smolensky's latest paper posted here the other day has some thoughts on how modern neural networks might beconsidered neurosymbolic, or rather "gradient symbolic processing," from another perspective entirely.

I wouldn't say the bitter lesson has given out! If you haven't noticed, these things keep getting bigger and bigger.

Quite a leap to call a random embedding a neurosymbolic representation

The construction jobs are only temporary if the compute infrastructure build-out decelerates. That seems pretty unlikely in the mid-term! It would mean that, like, there's a fixed appetite for data centers, and once we satisfy that appetite, we stop building them.

For better or worse, it looks more like that we're gonna tile the whole damn planet in data centers, at a faster and faster clip.

The poor fellow just rolled over. what an incandescently vulgar abuse of notation.

Not really.

LLMs are intended to model language. This is clear by observing how people expect them to respond when asked questions. The implementation of that model is akin to “pick the next word with highest probability”.

In some contexts, this is absolutely the wrong thing to do. In some contexts the LLM will give you totally the wrong sentiment, or even an incorrect fact. Humans call those “misalignments”, or “hallucinations”, or whatever other softened or anthropomorphised language to play down the problem. The reality is that sometimes they are wrong. The model is wrong.

It is not an abuse of notation at all.

If a meaningful chunk of customers moves to some other service, that service will get swamped and fall down.

Paul Smolensky is a cognitive science titan from that era. He worked with Hinton, Rumelhart, and McClelland on parallel distributed processing, and literally wrote the book on tensor product representations in cognition, with Geraldine Legendre: https://mitpress.mit.edu/9780262516198/the-harmonic-mind-vol...

He's the axis of this particular group of researchers, being the most senior at the place where they all met, Johns Hopkins.

So this is less a straw man and more a quick reminder to his peers: "Right, so, remember this particular thread we've spent the last 40 years hashing out, here we've got another contribution to that particular conversation."

If it was supposed to be sarcasm, that does help.

Right? I'd submit something just for the chance of lodging an idea in the head of Stephenson or Gwern.

Of course there's a point in it, don't be a boor.

Any act of making can be treated as product, as craft, or as art. You'll find yourself taking all three stances at different points. Any engineer or artisan or artist can choose to pour their attention and love into any layer of the production process.

I like ceramics. I like wheel throwing. Once upon a time, the pottery wheel was a newfangled technique for rapid and regular production of commodity goods. Same with coil building, same with slip casting, same with standardization of glaze recipes, gas and electric kilns, all of it.

But I know people who choose to quarry and purify their own clay, or to mix their own glazes, or to fire their pieces in a hole in the ground dug by hand with a fire they built by hand. I know people who make dozens of identical copies of just a few forms, after they spend months iterating on carving intricate molds. I know people who will spend a whole season working on a single hand-built bust.

And none of these people have ever, to my knowledge, expressed scorn for any of the others, for focusing on a different step in the process.