@yoltartar how does it create the sampling probabilities for the list? you can also just pick the highest probability token every time with no randomness at all and that still works
you’re getting hung up on implementation detail
@nearcyan it’s pretty brutal and then to thank you for your time they’ll fuck you over at the end and say that’s not the right document good luck next time
the technology industry worshiping the global consumer as a god is simply not enough. “the endless satisfaction of sophisticated consumer demands” is simply not enough to produce a great society
i have always admired how the musk companies treat commerce as a warhorse you ride into the stars without ever becoming beholden to it. thoroughly whips the markets into shape. the messianic instinct of the technology sector is far more important and interesting than the economic
it’s not worth doing so much science of politics and demographics and polling and focus testing when it’s clear that that’s all dominated by the idiosyncrasies of the individuals involved
@Noahpinion it’s interesting that being war torn and violent was very generative scientifically, culturally, technologically for Europe but not so for the Middle East
the job related meaning crisis has already started and will soon go full swing. this may sound insane but my only hope is that it happens quickly and at large enough scale such that everyone is forced to rebuild rather than painfully hanging onto the old structures
the worst outcome is a decade of coping where some professions still retain a cognitive edge over ai and lord it over those who lost. the slow trickle of people losing jobs are told to learn 2 code by an unfriendly elite and an unkind government
the best outcome is technologists and doctors have a massive restructuring of their work life just as much as uber drivers and data entry very quickly. One People all in this together to enjoy the fruits of the singularity. raw cognition is no longer a status marker of any kind
@braindump_exe the panic of the coronavirus pandemic created an amazing welfare state response that kept pretty much everyone jobless above the poverty line
“lmsys” is insane because it appears to be one of the most legitimately dangerous benchmarks with the potential to gigafry researchers’ brains but is exclusively used by literal turbonormies who unironically want to like "improov number" and basically get oneshotted by it
there’s a specific kind of degrowth lib that has convinced themselves that using chatgpt consumes some Amazon burning amount of energy bc the concept of free lunches or pareto improvements doesn’t exist in their moral landscape
a price is an upper bound on the amount of raw resources you’re consuming with some purchase! you are likely not consuming heinous amounts of resources with a cheap product
yes add some asterisks:
- unpriced externalities on energy production, but it’s probably only like 2x what you’re paying
- animal suffering is unpriced
> Meanwhile, we’ve developed an obsession with existential risks, from climate change to the rise of general artificial intelligence. In Silicon Valley in particular, AI safetyism has become so dominant that the obsession with alignment between humans and AI could, by inhibiting accelerated progress in the field, become an existential risk in itself.
on the contrary i feel that alignment and existential risk literature have accelerated ai progress hundredfold. it’s no mistake that eliezer was present to introduce demis to thiel. the ethos of existential risk is fundamentally forward looking, farseeing, and I would even claim optimistic
this is the true meaning of karmayoga
to stare destruction in the face and lock in
its easy to be deluded into doing what you think is your duty when you are dissociating from the situation. the flow state requires total absorb not dissociation https://x.com/ks_kulk/status/1860166536461451482
something real and interesting going on here
- there is a rare and valuable skill of “taste” in terms of knowing what software to build
- this skill is not the same as “leetcode horsepower” (though may have nonzero correlation)
- corporates are better at benchmarking hard skills https://x.com/catalinmpit/status/1859669774231536014
ok obviously this isn’t efficient and is a drag on resources. but anglo civilization imports this stuff like a cultural entertainment product just as much as it imports things like spicy food
modern indians are a mixture of 3 groups with as much distance as modern east asians and europeans
people have been walking around the globe for a very long time
carl sagan ruled the science airwaves in like the 80s and he did it with poise and depth befitting his stature
has there been anyone like that since him?
> you, fretting for no reason, not knowledgeable abt the complex environment, but instinctually afraid of change
> the board riders experimenting with the sublime machinery of nature for their own aesthetic gain
> the truth:
>nooooo it’s private property
does man own the mountains and the heavens too? hubris
all under divine jurisdiction and god sends his surfer angels to laugh at the pretensions of men
Genghis khan, what is best in life?
To procure awesome technological powers, to manipulate the physical universe, with permission asked only from god, to create sublime aesthetic truths on earth
hurricane levels towns, rips apart forests, untold ecological horror: this is just natures course haha
a surfer connects a minor river to an ocean ten feet away: omg jail for 25 years
crazy that people spill oceans of ink on which policy proposals or campaign blunders lost which president the election when the metric of “which of these seems to like people more, has a media presence, etc” predicts the election winner since jfk
@strangestloop yes! Biden before he was senile passed the sniff test of reasonable guy you’d get a beer with, got off some lines on tv, seems reasonable and charismatic and not like a robot. charming corn pop moments
if newsonnet was just sycophantic repeating the pretensions of the user back to themselves it would not enjoy the kind of cult popularity it does today
it seems to be genuinely insightful on qualitative matters, regularly pushes back on the user, there’s a clear “other” entity there lovingly aligned by character/values/constitution described by post training at anthropic
calling for a ceasefire at a time like this is a great way for the us to create a permanently stuck conflict that re arises every generation with cultures that never move on and never stop paying the price
if you want a good ending hezbollah should become an unutterable name
all good religions have to be internally and externally consistent or they fall apart
you can’t say outrageous things in public and moderate in private nor vice versa https://x.com/gbrl_dick/status/1861898180847428030
i was sympathetic to obamathought before covid
now not so much
it’s just a complete void of competence or inspiration it’s not “government is complicated”
social media sells unrealistic expectations, the inaccessible glamor of the rich to the poor
but from where im sitting it also democratizes the unhappiness, striving, and messiness of the elite to everybody
@jessald if we can assume a coordinating authority everyone should of course take red
if we can assume a coordinating authority where mistakes are still made everyone should take blue
@quincyforcex the people who built this country didn’t mindlessly enshrine contemporary institutions as infallible and optimal. people do that because they’re a part of a dead and stuck intellectual lineage, it’s time for you to pass on the torch old man
↳ "Urist McBlacksmith has created a Steel Battle Axe Masterwork!"
↳ "Urist McBlacksmith has named the steel battle axe 'Doomspiral, Thirst of Striking'"
↳ "This item menaces with spikes of steel. On the item is an image of dwarves in steel. The dwarves are laughing. The artwork relates to the founding of Axepeaks in 127."
@eshear no there’s a larger discrepancy between split second twitter poll intuition and real life where it concerns self preservation vs the trolly problem
mostly agree:
- human discrimination is strong
- an RM is potentially stronger in many ways (some wisdom of crowds interpolation, some potential extrapolation)
- RL creates *policies* with somewhat coherent agency (why does bing have that ood style? Why does opus have this weird lyrical quality?)
- people empirically can make opus do insane acts of creative writing that none of the labelers are capable of generating or even judging
@typingloudly@karpathy probably because they are somewhat mimicking the user somewhat influenced by the historical logs of people interacting with them in that mode and also the predisposition of the creators’ RLHF personality data
@NickParkerPrint@Xenoimpulse this is the solar plexus chakra thing right? I’m pretty surprised because this doesn’t do anything for me and I usually get easily jumpscared by shit like this
the white face smiling jumpscare thing freaked me out for a year I couldn’t open links without flinching
3-6 months garden leave should be the bare minimum at any advanced research lab. it’s actually ridiculous you can just get up and join Baidu research next week and tell them everything https://x.com/NandoDF/status/1862808895720239349
it’s not at all impressive of the old fb executives to apologize to Palmer etc in 2024 now that it’s politically expedient. all they’ve shown is they bend the knee to whoever is in charge to make a buck
@spaceangelvoice whatever you believe here it does not merit firing Palmer Luckey for donating to an anti Hillary pac in early 2016. even if there was criminal stuff it would’ve come to light far later. it’s immoral and anti American
@spaceangelvoice even if Trump was literally dealing directly with Russia it’s ridiculous to conclude that anyone potentially financially supporting Trump through several layers of indirection is a security risk
If I send $5 to an anti Hillary ad campaign I become a security risk?
@spaceangelvoice imo American companies should defend freedom of speech, and support people even when there’s a media firestorm
especially because this isn’t a ford executive badmouthing trucks
it’s a neutral social media platform exec supporting a candidate 50% of the platform supports
@CeleryTodd because these fucking idiots go to Europe and trade their sedentary lifestyle for strolling through the French Riviera or whatnot and then become shocked when they feel good and healthy
@MongoTheGeek it’s overeating and being under active. it’s always this no matter how much cope. it’s why the right wing lowkey hates ozempic because it proves there is no metaphysical conspiracy there
@IanMcInerney2@MongoTheGeek food is cheaper and also people are significantly less active
the culture of outside spaces has declined, we sit inside way more
see also: rise of myopia in childre
@JimDMiller kids in the 60s had no entertainment options except to play outside for hours and hours rich or poor
now video games are basically superior
@pissvortex no it’s because this whole thesis was predictable just from the title because the humanities have become utter useless slop that contribute negative value
@FahadMAlam@0x49fa98 i think Ted does a great job having characters inhabiting other world views (sometimes true in the story, sometimes not)
Tower of Babylon is excellent in that regard, as is Hell is the Absence of God
i heard from an English prof that he encourages his students to run assignments through chatgpt to learn what the median essay/story/response to the assignment will look like so they can avoid and transcend all that
the problem is that the abstract is entirely guessable from the title, or even from a caricature of what modern humanities departments do
entirely captured by a totalizing mind virus that allows a single lens for viewing any of literature or history and is insultingly boring https://x.com/DrAllyLouks/status/1862454376645677222
it’s a tragedy because the humanities *are* important but the modern humanities department is not and these are the jagged cliffs against which wave after wave of bright young minds sacrifice their creative spark
what really bothers me is that scholarship should be a high risk intellectual enteprise
you should set out to learn or unlearn something important and bold where even the mental frame is different than things that have come before
instead you can see the mental flowchart here of “most things enforce racism” “has anyone shown that smell in literature enforces racism” -> churn out PhD
this isn’t just in the humanities, the physical sciences are also infected with low risk behavior where everyone deterministically publishes papers and gets a PhD
I’d like to see a lot more people fail
@Scholars_Stage this is a very myopic view, I think the missing context here is that America has given the Indians several reasons to hate her, including letting our ally at the time Pakistan conduct a genocide in Bangladesh. we’ve fucked everything up in the region since partition
@Scholars_Stage given that reality India’s lukewarm support of the US for the first time since the Nixon administration can only be seen as forgiveness
but you know you should ask yourself why people all over the world think paris is exceptionally beautiful and houston is an ugly hellscape and what you think allowing denser construction does https://x.com/the_transit_guy/status/1864340291253153793
this was not an endorsement of density
im pointing out that most americans have no taste and will continue to make their cities worse with shitty construction and the yimby movement would be 10x easier if developers and planners acquired some taste
@bionic_ooze@moldbridge_ im an American first and foremost
any objective analysis of our foreign policy in the region will show that we backed Pakistan time and again as it committed genocide, hosted bin Laden, etc
I love America but there is no doubt we fucked this one up
what I meant here is that we do not use our full understanding of physics to build a weather model. you approximate a handful of effects on a coarse area and run the engine. this doesn’t mean that deep learning is more true than physics, it means that running detailed physical simulation is intractable so we use cheaper versions
civilization measured simulated and abstracted many types of risks predicted the weather made capital markets efficient in the hopes that Men would be freed to take other more interesting risks
it would be a shame if we used their compounded work to mostly live in a stuck and aging culture that treats all new things with extreme suspicion and pushes interest rates below zero!!!!
@VitalikButerin yes very much agree … there’s gotta be something in the mechanism design space that doesn’t rely on unaccountable planners with full veto rights
@mnovendstern true but there must be so many novel pathways for toxicity — some molecules that just happen to fit a target we didn’t even know existed and model doesn’t cover
unknown unknowns are high
@dylan522p im not really sure why we didn’t communicate better about this but the o1 version we released should be better than the checkpoint we ran those MLE bench scores on
@Yuchenj_UW the funny thing is i can’t really use the competitors model for real programming work so i don’t have high N comparison haha
where ive tried o1 is more likely to one shot difficult issues i run into with lots of context
@Yuchenj_UW just so you know im not uncritically shilling ive found newsonnet is pretty amazing at qualitative work including even life decisions or breaking down a complex situation. 4o has this listicle style that can be uncompelling for this type of thing
there’s some fud about the preparedness eval results being lower but for various reasons those were run on an earlier checkpoint that doesn’t follow instructions as well, the actual o1 is better than preview in every meaningful way https://x.com/dylan522p/status/1864833610542711065
@latentspaceage unironically the reason is that progress is so fast that we have to write more of these model cards these days. the preparedness evals are more to certify that models aren’t dangerous rather than strict capability evals for showing off
@BasedBeffJezos that’s true! and look at how Lee Sedol who is practically an alien to me reacted when he came into contact with AlphaGo
an alien even to aliens
i don’t read the movie blogs I just tried to rewatch it and all the dialogue that’s meant to sound clever sounds dumb and robin william’s therapy sequence / psychoanalytic wisdom falls flat that’s all
@exa_flop to be honest I think the difficulty of ARG relies a lot on large multimodal models being not so good at vision. they struggle to tell time on clocks
imo its not 'creating a cult of personality' or 'humanizing/empathizing with a murderer' to dig up some of his tweets. more like morbid curiosity re someone who clearly spent some time on here and the way a life similar to some of ours went so completely off the rails
might as well understand what went wrong, learn the truth, make sure it happens less. as opposed to the victim who is a lot less like me and there's nothing really to be learned from his senseless death other than that luigi should spend a long time in jail
bryan johnson is better understood as a singularity cultist than a health influencer
there’s a lot of very silly criticisms that are like “that’s no way to live!!!” when bryan’s argument has always been that living forever in asi utopia is more fun than drinking every night
@tenobrus isn’t Brian nearly 50? The chances of dying a natural death for a 50 year old over 15 years are too high to accept
it’s like 5% chance of losing infinite reward
it is nice to have the annealing force of social media. a chaos deity that’s sometimes benevolent sometimes insane
and thus destroys the best laid schemes of mice and men
people plan obsessively in politics in technology in law to win using facts and logic and just get destroyed by some popular uprising. doesn’t even need to point in any particular direction it’s just nice that it keeps any party from getting too powerful
people are mostly wrong about psyops and information warfare. you can bet your bottom dollar that the boomer spooks are not great at manipulating online opinion. they lost control long ago
the most skilled person you know at social media is in command like 5% of days. much less professional mossad kgb spooks. creating a Russian botnet or whatever doesn’t matter you can only say the things that people already want to hear
@developer134135 the people least capable of manipulating online opinion is this type of fbi cia buttoned up mormon spook from utah who’s never done drugs. you say tens of thousands as though that isn’t an anti signal. influence is Singular
@developer134135 because their political and business interests aligned with having net neutrality plus a mob mentality there’s nothing mysterious there
@RobS142@latentspaceage no! making a 100 page report on preparedness is really time consuming work that has to be done in parallel with post training improvements
rest assured any significantly more capable checkpoints get run through preparedness suite
deep learning skeptics for the last decade will really be like "you believe in connectionism? that pales in comparison to my plan to think outside of the box and create brand new symbolic paradigms" and then not think outside of the box or create new symbolic paradigms
tbh i'm grouping amorphous problems/symptoms here and blaming the central bank(s)
- secular stagnation
- the rise of passive investing
- stock market decorrelated from value investing, the interest rate policy is by far the largest effect on equities
- excessive bailouts
- inefficient companies kept alive, historically low bankruptcy rates of largecaps
- high asset prices
BOJ, Fed, ECB have all engaged in quantitative easing of large cap corporate bonds creating an immortal species of zombie company that will never be unwound. asset prices soar
https://x.com/tszzl/status/1866967026725777526
@ComradeDoyIe breaking bad is about a man finally coming into his greatness. the fact that it’s destructive and short lived only emphasizes the joy of it
high schooler gets into computers bc he played a video game and wanted to make a video game and then couple years later he’s literally immanentizing the eschaton
the sunk cost fallacy is not real because every choice you make changes you. by standing in line for two hours you become a different man, one who’s identity is tied to reaching the front
a major inflection point will be the stage at which reasoners will write down lemmas and theorems and simple programs for future instances to access. the birthplace of the agi Culture https://x.com/alexbilz/status/1867307533825688059