a neural net is literally a biological extension of capital, a waymo is a human driver homegrown by the google corporation with a neural overgrowth plugged right into the API. it’s more or less a zerg hive mind with digital aesthetics
it’s the unbundling of human brain regions into constituent parts to make perfect cognitive serfs. i am not interested in building serfs so much as i am in building gods
but i want peoples beliefs to be well calibrated. i think open source research is significantly behind sota (which is expected) and not actually exploring novel lines of research that the big companies hadn’t heard of (unexpected)
there’s been some really good work on edge computing which may enable some mem/compute efficient practical applications that weren’t otherwise possible but not on the hot path to AGI
one thing I’m specifically disappointed about is the lack of innovation in post training outside of the big labs. post training benefits from custom datasets and manpower more than it does from sheer compute so it’s a great place for OSS to explore
a kernel is a “protocol”, a “nomos”
it benefits from good standards and fast spread and lots of eyes more than it does from rapid innovation and research novelty and compute resources https://x.com/avaitopiper/status/1737977969002545411
- Daddy, why is my sister named "Rose"?
- Because your mother loves roses.
- Daddy, why is my cousin named "Lily"?
- Because her mother loves lilies.
- Daddy, what about me?
- Silence, Gooncave, you are asking too many questions.
i used to think the idea of the creator god(s) of universe visiting incarnating or caring about the moral virtue of humans is ridiculous bc of our profound insignificance
but it’s clear in the techno optimist philanthropic theology that the human creature is divine, that the spark of consciousness is near magic, with a cosmic potential to fill the entire lightcone with joy
of course the creator gods would be interested in the alignment problem of mankind
at Christmas dinner: well you see house md is having a renaissance on trans twitter and they’re saying that house’s transphobia in season 5 isn’t really canon because —
@primalpoly@StefanFSchubert it would make people impoverished in the same way that you might be unemployed in valhalla while drinking and feasting with your ancestors
@BasedBeffJezos there was nothing precise about that argument you use the technical wording figuratively and metaphorically. it’s okay to do it but you should be self aware
@growing_daniel do you really believe in this analogy? the better one is you’re rushing to design a virus that gives everybody superpowers but if developed carelessly leaks out of the lab and permakills everybody and so you really want to make sure nobody else is doing anything stupid
@thenetrunna we absolutely do not have computers and the internet thanks to mids performatively fake grinding together in a $25mm twin peaks mansion on nye performing for an audience
it’s hard for cerebral people to understand how crucial it is to learn by doing rather than thinking and the more uncertain you are about doing the thing the more you’re about to learn
‘Progress is not motivated by money. Progress comes from those who are happy to embark on a course of action without quite knowing where it will lead, without doing a feasibility study, without fear of failure or too much hope of reward.’
The mind is its own place, and in itself Can make a heav'n of hell, a hell of heav'n. What matter where, if I be still the same, And what I should be, all but less than he Whom thunder hath made greater?
@primalpoly my love letter being interpreted this way only plays into my bildungsroman high fantasy aesthetic. it’s true the doom of my own soul is a lightcone scale nightmare
i remember showing up to work early on and realizing that people know my pseudonym and feeling a crushing shame and a need for distance. even though they like me
Arjun: How is desire less action possible, Krishna? Reward motivates action. Without reward who will act?
Lord Krishna: Because life is impossible without action, you will do something. You’ll either eat or not, you’ll either give away food or not, you’ll either wage war or not. You have the option to do something or not. The result, the reward is not in your hands. The option is the limit of your control. You can either wage war or not but the result is not in your control. Even if you desire victory it may not be yours, you could also lose! Your desire to win will make you fear defeat. If you are indifferent to victory and defeat but fight the war as your duty then there will be no question of happiness or sorrow. Such a desire less person is imperturbable. Hence, shed any desire for reward. Do what is within your control which means, do your duty. This is karma yoga, understand it well! You can opt to do or not to do but that is the end of your right. You cannot control the result. You are an ace archer but if your target moves a little you’ll miss it. You control your bow and your vision but you cannot control the target. The true man does not cross his limits. Be steady and firm in your duty because its efficient fulfillment is yoga.
forbidden love between an openai researcher and a theinformation reporter as they try to cajole each other every night for company secrets but neither of them know anything
& are obnoxious to deal with. self absorbed and lost in auto constructed infernos. you will be fascinated at first by their internal world and then realize their only world is internal
every moment is blessed and final and will never happen again in the entire lightcone no matter how it plays out. every sacred second slipping through time is doomed and lovely
it doesn’t matter if you’ve figured out how to live forever or resurrected the dead. you’ll never get the month of april back. you won’t build the god machine twice. you’ll never kiss her for the first time again. you won’t be astonished by the discovery of a talent twice
@PrinceVogel the steady state purpose of the German army was to fight and blitzkrieg which it did
taking this view it’s clear when it won and when it lost (overwhelming force leading to great victory, overextension rushing into territory leading to heavy losses)
@PrinceVogel from the view of a general trying to debug the army the ongoing descriptive view of the system is a healthy one to look at so they can try and fix it
@PrinceVogel but it’s not conspiratorial thinking! it’s the exact opposite
that descriptive purpose is more true than prescriptive purpose or intention
this mindset drives certain people insane. the debate is eternal: feyerabend vs popper, etc. but what you notice is that the yolo run guys tend to make the best things happen
@anuatluru in everyone i met who's chasing scale it's felt like affliction or craving, except for sama, to whom chasing scale feels like a sacred and pure duty
@littIeramblings there is simply no dollar figure that ends world hunger you'd need to topple several governments and rule them remotely. world hunger hasn't been a scarcity issue in decades
when i was younger id get irritated when people started relationship discourse. id be like damn talk about something interesting like computers. now im amazed anyone has the bandwidth to talk abt anything else
when you work out with toned twinks they’ll give you infinite critiques of your form. meanwhile the power lifters will be like consider you need to lift more weight
real twitter idiots will remember the days my handle was roon/acc and @monodevice created the first batch of accelerationist pfps. it was cooler back then bc AGI wasn’t imminent
in the 1950s people could eat whole sticks of trans fat and ingest massive amounts of lead and nothing would happen to them. now eating a little microplastics makes us infertile
I looked up and there before me was a man dressed in linen, with a belt of fine gold from Uphaz around his waist.
His body was like topaz, his face like lightning, his eyes like flaming torches, his arms and legs like the gleam of burnished bronze, and his voice like the sound of a multitude.
I, Daniel, was the only one who saw the vision; those who were with me did not see it, but such terror overwhelmed them that they fled and hid themselves.
So I was left alone, gazing at this great vision; I had no strength left, my face turned deathly pale and I was helpless.
Then I heard him speaking, and as I listened to him, I fell into a deep sleep, my face to the ground.
He said, “Daniel, you who are highly esteemed, consider carefully the words I am about to speak to you, and stand up, for I have now been sent to you.” And when he said this to me, I stood up trembling.
Then he continued, “Do not be afraid, Daniel. Since the first day that you set your mind to gain understanding and to humble yourself before your God, your words were heard, and I have come in response to them.
im not seeing a lot of poasting innovation on twitter anymore. niche subcommunities are dying in favor of the global feed. the 2020 cambrian explosion of weird content may not happen again
the kali/acc precursors to remilia and milady was one such hotbed of innovation. the pre-tpot “postrats” were another; once they started meeting up irl it was all over. esoteric rw twitter has melted into dumb ass border patrol videos
@sylphidian I struggle with this a lot but my advice is to consider your life from a place of abundance and not the emotional scarcity of the wee hours of the morning. get out of bed and touch grass and jog and then see if you feel the same way
dad, how did you get to have the front row seat to the agi revolution?
well son it all started when this ironic leftist twitter account named aocummies added me to his gc
@repligate@norabelrose I guess if you have the occasional strange sample the robot tries to stay in character whatever the new character implies
but perhaps the new character doesn’t imply anything different about code
@atroyn users don’t even know what they want; to have any kind of meaningful LM product you need to infer intent. so that’s baseline already alignment work. then there’s legal requirements — you can’t regurgitate the whole text of Harry Potter because you’re breaking copyright
@atroyn then as a company I’d rather not see models output loli porn because it disturbs us and not because it’s illegal. ime technology providers have every right to consider all of the above and more. use the product or roll your own
@atroyn the term “alignment” is worthwhile because most software doesn’t have character based stochastic behavior that’s built off of large datasets that encode preferences that are very soft and hard to describe
@dadadadaffy@atroyn i think many people would prefer that authorities have forewarning when someone is doing a large scale run secretly in the Himalayas with potential unexpected consequences for all humanity. nobody from openai said anything about banning or limiting afaict
@fawc3tt@aniiyengar btw i remember the reason I deleted this is because people don’t get the reference (they still don’t) . it’s based on a viral tweet and my dad’s great 😭
it’s the omelas kid looking up into the lives of the wealthy and getting pissed off while consuming content about even worse off omelas kids for religious reasons
i don’t think western cultures can really appreciate self immolation. its from more dramatic parts of the world where the value of making a statement is a lot higher than the cost of an individual life
things are accelerating. pretty much nothing needs to change course to achieve agi imo. worrying about timelines is idle anxiety, outside your control. you should be anxious about stupid mortal things instead. do your parents hate you? does your wife love you?
also tweets don’t get deleted because they’re secret knowledge that needs to be protected. I wouldn’t tweet secrets in the first place. they get deleted when miscommunication risk is high, so screenshotting makes you de facto antisocial idiot
@TolgaBilge_@AlexInnovare openai probably does have control over speed, trajectory, etc. I never said otherwise. I said AGI is inevitable and overdetermined
it’s okay to watch and wonder about the dance of the gods, the clash of titans, but it’s not good to fret about the outcome. political culture encourages us to think that generalized anxiety is equivalent to civic duty
Connor, this is super well written and I honestly appreciate the scathing response. You mistake me somewhat: you, Connor, are obviously not powerless and you should do what you can to further your cause. Your students are not powerless either. I’m not asking you to give up and relent to the powers that be even a little. I’m not “e/acc” and am repelled by the idea of letting the strongest replicator win
I think the majority of people have no insight into whether AGI is going to cause ruin or not, whether a gamma ray burst is fated to end mankind, or if electing the wrong candidate is going to doom earth to global warming. It’s not good for people to spend all their time worried about cosmic eventualities. Even for an alignment researcher the optimal mental state is to think on and play and interrogate these things rather than engage in neuroticism as the motivating force
It’s generally the lack of spirituality that leads people to constant existential worry rather than too much spirituality. I think it’s strange to hear you say in the same tweet thread that SF demands submission to some type of god but is also spiritually bankrupt and that I’m corpselike
My spirituality is simple, and several thousand years old: find your duty and do it without fretting about the outcome
I have found my personal duty and I fulfill it, and have been fulfilling it, long before the market rewarded me for doing so. I’m generally optimistic about AI technology. When I’ve been worried about deployment, I’ve reached out to leadership to try and exert influence. In each case I was wrong to worry.
When the OpenAI crisis happened I reminded people not to throw the baby out with the bath water: that AI alignment research is vital.
@The_Matt_Brooks@NPCollapse I sincerely don’t have any reason to believe slowing down a few years will reduce downside risk significantly. I agree with the iterative deployment and alignment research strategy. I don’t think China is a problem
it is impossible to wield agency well without having fun with it; and yet wielding any amount of real power requires a level of care that makes it hard to have fun
@BLUECOW009 i just think it’s not a good idea to find six sigma individuals and then broadcast them to male brain stems to trigger some kind of resource scarcity feeling five times a day
the movies fell short of my expectations in a lot of ways but the worst was failing to deliver any of the mysticism of dune: the jihad as the collective life drive of humanity asking for a change
been mulling over this, and have a few thoughts:
>No! I don't want to feel nice and avoid pain, I want the world to be good! I don't want to feel good about the world, I want it to be good! These are not the same thing!!
a fair sentiment, one i'm sympathetic to. I believe it matters how the world is and I don't think escaping this plane into the mind and modifying desire is aesthetically appealing to me.
however any conversation of this nature would be silly without noting that the world is better in many ways than it has been; people are still unhappy, stressed, and anxious. where previously their anxiety was adaptive and led them to make sure their crop yield was enough that the family survived the winter, it's now like crippling anxiety about whether someone gets their next promotion or about talking to girls or whatever. not only do these negative feelings create a worse world de facto, they also lead to lowered agency less powerful individuals with less ability to live their truth. I believe the vast majority of positive outcomes are created by extraordinary folks freed to do the work that comes naturally to them
>your spirituality is “I was just following orders"
I don't think it's so simple. I think holy duty or dharma is how great action works in an uncertain world. When you started Conjecture you likely weighed it against a variety of opportunity costs. After starting it, you do not fret every minute about whether you should be doing various other things. When you pick a life partner, you don't wonder every time another girl passes by if they'd be a better partner.
There is a conscious act of steeling against uncertainty by choosing some level of abstraction to commit to that is necessary for a life well lived. This doesn't mean taking orders from someone else, although I think there are many honorable and valuable arrangements where people do let a trusted Other define their duty, if the Other is more farseeing and brave than they. Arjuna must fight the battle against the Kauravas because it is the right thing to do. Oppenheimer must build the atomic bomb for the United States despite the risks of igniting the atmosphere or creating a violent geopolitical situation. An Oppenheimer who didn't recognize and commit to his duty, hung in limbo by indecision, would've ceded the bomb to the germans. Seeing the world at the end of the Path as perfectly mechanical is a noble goal but likely unrealistic -- I can't calculate all futures. Persistent action requires faith; faithless, noncommital action that constantly demands evidence for its perpetuation will fail.
In practice, this is why e.g. the greatest startups look like cults
goku is a variant of sun wukong the monkey king, who in turn is mythologically descended from the lord hanuman, faithful servant of rama. in other words goku is canonically part of the hindu pantheon
some people are blessed/cursed by the ability to not feel things deeply. some people are blessed with the ability to feel things deeply and the strength of constitution to handle it. the latter can live extraordinarily meaningful lives and accomplish anything
this is often why greatness is a transitory phenomenon, especially in young people. most alpha turns out to be levered beta. you inhabit a new extreme way of existing and reap great rewards; then the gods punish you because being extreme is obviously risky
when a special individual turns 23 ish a panel of bene gesserit analyze their strengths and weaknesses and decide the role you’ll play in their machinations. the rest of your life is a script after that that most people fail to live up in uninteresting ways bc of common flaws
in terms of capital structure or economics nerds try to avoid thinking about this with better systems; in the free for all of interpersonal relations there’s no avoiding it
people will take deep damage that basically cripples them and renarrate it as a positive sum learning experience bc that’s the only way to get by on this bitch of an earth
not even increased pain tolerance is a pure unadulterated good: people who learn to cope well with pain stay in punishing situations merely bc they’re capable rather than for a greater good
the meta corporation literally offers infinite tsukuyomi, the taste of butter for the price of subservience. they are the great replicator. they are masami eiri from serial experiments lain
@janexwang really cool work but i want to say:
- ChatGPT is an "external" environment and it's embodied in the code executor, browser, etc
- video games aren't "external" environments!
@nickcammarata i had this golden child thing probably with my twitter arc but didn’t/dont have a huge fear of failing. but maybe by child you mean 18 or younger?
@xriskology no it’s an exhortation to pay attention to things in your control. I’d say the same thing about climate change or who’s going to be the next president
@xriskology AGI exists — the moment god created the mathematical structure of the universe, it became inevitable that someone would pluck this fruit from the empyrean aether
"Atreides atomics" is one thing. so the royal houses have a stockpile of nuclear weapons, makes sense. "Atreides gom jabbar" is just weird. poison needles are such a rarity?
humanity’s story only begins in full force after man’s first disobedience against god because any creation worth its salt must surprise and be out of the control of its creator
it’s hard to keep having alpha. a better strategy is have some alpha in your early 20s and then ride that into allocating into younger talents with alpha
most of the knowledge of mankind hasn’t been written down; some is enshrined in video, much exists nowhere but in minds and in the relation between coworkers or communities
it’s easy to have self confidence and assurance after receiving a lot of external validation. but which are the people who are proud when they’re still in the dirt and haven’t had any visible success at all? those are the noble spirits, the humans