@ded_ruckus I’m not sure my nature is less evil than my forefathers but I’m sure they committed more murder and violence than me. If moral outcomes change without moral fiber changing then this metric is unmoored
im an unapologetic big tech shill if this is the future. the generational companies of the past were like “what if we distributed personal computing to every single human” or “what if we indexed all human knowledge” and you guys are like i am going to do invoice factoring
intuitive decision makers thrive when they’re plugged in and on top of their game: they make preternaturally good calls after processing tons of information. after they grow old and become divorced from the info flow, they try to make confident inferences but will go awry
imo this is why genius and madness ride so closely and why Nobel laureates, Howard Hughes, elon, etc go insane as time goes on. more careful measured thinkers may be safe from this
actually this is a very good classification scheme for scientists and engineers …
zerg is “move fast break things”
toss is “elegant design, overwhelming push”
terran is “defensive posture, build stable infra”
india did not become the preferred industrial trading partner of the west; instead that honor went to china (for various good reasons), and indian growth became centered around back office service economy, involving low skill IT work, call center labor, click center labor, etc
i find emad and stability's partnership with the indian art studios very interesting. imo indian companies will become extremely valuable partners in the machine learning value chains, for several reasons
as an AGI company trying to create digital assistants for any type of mid to high value labor, you need a large pool of workers to use your product in a stage where it's not quite useful yet and be patient with it to create the data flywheel that generates a useful CoPilot for X
on the other hand, the big tech companies, accounting firms, etc have had a much much easier time outsourcing back office service work to india. this creates a very interesting opportunity for several reasons
the indian gov was not forthcoming to work with american industrial MNCs on their own terms; the local rat's nest of license-permit regulatory hell and corruption that creates liabilities for american MNC's made it an unattractive target for outsourcing factories
india has a few things going for it:
1) india is sitting on vast pre-existing back office service work for e.g. animation or accounting or IT or finance or etc.
2) the labor power of indian workers is low, and data privacy concerns are not as of yet existent
working with china in AI value chains is a geopolitical nightmare that is getting worse and worse by the day. it's not clear if you can actually own your data or one or both governments will destroy your business overnight
getting americans to use these tools is difficult generally. in the art and design space, most artists instinctively hate AI art and want nothing to do with it. there's a certain resentment and a feeling that we are trying to replace rather than augment their potential
3) the indian ppl are naturally technological optimists. i'm not sure why this is but you won't find anyone that are nearly as worshipful of the big tech ceos as indians or as mystified by tech. you'll find people that aren't software engineers happy to try new tools
it cannot be overstated how the nature of programming has changed over the past few months. it feels weird and unnatural to write code without the AI, like crawling around after learning to use a bike
the adding a comment -> generating code UX may be unnatural to some. what if you added a pop up box in VScode to instead command it to write some code “write a function that performs X”, which does a text transform to a comment behind the scenes -> “# this function performs X”
.@ashVaswani and @nikiparmar09 may be the most important Indian scientists of all time barring only chandrasekhar and ramanujan perhaps. very undersung
to be clear this is nothing more than an intellectual curiosity. OAI is a sleeping giant that has yet to ratchet up any of its money levers. they’re just having fun
i've been too anti-crypto so i'll say that i've always liked the piratical create new legal/financial system ethos of it all. towards 2021 end, what we actually saw was the 11th noncollateralized algorithmic stablecoin (ponzi) or people remaking normal apps with worse technology
the problem was always that the good use cases for crypto require random people in poor countries without extradition to build insane free market cypherunk neal stephenson network states and instead we got harvard graduate institutionally backed money grabbing nonsense
the decision boundary for deciding who is a critic but on your side vs who is actually just a hater is pretty tenuous. need to be able to tell who is praying for your downfall vs who just wants you to do better
my politics has changed drastically several times but each time bc I thought I found the Correct Way to make technology progress much faster and put humanity on a hundred worlds
@RuxandraTeslo earnest semi autistic, well intentioned people run the world bc many of our systems reward truthseeking to a high degree. best not to become too blackpilled
every year you can watch normal productive well compensated highly promising ppl kicked out of america bc they lost the green card lottery or whatever. ngmi country
neway my problem with this passage isn’t the moral position but the basic economic lie; life extension is an O(1) thing where fundamental advances in biotech will be difficult to research but easy to provide vs effective fertility interventions are O(N), linearly expensive
paying people to have kids has been nowhere effective and the truth of it is that the financial incentive would have to be budget shatteringly high for it to make any sense. vs I think we can get way more QALYs via dosing everyone with rapamycin and metformin or whatever
in a world where nobody wants to have kids radical life extension (of the working age part of one’s life rather than the decrepit part!!) is necessary for the continuation of civilization. as with all such tweets none of this matters because that AGI be hittin in a few
one of the worst path dependencies of all time is that reddit had an r/blackpeopletwitter which was really funny and good and then as a catchall for essentially all other twitter reposts they made an r/whitepeopletwitter where they post mid liberal propaganda
the first weekend after GPT3 came out, i was undergoing a weird psychological reaction. all text i read felt vaguely fake and hallucinated. i felt in contact with alien minds. this effect is about to happen at a civilizational scale in the coming months and years
the upcoming great models have a few things going for them:
- they benefit far more from human rater fine tuning, so they appear more human and less alien
- they're simply more intelligent, so the uncanny valley effect is lesser
but the general feeling of coexisting with alien gods will be orders of magnitude more present and more obvious to everyone rather than just those who spent 48 hour marathons talking to the gpt playground
this kind of rocks. i can actually imagine a certain type of an amazon SRE modifying configs on his apple watch and taking the whole AWS region down. cyberpunk af https://x.com/amasad/status/1584327997695283200
@EnmityNoether@VertLepere like I’ve always said, there will always be a place for humans even in a world with hyper smart robots: compute is scarce, and humans will have a competitive (but not absolute) advantage at many tasks
the high salaries commanded by young engineers are in expectation of their future career growth. even if unimpressive now if they become good they’ll be worth millions to the company. some will not — therefore overstaffing and dearth of good engineers are both possible https://x.com/conorsen/status/1584615455209230336
the number of highly paid people who want to go live in truly remote areas just because they have newfound internet there is pretty low. it's a rounding error https://x.com/welikejpegs/status/1584021808105127937
i suppose the point is we can invent new burbclaves out in the wild but frankly i doubt internet access was anywhere in the top 10 concerns for creating such things
what i do expect is one more iteration of mass recruiting people into the Culture. internet access for like the 3% of humanity living completely remotely will uncover new talents and new ideas. fast satellite internet will also ease some military and civilian travel. cya to GoGo
@VitalikButerin agreed, and i hope several of these communities will form -- but will not matter enough to create macro trends imo. cities and agglomeration are only becoming more important
the way to really get a sense of the power of generative LLMs isn't to interact with them in the limited question&answer sense. have them autocomplete something you are actually writing to be astonished. more creative the genre, the better
@atroyn no, wrong, generating vast amounts of synthetic content is a critical step towards general intelligence. text is not like the real world, it is not hard to simulate at acceptable fidelity
in the best case for generative art, let’s say you make a language interface version of figma, photoshop, aftereffects, shutterstock, unity, blender, etc etc. I figure it’s 500B-1T industry size. LLMs on the other hand is like the entire white collar economy
imo this generation of AGI is data poor, per chinchilla. getting to the next stage will require massive synthetic data. in the case of copilot type models this will mean "self play", where the model generates code, interacts with a REPL, gets a stack trace, plugs that back in
everyone argues that the scale of deep learning models is concerning and indicates a wrong approach but humans have:
- 100 trillion neural connections, each synapse having WAY more complexity than a neural net param
- 200 million year dataset of mammalian evolution
an individual human lifetime is more analogous to few shot prompt engineering of the pretrained human foundation than learning language or reasoning from scratch
https://en.wikipedia.org/wiki/Baldwin_effect
my vibe check is that he’s doing the rounds to demonstrate legitimacy as a ruler to the smallfolk. dude brought his baby to kiss and generate good energy. succession ass moves happening
criticizing meta for bold VR play is dumb but i can and will criticize them for their uninspired product vision. “let other people figure out how it’s useful” model
when nintendo made the wii, they faced a challenge of introducing a radically new controller UX into millions of homes. to go along with it they made best in class games utilizing the new features. it went on to become one of the greatest selling game consoles of all time
frankly i wouldn’t have believed that there would be reproducible open secrets about the human mind lying around like that if smart science brained friends hadn’t investigated them
the SSC post about @nickcammarata misses the most interesting thing about the jhanas, which is that humanity has known, named, categorized, described these altered states of consciousness for ~2000 years and like 0.001% have achieved them
twitter is somehow vaguely important enough to be a digital state. hostile takeover = regime change. old party cadres are being executed in the streets. some are upholding the will of the new rulers without even being asked; several banned accounts are back
several anons confirmed they’re doing personal pair coding sessions with elon to prove the worth of their entire team lol. elons crew is in the house too like david sacks etc
The following text was in the invitation to the engineers invited to the code review meeting: Please bring a print out of the code you've done in the last 30 days (if you haven't submitted code in the past 30 days, then you can go back up to 60 days).
common failure mode of the thoreau “throwing stones over a wall” or graeber bullshit jobs thinking. peoples roles only make sense when you look at them as very strange cogs in an alien machine, teleologically creating the future https://x.com/scottastevenson/status/1586400661943783424
people are definitely wrong when they assume that meta VR headcount is bloated. facebook tends to be incredibly understaffed, with individual engineers managing whole features that are of 9-10 figure importance. it’s just hard to build new tech and salaries are high
not onboard with people who think that humans are irrelevant in the scale of the universe. there’s obviously something special about intelligence. like in the entire universe you can either convert iron to gold in a supernova or in a particle collider on earth and nowhere else
ppl tell me it’s mostly tesla autopilot engineers reviewing twitter code. makes sense bc musk (rightfully) assesses them as the best available software engineers, but also funny bc it seems like massive waste of time for them
@Suhail i figure its more vibes based to assess if the engineers they are assessing have an understanding of the architecture or not rather than actually reading the code
making people pay for twitter is stupid as hell and will never work. every wise guy trying to start a new social network iterates through this idea and realizes exactly why it’s terrible. why not just make the ads products better
a blue check is an identity service to the users. the blue checks create incredible amounts of engagement whether you like them or not. charging for the check is like if youtube stopped its revenue sharing and started charging its top creators instead. pants on head shit
@atroyn it’s a one way function of course. a simulator for checking traveling salesmen completions is easy but finding good traveling salesman algorithms is hard
@ipsumkyle if i had had any talent at dota rn i would be in a pro gaming/opium den somewhere with a hair dyed gf for whom i buy high value in game items while i nurse my wrist that’s slowly developing carpal tunnel
worst part abt the EU as a ‘regulatory superpower’ is that they really don’t seem very good at legal innovation. their environmental policy is a tour de force in doing nothing while pretending to do everything
people have maybe gotten too good at controlling language models. i remember the wild wild west of GPT3 before content filters or human rater fine tuning
as with a normal economy you can juice the supply side:
1) make creator tools radically better
2) intro new modalities, eg videos product
3) revenue sharing
you can imagine twitter as a content economy. many produce tweets of varying quality, and twitter adds them to their content library. they serve the same content to their consumers and take a little tax for the service in the form of ads. better content served ~ more ads seen
unlike a real economy, twitter is centrally planned by several algos. so we can juice the whole thing by making the timeline, ads, and follow recommendations drastically better
any of the above can be done 10x better than current twitter via engineering excellence (what elon and his orgs excel at). what you obviously don’t want to do is tax creators for creating or make it harder for consumers to find the media accounts they want to follow
the pursuit of happiness seems like a strange and limited model for life and if you’re on this path you should skip whatever you’re doing and go do jhanas instead probably
idk if I’m tripping balls but this clearly makes this problem way worse right? rn there’s like 300k blue checks. most users consume or ignore them. making it $8/month will mean there’ll be like a few million buyers maybe out of the 500m MAU making the class system much clearer https://x.com/elonmusk/status/1587498907336118274
this also doesn’t get anywhere close to solving the bot/spam problem considering the vast majority will be unverified. the only rationale i can see here is a personal vendetta against blue checks which is not a good way to run a business with liabilities backed by tesla shares
i think this is sometimes true but not always. one of the comparative advantages of AI is that i do not feel bad asking it dumb or personal questions. imagine all the embarrassing things you google that you’d never directly ask your friends or family https://x.com/emollick/status/1587913322045001728
you’d have to naively eat up propaganda daily to think of facebook as a tragedy. it’s obscene success. here we are on the other end of the internet revolution, the world still stands, a few kids changed it. everyone still complains about everything as they have through all time
kind of suspicious that you were born at the local peak of human population. hopefully nobody applies strange anthropic principles and weird measure theories and realizes this means humanity is about to fall off and the digital creatures that follow don’t have qualia
seems like elons best days are likely behind him. tesla actually achieved its mission of accelerating the advent of clean energy by decades, SpaceX has reusable rockets and seems to be autonomously run by shotwell, he cofounded and left the company most likely to develop AGI
lot of similar types of industrialists and scientists spend the latter half of their life pursuing inscrutable political goals. hopefully I’m wrong and he puts his full effort behind the autonomous robot or the mars mission
even despite all my optimism things are progressing faster than I expected. one thing I wasn’t expecting is how good they got at chit chatting. we r gonna be augmenting/replacing roles like tutor, therapist, counselor sooner rather than later
before you get up in arms consider that the internet was already acting as a substitute for these roles somewhat. “Am I the Asshole” subreddit instead of a therapist or whatever. khan academy instead of a tutor. soon everyone has a khan that they can have dialogue with
souped up twitter blue is good and fine actually. there will be a lot of buyers, myself included. tying it to the checkmark makes no sense. the authentication service is good for the platform more than it is for the content creator. idk ive done well without any checkmark
guy who lives in the concrete jungle, the incomprehensible prison of moloch, amidst a set of towering LED billboards whose messages would’ve killed genghis khan: the sky lights are bothering me https://x.com/lulumeservey/status/1588366970524954624
firing/ stack ranking via lines of code metric is p based. a lot of big engineering orgs do this, they're just kind of quiet about it and pretend it's one of many signals. it is quite a good coarse signal when you're trying to compare outputs of thousands of people
before you get all up in arms, there are easy heuristics to remove package manager spam, document spam, etc from LOC metric. ML teams have adjacent metrics like “models trained”, “GPU hours used”, etc
@boop no they definitely didn’t but layoffs of this scale are gonna have to be coarse grained. if they fired someone incorrectly they’ll end up hiring them back w an insanely lucrative consulting contract. word of mouth i heard that twitter ppl were scheming which teams to cut long ago
@nickcammarata imo ambition is about the magnitude of agency rather than the magnitude of craving but idk
like i can very clearly imagine a guy who desperately craves power/money/sex but isn’t very ambitious about getting it
@nickcammarata people who are very ambitious often seem to have a distilled sense of self and aren’t afraid to apply change to the world rather than eg wanting X more than everyone else
“My work is not a piece of writing designed to meet the taste of an immediate public, but was done to last forever” - Thucydides, as I read him 2500 years later
@cauchyfriend yeah but this doesn’t mean much practically. if you push someone into a whole different region of policy space that you never would’ve seen it’s not apparent to me that it’s the same person. likewise whole civilizations that have met material abundance act categorically different
nothing new at this point but trying to engender sympathy for laid off twitter workers is hilarious
they had kombucha and beer on tap. they can walk down the street and find another job
no zuck's balls got put in a 3way vice grip
- govt de facto banned facebook's acquisitions of new social media platforms
- apple let the golden cow grow & started squeezing them dry as soon as they reached a steady state
- fb apps not allowed in china but must compete w tiktok https://x.com/nikitabier/status/1589415616204926976
remember when everyone was excited that a twitter power user was going to run the show and would have good product insights? turns out the twitter experience of elon musk may be atypical,
startups have a constrained optimization problem where they 1) need to be secretive and protect ip 2) need to hype themselves up for recruiting purposes and 3) do not have the money to compete for talent on salary alone
if you need top talent and not just random devs willing to grind SaaS then it gets even harder bc your targets have 1 million job offers, are shopping around constantly, etc. in this case you need alpha by guessing which ppl are going to be good long before they’re good
@atroyn ok I want to hear the argument for why it’s wrong but putting that aside my point is a lot of great deep learning innovations come from stuff that’s not nature inspired at all, and i wager there’s a slight publication bias towards things that have a physics based backstory
even the growth of weapon lethality hasn’t been a straightforward negative of tech progress. dangerous weapons = larger states = less total combat per capita https://x.com/salisbot/status/1589605149454262273
the number of deaths during ww1 is still small relative to pop sizes. 2 million died in Punic wars, when the entire Roman republic was like ~20 million
everyone following me for years knows that elon could steal my lunch money and punch my mom and id be like he probably had a good reason and he somehow lost even me
the rationalist community has been incredibly correct on all the most important things in the past few years. most criticisms feel like cope now.
this SSC post demoed the power of smart generalists to reason better than 90% of domain knowledge experts
https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-general-intelligence/
the ads product on this website is so trash that most ads get less views than if you just made an organic post and elon’s first thought is why don’t we tear apart the core platform instead
i genuinely think hating digital ads is a midwit trap designed by some coalition of tim apple and legacy media operatives to destroy some of the best websites on the internet
copilot seems like nowhere near the best possible use of currently existing codex models. why is it token capped to 2048 when codex can handle 8000? why doesn’t it use the guided edit model at all
it kind of rocks that, despite the kind of people running FTX being completely different than the Wall Street bond boys of the 80s, the one thing traders can’t escape is profound stimulant abuse
what the hell is “common sense morality”. you know that shit shifts like the sand right. try telling your great grandparents abt ur number of sexual partners or how you have a honorable respectable job as a “software product marketing manager”
i would like to a commission a meditative 5000 word new yorker essay on the type of guy that plays competitive league of legends and their mental pathologies
the thing about elon failing w the blue check subscription fiasco is that i do not think this is a case of someone trying something bold and failing. it’s an ethical lapse of some1 using the public square to punish journalists and doing a bunch of collateral damage in the process
@alexandr_wang might mean the moat on RLHF is small (human labels expensive, training on fine tuned output easy)
but the underlying foundation model trained on trillions of tokens is still a huge moat
ok now let’s say decreasing the power of journos is a noble goal. is this really where the news media gets their impressions? individual contributors tweeting to their niche highly engaged audiences? or the billions of impressions of articles served on Facebook feeds
@MegaBasedChad like do you realize the most massive productionized uses of AI today are products like google search, Fb newsfeed? if you mean generative AI then it’s already revolutionizing programming and will reshape all customer service, email jobs, every computer interface etc
the criticism of EA is like “EA is a centralizing communist ideology” and then when you get to the object level everyone has different complaints about it. some are like “the ai freaks are distracting from solving malaria” and others are like “spreadsheet malaria solving is bad”
loose associations of consequentialists are the furthest thing from monolithic. some of the EA folks are sitting a room smoking the spice drug and concerning themselves with trillions of future simulated minds and others are going off about wild fish suffering
at facebook they have a messaging queue backend service for facebook, whatsapp, and Instagram DMs. it effortlessly serves 100 billion messages per day, the chit chat of the entire world. it is named Iris after the Greek messenger goddess of the rainbow
@gbrl_dick excel destroyed many accounting professions or drove their wages to nothing. there were armies of people who were good at just adding up books. sure the total number of accountants may be higher now but that doesn’t mean folks didn’t become irrelevant
@gbrl_dick it’s like saying well woodworking is still around even though there are factories. I mean sure but woodworking a desk or something is not profitable. there may be a few artisans who survive due to rich liberals or a handful of professionals who design for ikea
@gbrl_dick I agree that job loss due to AI is mostly a dumb fear, lump of labor fallacy, AI id capital and raises wages etc but doesn’t mean there won’t be lots of structural displacement, maybe at a faster pace than ever before
it’s really cool that people exist who want to end wild animal suffering or whatever. i personally don’t care at all about this topic but what an amazing species that it spends some of its time debating how to end the machine that created it
you think you have some privileged knowledge on the struggle and glory of life? versus the degenerates gambling 10 billion dollars for their arcane ends? what the hell do you know
i went into the desert and smoked the spice drug melange and saw all possible futures. elon twitter only survives in the one where we attack and depose allin podcast
@Saurya lol you’re just defining fitness adversarially — nature is a machine of competing molecular machines that try to make more of themselves, whether by natural or sexual selection, on the Pygmy island or on the mainland
one black and/or whitepill on elon is that he’s a deep thinker. he doesn’t make choices for stupid careless reasons; if he’s doing something that looks publicly evil or gauche there’s probably intention behind it
for example being a dick to his fired employees and doing everything possible to lower morale seems like an actual strategy to scour the company and leave only a skeleton staff remaining that have passed all selection pressures
you people are too literal. something can be evil in the typical sense (being a dick to your employees) and good in the global sense (healthier twitter, platform lives on)
it’s interesting to see the literal universal hate of sbf from tech, vox type libs, etc but then adoration from New York Times. it just shows me ive not nearly hit the skill caps on modeling different agents
working around elon is a high selection pressure environment. most in context don’t survive and it’s created a species of insane fedaykin who are ruthless w cultlike levels of fear and worship. some of these are parasites and yesmen, some of engineering death commandos
these people are hard and not very benevolent to engineers in a new org. he’s trying to squeeze twitter to create a similar species. time will tell if it works
one thing i didn’t expect about language model scaling is that they’re in many cases better than google as a search engine. even for niche esoteric knowledge they’re going to directly answer your question with inference, comparison, extrapolation in a way that search can’t
on the flip side google search doesn’t light a fleet of A100s on fire to run an inference. if GPT3 inference cost is 6c then I’m going to arbitrarily estimate that the next model will cost $1.00. use cases must be ROImaxxed
the current thing ranking by importance
1: language model scaling, as always
2: elon twitter, future of the digital commons
3: EAs must reevaluate their funding sources
.
.
.
N-1: trump 2024
N: ponzicoin ecosystem in turmoil due to amphetamine addled CEX scammers
bull case for twitter:
- blue checkmark release keeps getting pushed off indefinitely
- rapid iteration of new content tools, vine comes back, long form paid content, etc
@eurydiceuntil I’m not plugged into this particular psychodrama so forgive me for intrusion but i personally found that you gotta stop blaming your parents at some point. Bless their hearts, distill their volition, and come up with better principles for propagating it
elon game plan:
1) arrive in a poorly run industry
2) take a hammer to it
3) save a few knowledgeable old guys, motivate them with lots of freedom and resources
4) recruit lots of high energy 20 year olds to burn the midnight oil, motivate them with pro humanity ideals
5) profit
.@elonmusk if you’re serious about twitter being the central hub of citizen journalism you need to acquire substack or build an in-house clone immediately. “revue” is not gonna cut it
@growing_daniel in facebooks case more like a product / marketing bar i guess though they did manage to scale users much better than everybody else by siloing to colleges
anytime you put together a group of like 3 good software engineers the net present value of that gathering is immediately in the 6 figure range due to the asymmetric return profile. you just start glowing with money
the belief that the next 20 odd years of technological singularity will be good is not much more than religious faith. which is not to say it’s baseless or wrong but rather that it’s primarily aesthetic extrapolation
“vox populi vox dei” interpreted literally, a screaming many faced god whose fleeting whims and violent delights run the world in the image of the tiktok algorithm
@eigenrobot absolutely. but i do wonder if they can just steal the weights of the biggest models. like I figure MSS has several people at deepmind and openai
@eigenrobot interesting war games here. stealing chip manufacturing processes and jet engines is hard because the real world is finicky and full of complexity. how complicated is inferencing a brand spanking neural net on old hardware?
capital optimization is funny. creates airplanes whose jet engine manufacturing is an intense geopolitical competition with alloy processes known to few on earth, alongside the shittiest onboard consumer electronics money can buy, chairs that don’t recline, etc