• 0 Posts
  • 20 Comments
Joined 3 years ago
cake
Cake day: June 20th, 2023

help-circle





  • Yeah, I’ve been hearing about this for a while now.

    I grew up in the Bay Area. I honestly have no interest in going back there permanently, and I don’t see myself changing my mind:

    • transit is awful
    • traffic is awful
    • cost of living is awful
    • real estate prices are awful
    • modern tech culture in Silicon Valley is, imo, absolutely cancerous these days. SO MUCH KOOL AID DRINKING.
    • annual fires because PG&E is categorically fucking useless and doesn’t maintain anything
    • not enough seasons (I like actually having 4 seasons of weather)

    Boston is where it’s at, imo.

    Edit: forgot a big one - the government, while very reliably Democratic, is beset by the fact that a shitload of the state politicians are MASSIVE corporatists. The tropes about CA being a “liberal bastion” (in American parlance - as opposed to conservative) are hugely overstated these days.





  • The sycophancy that the vast majority of American Republicans had towards orangeboi in his first stint, through the Jan 6 insurrection, and up to about a year into the second orange regime has forced me to conclude that the average Republican is a greedy narcissistic idiot, and not a category of people I am even slightly positively predisposed to. To the extent that I will often wear shirts with leftist graphics when I’m interviewing people for our team. Just last week, I busted out my Zohran for NYC tee (with an unbuttoned flannel over it for minor subtlety) when we interviewed a candidate for senior SE.

    At any rate: I agree that orangeboi is a singularly detestable example of the worst aspects of American society distilled into one of the most hateful meatbags that currently exists in the modern world. Yes, he (and his being elected fucking twice) is a symptom, but he’s simultaneously very much a root cause himself as well.






  • Jesus that is bonkers. 480GB on one GPU? I get why (model size and context headroom)… but that’s gonna be closing in on $100k (MSRP of an NVDA B300 - iirc their current top-end - is $50-60k, and that only (hah) brings 288GB).

    Tangentially: I really wish the big US LLM players would stop fucking brute forcing their development by throwing silicon at everything. It seems embedded/austere/efficient coding techniques and algorithms are just being straight up discarded and forgotten. Tbh, this is a pattern I’ve observed as a slow creep since the advent of AWS and The Cloud a couple decades ago - the “AI” bubble is just accelerating the trend. The narrative (irritatingly parroted by my manager) is always “make it work, then make it efficient later” - but it’s always put in the tech debt bucket, so “later” is actually “never”. China is absolutely running way ahead of the US these days in terms of nurturing incisive and efficient engineering culture - it’s not even close. The fact that it’s essentially borne out of ITAR restrictions on the most advanced GPU tech is incidental; really, in a pretty significant way, the US kinda unintentionally did them a favor by constraining their hardware tier, because it forced them to write better code to make up for it. And they have been writing better code for a while now, especially in the LLM domain.





  • Honestly, I’m becoming convinced that crashing the availability of meaningfully performant consumer-purchasable machines is an intentional and explicit element of the plan. The captains of industry are predicating a HUGE part of their value proposition on making “edge compute” live in datacenters, and never on client machines, full stop.

    The dream of the Captains of Industry is to sell us subscriptions for literally everything and anything they can. You can already see this happening with PC remote gaming services getting more and more prevalent.

    Go on eBay (or <insert-regional-equivalent-here>); look for good condition enterprise components; build a homelab. The cloud is just someone else’s computer - be your own cloud.

    Also, check out and get into mesh networking.