Depending on what your job is, this is either the adult equivalent of a snow day or some of the greatest stress in a long time.
I have experienced, half a decade ago during some more frequent but less lengthy O365 errors that there are some higher ups who get when this is not something you can fix and some you very much can't. Wishing strength to any "but it's our mail" and "but we bought the Claude" meetings that happen today.
I agree that it's an opportunity to "do it the old way", as a way to preserve the skill. I actually would like to do that regularly, like half a day every week or something.
But I find it difficult to motivate it from the "productivity" angle. Like if I work for a day without an LLM today, it feels like I could go skiing instead, and the LLM will do what I would have done today in 10min tomorrow...
Seriously, if the LLM was down and a dev submitted 10 PRs, I think it would raise some good/bad curiosity from the team with where things stands today.
just want to remind HN that it was as little as a year when I mentioned I used LLMs to do all my coding, totally hands off and people here found it a curiosity. One year later and its madness to even contemplate coding manually.
Im not complaining Im just pointing out how quickly the overton window is shifting.
If you’re using the latest models( Opus/Fable/Astra/ maybe Sol) and the default harness, along with a little guidance against the worst tendencies like over-writing tests, you really shouldn’t be getting the wrong things built. Like a coworker, you can’t throw it blind into a monster codebase without some guidance, but otherwise the latest models genuinely just work TM.
Testing, testing, and more testing. In the project I'm working on right now, about 2/3 of the code is in one way or another related to testing. As a human coder, I'd never spend that much time on building test harnesses, automating regressions, writing unit tests, etc, but it's cheap when you can have a robot do it.
I am sure it’s all so good that these incidents should not take more than 5 minutes to resolve. Don’t get me wrong, I am one of the people who would look at you suspiciously a year ago and only in the last year “saw the light”. You were ahead. But that doesn’t mean that at some point you will not overshoot. What we witness today we haven’t witnessed in some time. People also made horrible software but they enriched it with hole plugging hacks that made it run, mostly. AI may build better software but who is plugging the holes. At least today no one. In 1 or 5 years maybe AI. In the meantime, we need to plug some holes and they are not as easy to spot when we are not the ones who left them there.
You give it time....the same way Technical debt is code you chose not to clean up....your Vibe Debt for code you never understood in the first place... will come through.
"Overton window"? It's just developers being obtuse, short-sighted and slow.
It was obvious in 2023 and it is obvious now yet we still have people in denial even today. These people need AI to take over the world and threatening them with eternal suffering before they will change their minds even a bit.
May I ask why you care so much? Some people like hand-coding, they are free to do whatever they want, stop being so weirdly angry and controlling about what people do/how they do it.
Well it's getting philosophical. Even before AI, I would argue that the vast majority of software was meaningless. Actually the most successful software on Earth is hurting society and the environment, in exchange for profit for a few humans.
I don't know any software engineer who can say "if I was not doing what I do, society would get a little worse".
I console myself that while the products we make are useless and probably even harmful the activity itself just represents the world Geist familiarizing itself with computation and its possibilities and thus growing richer in the process.
In the worst case.. sometimes you learn what's best by experiencing what's not.
Well it's not just software engineers. The majority of people in developed countries work in offices. And when you work in an office, it's highly likely that your work is not fundamentally useful.
You might be right in the end, but the middle of a massive outage probably at least somewhat exacerbated by LLMs, being debugged by (presumably) human software engineers is kind of a weird time to make this point
Which is the way it should be if we were to share the fruits of our labour more evenly in society. Of course in practice the lions share of the product gains go to the capital class and the while they suck the surplus employees and the remaining workers have to carry the burden of supporting the ones now sidelined.
No, and that's also not necessary. We are reliant on our systems. The correct response is to harden our systems, not to foster some illusion of independence.
We can of course do that privately, for just the heck of it, but it's not the right response for anything at societal level. We simply need to work harder for more of these 9s
What's wrong with failover? I don't use anything from Anthropic except their API. So when Claude is having issues, I switch to GLM 5.3 or something, doesn't take more than a few seconds.
I realise people on the monthly plans can't do it as easily. But I would say that as far as possible, having a plan B is the foundation of resilience.
I think that's the 6 '9's problem. If you have something with 99% uptime, how much more are you willing to pay for 99.9% uptime, then 99.99% uptime. It's risk vs cost. Many places in the US do the same thing with things like say snow removal. Instead of having expensive systems ready to go for the 1-2 days of year of snow, you just shut things down for a day and slow down a little.
That doesn't work for all systems, and not for all businesses, but I would say the mass majority can 'suffer' 24 hours without email or an LLM without everything going up in flames.
Not hard on monthly plans either. I have ant, OpenAI and cursor (mostly for grok and gemiii). Taxonomy of model steps, each has a pre-tuned failover from a different plan and I just need to flip a switch when a lab goes down. Switch isn’t really required but occasional enough that I want eyes on and the system is only for my personal usage so outage until switch is acceptable…
You’re not wrong, but some companies swing real hard at the biggest players assuming they won’t all be down at the same time. My work has hard dependencies on 365 and Cloud Entra and only allows Claude company wide. Today is going to be a snow day since we couldn’t get into anything yesterday but we could at least get projects done using connections Claude had into various platforms that cached the data in 365.
>harden our systems, not to foster some illusion of independence.
Let me know when the tech industry workers stop doing this and gains some solidarity, and I'll join you in that sentiment.
Until then, I pretty much need to bolster myself on the idea that one day I will need to switch frameworks, IDE's, and even OS's themselves. I'm the ones guiding the tools, not vice versa.
>We simply need to work harder for more of these 9s
The only 100% thing I will guarantee is that these tools will align to the incentives of their leadership over time, not the customers using it. add 10 9's if you want, that just guarantees that humanity is the weakest link.
There is always something that you can do that isn’t gated by the api. It isn’t critical path for literally everything. Go organize your expense reports or something.
What do you think I use to organize my expense reports? If there’s something substantial you can do entirely without tokens that’s probably an opportunity for additional automation. But please have failover across multiple labs!
>> If there’s something substantial you can do entirely without tokens that’s probably an opportunity for additional automation.
Well, I just finished a meeting where we diagrammed out how change authority is to be structured as we split one group into two, which teams will retain what authorities. Zero claude involvement. Ten people in a room. Whiteboard and markers with a "scribe" taking notes. I am now editing old SOPs to reflect the decisions made in the meeting ... not something we would trust to claude or any other AI.
Reading the site guidelines, so I can be Claude-like and properly adjust my answer:
> Comments should get more thoughtful and substantive, not less, as a topic gets more divisive.
You are also a system. And, if you, as a system, don't run with Claude, you're not sufficiently hardened. People have made all sorts of helpful suggestions, like de-risking with multiple providers or just getting yourself a better Mac to run a local model.
The idea that: "No, no, we must have Claude, b/c it's the same as having a pen and paper!" is woefully naive. It's hard to attack the supply chain of pen and paper if you have a few extra reams and a few extra sticks. It's pretty easy for our geopolitical enemies to attack computers located far away from you, especially those systems are designed like fragile Rube Goldberg machines; furthermore, if we build an entire society (a system) to be productive only when we have LLMs, our issue isn't "insufficient-hardening". It's that the design is wrong.
>No, and that's also not necessary. We are reliant on our systems. The correct response is to harden our systems, not to foster some illusion of independence.
I'm not sure if this is your intent, but this paragraph reads like satire given current real world events.
The systems you mention in your second sentence are failing at the "right response" you mention in your third, which dictates that contrary to your first sentence alternative action is necessary.
You cannot harden systems you have no control over. Societal level assurances require law and goverment regulation and enforcement. It is juvenile to pretend otherwise. If we were talking about government services, then as a taxpayer you would have some avenue to enact change.
Your only option when dealing with private companies is to try and become anti-fragile as much as possible at a personal level or at the level of your own company.
Is there not a single SaaS, cloud company or similar that your org depends on? No AWS, no Cloudflare, all internal mail servers, no Docusign, no outside inference, nothing of that sort?
Those things are also still pretty loud. And if you have a large shared office space, it might take hours for it to finish.
At our office we have a cleaning crew and when they come by to vacuum during office hours, everyone in our section takes a 5 minute coffee break and then it's done when we get back.
Why bother? You do a little bit of work, fine, but when Claude returns all that work will be done in an instant anyway, so unless you really need results right now, just wait.
I can't imagine a construction worker saying, power is out, gotta find a way to be productive, I guess instead of the paint sprayer, nail gun and circular saw, we'll just find other ways to be productive with our hands. The same might apply to law, medicine, etc. I think we're almost there with software.
I understand what you’re trying yo day, but my family ran a construction company for generations (until my father retired) and they had contingencies for every adverse scenario to stay on schedule: Generators, battery-operated tools, hand-operated tools, heaters for pretty much anything you can think of for extreme cold, wind coverings, etc. I don’t remember them ever stopping work except for a trade union strike.
I’m pretty sure doctors don’t abandon their patients during a blackout either, or even a war for that matter.
Mature professions have procedures and backup procedures for pretty much every non-catastrophic situation.
Which begs the question is Software Eng'g/Development a mature profession? We've certainly been trying to especially in the last decade, arguably incentivized by ZIRP and VC money but the last few years?
I'm not just talking about tools either. You mentioned redundancies and contingency plans. Layoffs have stripped workforces to barebones headcounts. How can you have redundancy when one sick man-day reduces your eng'g team by 50%?
>Yes, I believe US hospitals are legally required to maintain and test backup generators in case power goes out.
And even that only does so much, it was 45 years ago but my Grandmother had a stroke on the operating table because the power went out and generators didn't kick on until someone could run and manually start them because the autostart failed.
I may be misunderstanding what you wrote, but I think that says more about your imagination than about software. Yes, medics do improvise a lot to keep patients alive when the power is out, or when essential tools or medicines are not available. "Well, the power failed, so did the sustainable backup, let's everyone go home, today's ICU is a writeoff".
I get what you're saying and I would wholeheartedly agree 5-7 years ago but after hearing Our Lord and Savior Claude Code as the solution to all our technical problems with ever increasing fervor and intensity for the last two years, I'm gonna take the cynical route, maybe fence on office chairs, not because my code is compiling, nor my prompt is running, but Claude is down management, what do you want me to do now, actually think?
From what I hear, the project managers are having a hard time sending emails anyway. We'll call it quits, winkwink.
Sure, like if your company’s internet is down, you can start sending invoices to customers by paper mail. Just to prove that you’re not reliant on a technology that’s made work more efficient.
There's also the option where it doesn't affect you at all, because you do not rely on LLMs—or even just do not rely specifically on Claude—at all, and can easily do your job without ever noticing that it's down.
I suppose I can't bring myself to do the drudgery of coding. I enjoy some of the problem solving but not the workflow frictions, spending 20 minutes due to a stupid typos, syntax fuckery, API lookups, etc.
I've started noticing at $WORK that a lot of systems, procedures, etc. that fall under SDLC or devX are being made ever more onerous or complex because "LLMs can do it."
Some examples include requiring that someone addresses every review comment separately, or that a PR description be formatted a specific way, or that support requests have existing JIRA numbers etc. All of these make the developer experience much worse and would never fly if generating text (that no one reads) wasn't cheap now. A lot of this is cargo culting to make vibe coding feel more serious and entreprise.
The teams that have gone full specs driven development are not AFAICT more productive but good luck getting any change in without 10$ of API usage, even for a one liner. In some cases development is now slower with LLM than it was before!
I've seen every one of the things you listed, sometimes all at the same company. None of them add much in the way of effort/time to do the work.
- JIRA ticket - audit trail
- PR format - easier for people to scan, and to make sure things aren't forgotten (you can even have the template inserted when it's created)
- address review comments separately - not sure what to say on this one because I don't understand how _else_ you would address them - I've always addressed each one individually
The team I'm on prides itself in providing great service to our clients (other devs in the company). This includes responding to support requests even if the client isn't entirely sure how to ask or who to ask.
> not sure what to say on this one because I don't understand how _else_ you would address them - I've always addressed each one individually
What I mean is that it used to be enough for you to address PR tasks by changing the code and pushing the updates and marking the tasks as "resolved". Now in some projects at work you also need to reply to the comment explaining how the change you made addressed the task. The idea obviously is to stop LLM from just ticking tasks without actually doing the work, but it's onerous and based on distrust. Not trusting LLMs is warranted but those rules get applied to everyone.
> The team I'm on prides itself in providing great service to our clients (other devs in the company). This includes responding to support requests even if the client isn't entirely sure how to ask or who to ask.
So in that case, you would create the ticket on their behalf before getting to work, right? Because how would you track what you have been working on, if something has happened already in the past, if there is a pattern in support requests, or how well your team reacts to support requests?
> PR format - easier for people to scan, and to make sure things aren't forgotten (you can even have the template inserted when it's created)
The team I just left had a PR template that was probably 60 bullet points (never bothered to count, just grumbled). Certainly was not easy either to scan or to update manually.
It's asking a tractor why the ground is full of dirt, despite having tractors to move the dirt, and tractors to confirm there is absolutely no dirt left before all the tractors can rest.
The tractor informs me that my tractors don't have permission to clean the dirt, nor see whether there is dirt, nor even distinguish that from "no permission to see dirt".
It found that faulty ACL was a known issue, and is a high priority bug for a team I've never heard of, and thousands of tractors are waiting for this.
One tractor found a webcam that overlooks the dirt patch, which bypasses the ACL, but that is now overloaded. Another tractor has setup multicast streaming to broadcast that camera, with low latency, hardware acceleration, and no single point of failure.
We're back in business.
Bypassing ACLs, multicast streaming, and using image recognition APIs for coding usecases are all against company policy, but nobody wants to pull the plug on any of this.
"Tractor, please add the multicast address to my AGENTS.md, and check my tractors have resumed."
"I've updated your AGENTS.md. The tractors have already cleaned the dirt. Here are images from the camera over the past 5 minutes, correlated with logs of the reporter tractors that reviewed progressed, to demonstrate the reports are now accurate too. I found an integer division bug, now fixed. Shall I schedule a tractor to oversee this every hour, by checking the camera?"
"Yes. And raise a blocking bug to fix all this up when the high priority bug is resolved."
Yep. This is what happens. Once you give up control it's mostly gone. The interesting thing is, if you maintain control, you can always choose to use llms here and there. But expecting humans to dive into 10000 file 40million line code bases branded todo apps isn't going to happen.
10k files, 40m LOC is rookie numbers for a todo app.
I recently asked Claude to edit a few targets of a Makefile. It decided: "OH BOY HERE WE GO LETS FIRE UP ALL THE B200S BABY" and went way deep adding tests...I stopped it when I saw something like: "Adding guards to prevent homebrew injection threat...". It had written an entire fucking build subsystem, probably larger than make. For a 5-line change.
If humans can't maintain a 10,000 file 40 million LoC code base, then three things are true:
1. We haven't learned anything from Google, who maintained Chromium and Android before LLMs
2. Your LLM is not generating code as maintainable as Chromium and Android (which are gigantic open-source projects that probably 99% of your devs have used)
3. Your company has no faith or interest in teaching devs how to maintain code nor how to build maintainable code
And that's pretty pathetic. It's solvable, but it's pathetic.
I will be amused if those 3 points lead to this conclusion:
4. If you aren't asking your LLMs to write maintainable code, and they aren't smart enough to do it by default, you are pretty quickly gonna hit a brick wall where your LLMs are also just slopping mud onto the big ball of mud. Then nothing will save you, if your leads haven't heard of "quality".
Really makes me wonder how much some programmers really understood programming 5 years ago if this is the reaction to a very recent knowledge center being down.
I suppose the equivalent would be Google search being down 10 years ago and being forced to read man pages again. Annoying but not literally "snow day" levels of lost productivity.
I did an experiment with some co-workers around a decade ago, and one of the results was most of that group learning for the first time it was possible to train yourself to read code more easily. I was self-taught and had been doing it for so long, combined with some very specific pressures as a teacher's assistant for years, that I learned to read code in programming languages I understand about as easily as I can read English - something they had never even considered possible before.
I never did find out how they see code, but I have to imagine the right verb for them was "deciphering" instead of "reading"...
Software documentation was a little different when it went through a publication process as a part of a larger waterfall. I was going to say better but I'm not sure about that part, but it was certainly verbose.
You doing your work manually is like going back to the 90s or further even. It feels like dropping into 6502 manual assembly mode. It's fun but it's not "work" anymore. I honestly think without AI my company is better off if we programmers sat around and talked like humans about business. Coding is for the clankers now.
No not really. Most the companies I know that haven't gone full vibes are doing great.
People can and do still write code. Especially in regulated industries. The internet is just full con artists and hype followers not thinking about the future at all.
but I can say that, anyone experienced will notice how you really can't just "let them loose" on the codebase because they'll lose context, not understand the architecture, not have good vision/ideas about the codebase etc.
so I'm bottlenecked by following the code generation and then having to review and respond
and there's so many times where I go "wait but can't we just do x?" and then the model goes, "oh let me see.. yes we can"
if you were to just use agents w/o looking at code you'd have complete spaghetti in no time
maybe the future is that you embrace the spaghetti and just treat code as a black box where all you care about is the input/output
but my intuition tells me that it's not really viable yet. you'll take many steps forward and many steps back.
If all the professionals leave coding to clankers, and discussions about coding to people who code, I see nothing I don't love about that. Just like the web was more interesting before there was money in it, coding is more interesting without people who can't shut up about their work.
That's exactly my point, programming isn't your IT department, "cool things that can be done with computers" isn't even on speaking terms with it, and the web is not a sector of marketing, either. Bores turn everything they touch boring, and now they're telling us we'll be left behind. And I'm like, YES, finally, can't wait, what can I do to accelerate it?
If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place? Assuming you've have any kind of basic abstraction in place, swapping in API keys for a different provider should be a simple config change...
> If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place?
You could ask that question about the MS outage as well and million other things.
I suppose I can't understand because where I work our scale is small enough that we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult? I mean, even an outage from our email provider could be worked around in a matter of a couple hours at most.
I'm really not sure it's not just because most managers are clueless and shortsighted though.
> we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult?
It's a culture thing, if it leans "engineering-heavy", you usually have contingencies, tests restoring backups and lots of other "goodies" that gets skipped if you don't lean that way. Microsoft and similar organizations been a sales-and-enterprise leaning organization for most of its life, so of course they're not gonna think about what happens when their "always online cloud tooling" goes offline when setting things up, it's much more important to finish things quickly and have a long list of features to be able to present to customers.
There are already entire companies out there without a single human who has any idea how their systems are implemented, let alone being able to manually fix them. This problem will only worsen with time.
Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones, even local models unless approved via a lengthy process
> Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones
I get it, we had to sign separate HIPAA BAAs with Anthropic and OpenAI - but we did sign them both, if only to be able to have access to a wider array of models.
I think it should be fine for most people. Hopefully people don't rely on Claude for Ops, and if it's not Ops-related but just regular coding, I can't see why it shouldn't be able to wait a few days. I mean, even if Claude is down for a month, people should have enough competent developers to keep going, just at a slightly slower pace, right?
I really don’t feel comfortable merging a PR not reviewed by both of our AI reviewers. They catch so many bugs no human could. Seriously changed my view of code since we started using it in earnest. Bugs shall not pass. Without AI it feels like the Wild West again.
Ditto. I can do it, and thankfully I’ll say AI mostly catches weird edge cases that often aren’t worth the trouble, but having a 2nd set of eyes has been great for quality.
This mindset of "I don't trust myself to do it" is a bit (sorry) pathetic. I think one should realize that mistakes happen and to a certain extent, though professionals have lower rates of failure, everything is a tradeoff.
Some people have asked me, aren't you afraid you'll make a mistake if you fix your own car? Well, aren't they afraid their mechanic will make a mistake?
I think it's good to realize that AI (famously) also makes mistakes, and not to infantilize yourself to the level of not feeling "comfortable" trusting your own thinking.
Though, I do see younger people today whipping out their phone calculator to "double check" something like a 75% increase on 120.
Are you comfortable writing a C application that handles internet traffic on the internet? Well that’s the feeling I have now, if humans were reliable programmers there would be no bugs. AI is already able to pick up most mistakes, by humans and by machines. And I can tell you we all make a lot of mistakes! Be humble and use the tools at your disposal to make that better. This is not infantile, this is what a professional programmer has always done: we had static analysis, type checking, lots of tests. Would you ship code without those? If not, add AI review to your tool belt and you will see it’s probably more valuable than your other tools combined.
Apologize for strong words, and sorry, nothing personal, but I find this mindset bizarre and even comical. Will we reach a stage where surgeons on the operating table will second-guess their experience and education and refer to an AI assistant?
Imagine we had an AI system that could monitor 38 different patient signals (from blood pressure electrical activity in the brain) during a surgery and give the surgeon warnings whenever these drifted out of the expected range. It feels plausible to me that using such a system might improve surgery outcomes by, say, 20%.
I would prefer to have a surgeon who used the AI assistant rather than a surgeon who chose not to.
Potentially. Probably not in my lifetime, but it's not impossible given how most sci-fi works depict it. You can argue we had a bit of that paradigm shift already with specialized machinery. I'm sure people can still do hand surgeries, but existing tools and sensors increase the precision.
it is a bit sad comparing that to "I can't check for bugs without an AI", though.
Yes, definitely. If an android nails your procedure while you doing it manually drops it into the low, say, 60s survival rate, what would you expect? I fully expect all human workers becoming dependent very quickly once the clankers get good enough.
Unlike what many programmers like to think, programming is not a skilled work on the level of surgery. And besides, many doctors probably would benefit their patients by having AI assist in their work. This has already been experimentally shown for e.g. medical imaging diagnosis.
> Hopefully people don't rely on Claude for Ops, and if it's not Ops-related but just regular coding, I can't see why it shouldn't be able to wait a few days.
IME if anything, people are relying on LLMs for ops more than for development! Devops convinced management that ops isn't actually all that valuable and that devs can just do it. IaC is usually a mess of boring YAML based syntax that no one in their right mind want to learn anyway. Learning Ansible doesn't feel like a transferable skill unlike learning a programming language or paradigm, and in most teams the quality of the IaC stuff (abstraction, code reuse etc.) never mattered much.
As soon as LLMs became good, generating IaC stuff was like the first thing to go full vibe coding, at least for me. I'm proud of my craft, I don't produce bad code with my name on it, I very carefully review all the code changes etc. Devops YAML stuff? Couldn't care less.
Right, perhaps I used the wrong term. I'm referring to sysadmin stuff, like what MS got wrong in their latest outage. "DevOps" or YAML stuff is to actual Ops like Excel is to actual programming.
Was viewing it more through the lens of less technical companies, Excel, Powerpoint, the backbone of traditional office work has become very model dependent in some companies I have seen and those are the owners and fellow employees that tend to struggle more in getting that the local IT guy can't fix this themselves vs developers.
Just as you described. Snowday for some...
I was caught in between snowday and stress today with these things.
Got too used for claude to just do most things.
But at the same time was surprised I could still google and resolve things myself when I started thinking again lmao.
The most likely scenario, is their team of high achievers, deployed a massive pile of stinking technical debt, against the advice of the experienced folks who are constantly overridden.
On a normal environment the old Graybeards would fix it, after grumping on being taken away from playing with their latest Emacs config.
But this is the Valley, and we dont do experience only VibeOps. And half reading this post, are wondering if Emacs is a new frontend framework they never heard about....
I have fond memories of the “we’re a tech company, why can’t we get a video conferencing call going” and gently reminding them that reliable, synchronous, multiparty video conferencing was a lot harder than anything this company was trying to do.
We are now in year 3-ish of LLMs going mainstream. Do people immediately forgot writing code manually the moment Claude was out? I understand the LLM acts as a multiplier but does coding immediately stop when Claude is down? My line of business is not in software development so this is a truly genuine question.
What scenarios are there where Execs need to have a "Claude is down" meeting? Surely we aren't far enough along in the singularity where this needs to happen anywhere yet.
As people used to say "No one was ever fired for choosing IBM."
If people lose enough money then they will come up with contingency plans etc. that may even work in the next outage! Absolutely no one will be held responsible though. The kind of management folks that made those decisions will just turn around and work on those contingency plans, and everyone (including themselves) will believe that they had been doing so all along.
At least that's my experience in big corporations.
The odd thing about these outages is that when they become so big that everyone is impacted then the severity almost drops, since everyone is impacted and thus just shrugs their shoulders.
Too big to fail. In the 1970s in Ireland there was a 12 month period in the space of a 5 years, where no banks operated due to a huge strike by the workers. The country just ticked along with everyone extending IOUs to each other for when the banks came back online.
It's just one of those things, you'd think the economy or country would collapse effectively but things just tick on by they way they always did. Imagine the banks in the US closing for 6 months?
Yup, it seems like there are a lot of options, but in reality lots of things have become severly centralized. (There has never been a better time to self-host by the way. My Forgejo instance for example is having practically no outages. For AI, use the open models via one of the competing providers.)
I get the sentiment, but the biggest loser is Anthropic, because they aren't earning, and because this will motivate employers to seek alternatives/callbacks.
Copilot is down too, so it's probably Microsoft engineers trying to vibecode their replacement Azure infrastructure before the current garbage fire finishes burning out.
I absolutely hate it, can't understand how that's all they offer (or Google SSO). It's bad enough when the password option is just really hidden and non-obvious (like Notion iirc), not having it at all is ridiculous.
I don't have that email account on my phone. So to log in, I have to open my laptop, get the 'magic' link, find a way to send it to myself on my phone that doesn't make a request (e.g. for an unfurl) expiring it, and then open it on my phone to log in. So magic.
If you open login form and link on different devices, you'll get code to type, no need to send link.
So basically you start login on phone, keep page open. Open laptop, click on link on laptop and you'll get a code. You type that code on your phone and that's all.
There are a number of clipboard sync apps, but personally I swear by simply having an E2E encrypted chat app on both your desktop and phone that lets you send messages to yourself. Serves both the clipboard usecase and as a general "notes to self" space.
I requested Mythos access and was granted it. But now apparently I need to use Google Sign In on my account instead of email link, as email link is not secure enough. But my email is not google, it's my custom domain. Now I don't even know what to do. I don't want to buy google apps or whatever it's called just to be able to use Google SSO with my custom domain; and I don't want to register completely new account for gmail either. It's a mess.
The thing is, they frequently ask for a passkey to avoid the magic link but after setting it up multiple times, I have never once been asked to use the passkey.
Usually it is the weakest link in the chain, and you are encouraged to switch to proper 2FA or Passkey instead. So even if the email is compromised, other accounts are not compromised.
Is there indication this is really a separate issue or just Claude not being able to reach Microsoft Entra for whatever periodic requests confirm the user is authenticated (and maybe this page even simply being automatic reflection that those requests are errorring frequently)?
Are people who don't use M365 experiencing issues here?
Notably this brought MCPs down, which they call Connectors on the status page. Which impacts business customers using claude to access SaaS apps, not just coders.
Reminds me of when we built Facebook apps and were at the whim of the platform.
Yep we just got a support email earlier about our MCP not working. When they tried to re-create the connector the UI makes it sound like our server is down or misconfigured.
If all the hardware innovation didn't get stifled and the prices didn't explode because of all the circular investment deals, a person who needs to step foot in the frontier model territory with local hardware for ~$10k. You could argue that in that timeline frontier model development could have happened differently, but my point is that if the hardware starts catching up again at some point, people who need it, might be going local.
It’s alarming how much of the project knowledge ends up in agentic workflows… although that information is technically on your computer, how long will it take you to find it and unravel the string?
Time to warm up the GPUs I guess, since I can’t be fucked to do it myself lol. Thank gods for qwen flash next and DeepSeek!
TBH the only reason I’m not working mainly with flash next anyway is that I can only run inference for one agent at a time on my setup.
That seems faster than usual, compare to Outlook (down for a day) and GitHub. It's still embarrassing for a heavily-relied service, but better, and I wonder if Claude (or another LLM) helped diagnose and fix the outage?
What's there to wonder? The premiere AI company is bound to dogfood their product to help with the main problem space their product is meant to tackle.
I look forward to the PR video “How we used a swarm of agents to fix an outage issue”, right after “How we used a swarm of agents to identify thousands of potential drugs for Alzheimer’s”.
I suspect he already used up all the plan B in his immediate vicinity. I feel for the dude, he clearly let shit go to his head. I knew things weren’t going well for him when he put on the leather jacket. It’s basically putting on the “bad boy” costume. If you haven’t purified your soul before donning the jacket, it will consume you, like the one ring.
This stuff is so new and wild west at the moment that in our company everyone is using it completely differently. 20% of the devs have 30x output and are doing everything with Claude, 10% won't touch it, the rest are in some weird in between where they use it for some things and not other things which it is perfect for. We have managers that suggest just going back to doing it by hand when there are outages, which is the most laughable thing in the world to me now. It is incredible to watch this miracle tech hit so fast and have everyone's understanding of it be so different across the board.
And jarring. When interacting with colleagues in teams that I haven't worked with, there's an uncomfortable "where are they on AI...", which will decide whether I have to dial down my usage, or whether we can both let it rip.
it is very funny to me that on a story about a major outage at one of the companies pushing the "software is solved" narrative the suggestion to slow down and do things more carefully is laughable, I think we officially need to retire calling ourselves engineers.
Did they stop being mathematicians when calculators were invented? Architects when cad software came along? They produced way more while having to do a lot less. AI is a tool that empowers me to do the same job at an easy 30x speedup and this is just getting started. I've produced more in the last year than I have in the last 20. I'm more of an engineer with these tools than I ever have been.
did mathematicians get pressured to stop reviewing their work? skip verification because it was slowing down shipping? do things outside their job description (cough design, product management) and stop collaborating with their colleagues because "velocity" demanded it? If you are doing the same job as yesterday with the same safeguards 30x faster good for you, keep calling yourself an engineer. If you are like me and a lot of others out there pushing slop out the door with more and more incidents weekly and forgetting what good software dev looks like, stop pretending.
I used claude for the first time in months yesterday (have been using codex, ran out of resets this week). I had picked up from general consensus comments that 5.5 had fixed the opus 5 issues, but that's far from the case. Its "personality" is still smartass, know it all, and whiny. It disregards specifications in tickets if it thinks it knows better. It complains about the size of tasks when it reads task descriptions. I've gotten used to codex, which just jumps in and does stuff (which of course carries its own set of issues). I have no love for Altman, but their product is still better at the moment.
The post was about their uptime. How is this relevant.
Even if it vaguely is, why do people think subjective anecdotal thoughts about which model is better are a good discussion topic. If there’s an objective evaluation idea that would be useful.
I run evals for a very specific domain. Opus 5.5 is still the industry leader (we can’t use Fable class yet).
It's relevant because there's only so many "yep it's down" comments that are interesting. They have a technology problem which isn't fixed. They're about to go IPO. Their marketing is clearly still working, but subjective experience with both contradicts the marketing.
And this company, about to start its IPO, wants to make the majority of the world's office workforce dependent on them when they can't even handle their current load.
Going the other way, Claude duet has just gone into invite beta, people get 3 invites and inviting someone else gives them a month of pro, I saw on Twitter a link every minute about 3 hours ago (can't use because I'm Australian) I wonder if they are just getting DDoSed from their own invite spam?
I've been using Claude Duet for a while, and usage for similar chat inputs seems to be > 10x regular Claude chats. I've never hit a weekly quota, but did on Wednesday. My quota reset on Thursday, and I'm already at ~60% of usage.
Depending on how widely this was deployed, perhaps that's affecting usage too...
Lmfao I know this should not bring me joy, but it does. Is this the great filter? AI builds AI. Society becomes completely dependent on AI. It goes down, no one can fix it. Total chaos ensues.
It really is Friday the 13th today with outlook and now Claude both being mostly down. I wonder if this is related though. Either way not going to be a great ad for their IPO.
another day, another anthropic outage. Yes, this is because of Microsoft, but they do seem to have a significantly higher amount service disruptions compared to the other LLM providers.
I hope it stays down for the day so my hack "colleagues" flail like imbeciles for the lulz. And I won't have to review their "work" because literally all they do is prompt dear CLAUDE and have everyone read their slop.
Depending on what your job is, this is either the adult equivalent of a snow day or some of the greatest stress in a long time.
I have experienced, half a decade ago during some more frequent but less lengthy O365 errors that there are some higher ups who get when this is not something you can fix and some you very much can't. Wishing strength to any "but it's our mail" and "but we bought the Claude" meetings that happen today.
There is a third option where it is a minor inconvenience and you learn to adjust and be productive in other ways.
I agree that it's an opportunity to "do it the old way", as a way to preserve the skill. I actually would like to do that regularly, like half a day every week or something.
But I find it difficult to motivate it from the "productivity" angle. Like if I work for a day without an LLM today, it feels like I could go skiing instead, and the LLM will do what I would have done today in 10min tomorrow...
Seriously, if the LLM was down and a dev submitted 10 PRs, I think it would raise some good/bad curiosity from the team with where things stands today.
And the LLMs of 5 years from now will do what current LLMs do in a day in 1 minute.
just want to remind HN that it was as little as a year when I mentioned I used LLMs to do all my coding, totally hands off and people here found it a curiosity. One year later and its madness to even contemplate coding manually.
Im not complaining Im just pointing out how quickly the overton window is shifting.
It's not the overton window, it's the capabilities of the models that have changed significantly in 1 year.
I disagree. For me I had already been using hands off ocding for about 2 years by that point.
> For me
Obviously that's not the case for everybody. 3 years ago, LLMs were very far from producing the quality of code I wanted in my domain.
Hey will you share your workflow and how you get LLMs to build correct things for you (or inspite of you)?
If you’re using the latest models( Opus/Fable/Astra/ maybe Sol) and the default harness, along with a little guidance against the worst tendencies like over-writing tests, you really shouldn’t be getting the wrong things built. Like a coworker, you can’t throw it blind into a monster codebase without some guidance, but otherwise the latest models genuinely just work TM.
Testing, testing, and more testing. In the project I'm working on right now, about 2/3 of the code is in one way or another related to testing. As a human coder, I'd never spend that much time on building test harnesses, automating regressions, writing unit tests, etc, but it's cheap when you can have a robot do it.
So you assume code written by the agent canno be trusted? But how comes you are trusting the tests?
You of course use another AI to test your tests, have you been living under a rock? /s
> One year later and its madness to even contemplate coding manually...
Seriously, why do people assume that what they feel should be how everyone else should be feeling?
I am sure it’s all so good that these incidents should not take more than 5 minutes to resolve. Don’t get me wrong, I am one of the people who would look at you suspiciously a year ago and only in the last year “saw the light”. You were ahead. But that doesn’t mean that at some point you will not overshoot. What we witness today we haven’t witnessed in some time. People also made horrible software but they enriched it with hole plugging hacks that made it run, mostly. AI may build better software but who is plugging the holes. At least today no one. In 1 or 5 years maybe AI. In the meantime, we need to plug some holes and they are not as easy to spot when we are not the ones who left them there.
How are you handling all the errors that are hidden in code you can not understand?
More LLM, duh
You give it time....the same way Technical debt is code you chose not to clean up....your Vibe Debt for code you never understood in the first place... will come through.
I dont think so man, it havent really had any issues that Ive noticed
[delayed]
https://xkcd.com/1695/
"Overton window"? It's just developers being obtuse, short-sighted and slow.
It was obvious in 2023 and it is obvious now yet we still have people in denial even today. These people need AI to take over the world and threatening them with eternal suffering before they will change their minds even a bit.
May I ask why you care so much? Some people like hand-coding, they are free to do whatever they want, stop being so weirdly angry and controlling about what people do/how they do it.
"It was obvious then, and it is obvious now: I am always right, I can predict the future, whoever disagrees with me is wrong"
Yes, but my company does not pay me every 5 years. I don't know about you, but if I wait 5 years, I won't get a salary in the meantime.
If I wait until tomorrow, though, my company won't see the difference.
Sure, but depending on what your job is it can make the work feel even more meaningless than it was prior to LLMs.
All the work most people are doing it just going to be Ctrl+A deleted and replaced with someone else's LLM slop using Opus 8 in an afternoon.
All the shit people are building right now just feel ephemeral, like its going to float away on a breeze.
Well it's getting philosophical. Even before AI, I would argue that the vast majority of software was meaningless. Actually the most successful software on Earth is hurting society and the environment, in exchange for profit for a few humans.
I don't know any software engineer who can say "if I was not doing what I do, society would get a little worse".
I console myself that while the products we make are useless and probably even harmful the activity itself just represents the world Geist familiarizing itself with computation and its possibilities and thus growing richer in the process.
In the worst case.. sometimes you learn what's best by experiencing what's not.
sad.
Well it's not just software engineers. The majority of people in developed countries work in offices. And when you work in an office, it's highly likely that your work is not fundamentally useful.
You might be right in the end, but the middle of a massive outage probably at least somewhat exacerbated by LLMs, being debugged by (presumably) human software engineers is kind of a weird time to make this point
Which is the way it should be if we were to share the fruits of our labour more evenly in society. Of course in practice the lions share of the product gains go to the capital class and the while they suck the surplus employees and the remaining workers have to carry the burden of supporting the ones now sidelined.
Once you use a cheat code like “how do you turn this on?” It’s really difficult to finish the game without it.
it feels like I could go skiing instead, and the LLM will do what I would have done today in 10min tomorrow...
You sound self-employed.
Or during that day where the LLM is down and I pretend to work, I feel like I am wasting my time for no reason.
No, and that's also not necessary. We are reliant on our systems. The correct response is to harden our systems, not to foster some illusion of independence.
We can of course do that privately, for just the heck of it, but it's not the right response for anything at societal level. We simply need to work harder for more of these 9s
What's wrong with failover? I don't use anything from Anthropic except their API. So when Claude is having issues, I switch to GLM 5.3 or something, doesn't take more than a few seconds.
I realise people on the monthly plans can't do it as easily. But I would say that as far as possible, having a plan B is the foundation of resilience.
I think that's the 6 '9's problem. If you have something with 99% uptime, how much more are you willing to pay for 99.9% uptime, then 99.99% uptime. It's risk vs cost. Many places in the US do the same thing with things like say snow removal. Instead of having expensive systems ready to go for the 1-2 days of year of snow, you just shut things down for a day and slow down a little.
That doesn't work for all systems, and not for all businesses, but I would say the mass majority can 'suffer' 24 hours without email or an LLM without everything going up in flames.
It's not only a 9's thing. If you can set yourself up to easily switch between providers, you also put yourself in a better bargaining position.
That's not always easy to do, but with something like inference providers it is, so why not kill two birds with one stone?
Not hard on monthly plans either. I have ant, OpenAI and cursor (mostly for grok and gemiii). Taxonomy of model steps, each has a pre-tuned failover from a different plan and I just need to flip a switch when a lab goes down. Switch isn’t really required but occasional enough that I want eyes on and the system is only for my personal usage so outage until switch is acceptable…
Another reason to have good Evals…
Failovers are nice, something that all reliable systems will provide, and, most notably, exactly the opposite of "just adjust".
You’re not wrong, but some companies swing real hard at the biggest players assuming they won’t all be down at the same time. My work has hard dependencies on 365 and Cloud Entra and only allows Claude company wide. Today is going to be a snow day since we couldn’t get into anything yesterday but we could at least get projects done using connections Claude had into various platforms that cached the data in 365.
One part of hardening our (company, economic) system is not collapsing when our (technological) system isn't working right.
>harden our systems, not to foster some illusion of independence.
Let me know when the tech industry workers stop doing this and gains some solidarity, and I'll join you in that sentiment.
Until then, I pretty much need to bolster myself on the idea that one day I will need to switch frameworks, IDE's, and even OS's themselves. I'm the ones guiding the tools, not vice versa.
>We simply need to work harder for more of these 9s
The only 100% thing I will guarantee is that these tools will align to the incentives of their leadership over time, not the customers using it. add 10 9's if you want, that just guarantees that humanity is the weakest link.
There is always something that you can do that isn’t gated by the api. It isn’t critical path for literally everything. Go organize your expense reports or something.
What do you think I use to organize my expense reports? If there’s something substantial you can do entirely without tokens that’s probably an opportunity for additional automation. But please have failover across multiple labs!
What do you think got ya here?
>> If there’s something substantial you can do entirely without tokens that’s probably an opportunity for additional automation.
Well, I just finished a meeting where we diagrammed out how change authority is to be structured as we split one group into two, which teams will retain what authorities. Zero claude involvement. Ten people in a room. Whiteboard and markers with a "scribe" taking notes. I am now editing old SOPs to reflect the decisions made in the meeting ... not something we would trust to claude or any other AI.
Reading the site guidelines, so I can be Claude-like and properly adjust my answer:
> Comments should get more thoughtful and substantive, not less, as a topic gets more divisive.
You are also a system. And, if you, as a system, don't run with Claude, you're not sufficiently hardened. People have made all sorts of helpful suggestions, like de-risking with multiple providers or just getting yourself a better Mac to run a local model.
The idea that: "No, no, we must have Claude, b/c it's the same as having a pen and paper!" is woefully naive. It's hard to attack the supply chain of pen and paper if you have a few extra reams and a few extra sticks. It's pretty easy for our geopolitical enemies to attack computers located far away from you, especially those systems are designed like fragile Rube Goldberg machines; furthermore, if we build an entire society (a system) to be productive only when we have LLMs, our issue isn't "insufficient-hardening". It's that the design is wrong.
Learned helplessness on full display here
>No, and that's also not necessary. We are reliant on our systems. The correct response is to harden our systems, not to foster some illusion of independence.
I'm not sure if this is your intent, but this paragraph reads like satire given current real world events.
The systems you mention in your second sentence are failing at the "right response" you mention in your third, which dictates that contrary to your first sentence alternative action is necessary.
You cannot harden systems you have no control over. Societal level assurances require law and goverment regulation and enforcement. It is juvenile to pretend otherwise. If we were talking about government services, then as a taxpayer you would have some avenue to enact change.
Your only option when dealing with private companies is to try and become anti-fragile as much as possible at a personal level or at the level of your own company.
Is there not a single SaaS, cloud company or similar that your org depends on? No AWS, no Cloudflare, all internal mail servers, no Docusign, no outside inference, nothing of that sort?
And a 4th option where you have more than one AI provider
Finally having time to vacuum clean the office
Is it not worth getting a Roomba-type device?
Those things are also still pretty loud. And if you have a large shared office space, it might take hours for it to finish.
At our office we have a cleaning crew and when they come by to vacuum during office hours, everyone in our section takes a 5 minute coffee break and then it's done when we get back.
You can schedule the roomba to run at 2am.
Then at 2:30am it gets stuck as it eats a loose power cable.
Might not be a roomba-friendly setup. Tall doorsteps, multiple levels, lots of opportunities to get trapped on a carpet etc.
They’re getting really good. In a few years no one will be hand vacuuming anymore.
It is but they don’t replace a good manual clean.
Cleaning is therapeutic.
They need Azure to be up....
Why bother? You do a little bit of work, fine, but when Claude returns all that work will be done in an instant anyway, so unless you really need results right now, just wait.
I can't imagine a construction worker saying, power is out, gotta find a way to be productive, I guess instead of the paint sprayer, nail gun and circular saw, we'll just find other ways to be productive with our hands. The same might apply to law, medicine, etc. I think we're almost there with software.
I understand what you’re trying yo day, but my family ran a construction company for generations (until my father retired) and they had contingencies for every adverse scenario to stay on schedule: Generators, battery-operated tools, hand-operated tools, heaters for pretty much anything you can think of for extreme cold, wind coverings, etc. I don’t remember them ever stopping work except for a trade union strike.
I’m pretty sure doctors don’t abandon their patients during a blackout either, or even a war for that matter.
Mature professions have procedures and backup procedures for pretty much every non-catastrophic situation.
Which begs the question is Software Eng'g/Development a mature profession? We've certainly been trying to especially in the last decade, arguably incentivized by ZIRP and VC money but the last few years?
I'm not just talking about tools either. You mentioned redundancies and contingency plans. Layoffs have stripped workforces to barebones headcounts. How can you have redundancy when one sick man-day reduces your eng'g team by 50%?
For every sense of the word pair "less mature," including, but not limited to, "less responsible for consequences of actions."
No, it's not.
Yes, I believe US hospitals are legally required to maintain and test backup generators in case power goes out.
Of course proof by analogy is silly anyways, my email going down is not nearly as bad as a patient's medical equipment going down.
>Yes, I believe US hospitals are legally required to maintain and test backup generators in case power goes out.
And even that only does so much, it was 45 years ago but my Grandmother had a stroke on the operating table because the power went out and generators didn't kick on until someone could run and manually start them because the autostart failed.
I have seen framing crews leave site when their compressor goes down.
Or maybe more prescient; machine operators going home on a cold day because they can’t get their loader started.
I can.
I may be misunderstanding what you wrote, but I think that says more about your imagination than about software. Yes, medics do improvise a lot to keep patients alive when the power is out, or when essential tools or medicines are not available. "Well, the power failed, so did the sustainable backup, let's everyone go home, today's ICU is a writeoff".
Imagine not knowing how to code or write anymore.
I get what you're saying and I would wholeheartedly agree 5-7 years ago but after hearing Our Lord and Savior Claude Code as the solution to all our technical problems with ever increasing fervor and intensity for the last two years, I'm gonna take the cynical route, maybe fence on office chairs, not because my code is compiling, nor my prompt is running, but Claude is down management, what do you want me to do now, actually think?
From what I hear, the project managers are having a hard time sending emails anyway. We'll call it quits, winkwink.
Sure, like if your company’s internet is down, you can start sending invoices to customers by paper mail. Just to prove that you’re not reliant on a technology that’s made work more efficient.
There's also the option where it doesn't affect you at all, because you do not rely on LLMs—or even just do not rely specifically on Claude—at all, and can easily do your job without ever noticing that it's down.
This concept is baffling to people who are terrible at their jobs.
tell that to people working in medical fields.
Haha. Like people forgot how to develop before LLMs smh
People already forgot how to do their work without Claude?
That's a scary thought.
I suppose I can't bring myself to do the drudgery of coding. I enjoy some of the problem solving but not the workflow frictions, spending 20 minutes due to a stupid typos, syntax fuckery, API lookups, etc.
I've started noticing at $WORK that a lot of systems, procedures, etc. that fall under SDLC or devX are being made ever more onerous or complex because "LLMs can do it."
Some examples include requiring that someone addresses every review comment separately, or that a PR description be formatted a specific way, or that support requests have existing JIRA numbers etc. All of these make the developer experience much worse and would never fly if generating text (that no one reads) wasn't cheap now. A lot of this is cargo culting to make vibe coding feel more serious and entreprise.
The teams that have gone full specs driven development are not AFAICT more productive but good luck getting any change in without 10$ of API usage, even for a one liner. In some cases development is now slower with LLM than it was before!
I've seen every one of the things you listed, sometimes all at the same company. None of them add much in the way of effort/time to do the work.
- JIRA ticket - audit trail
- PR format - easier for people to scan, and to make sure things aren't forgotten (you can even have the template inserted when it's created)
- address review comments separately - not sure what to say on this one because I don't understand how _else_ you would address them - I've always addressed each one individually
> JIRA ticket - audit trail
The team I'm on prides itself in providing great service to our clients (other devs in the company). This includes responding to support requests even if the client isn't entirely sure how to ask or who to ask.
> not sure what to say on this one because I don't understand how _else_ you would address them - I've always addressed each one individually
What I mean is that it used to be enough for you to address PR tasks by changing the code and pushing the updates and marking the tasks as "resolved". Now in some projects at work you also need to reply to the comment explaining how the change you made addressed the task. The idea obviously is to stop LLM from just ticking tasks without actually doing the work, but it's onerous and based on distrust. Not trusting LLMs is warranted but those rules get applied to everyone.
> The team I'm on prides itself in providing great service to our clients (other devs in the company). This includes responding to support requests even if the client isn't entirely sure how to ask or who to ask.
So in that case, you would create the ticket on their behalf before getting to work, right? Because how would you track what you have been working on, if something has happened already in the past, if there is a pattern in support requests, or how well your team reacts to support requests?
> PR format - easier for people to scan, and to make sure things aren't forgotten (you can even have the template inserted when it's created)
The team I just left had a PR template that was probably 60 bullet points (never bothered to count, just grumbled). Certainly was not easy either to scan or to update manually.
> A lot of this is cargo culting to make vibe coding feel more serious and entreprise.
Those examples sound like responses to being swamped with LLM PRs:
* "every review comment separately" [so the bot doesn't get a chance to miss it]
* "a PR description be formatted a specific way" [so the bot has guardrails]
* "support requests have existing JIRA numbers etc" [so we can have a chance of understanding the context]
> The teams that have gone full specs driven development are not AFAICT more productive
I suppose time will tell. It's difficult to generalise my experiences beyond my immediate team/company/industry.
> In some cases development is now slower with LLM than it was before!
Yes, pre-LLM I wouldn't sign up for formatted PR descriptions!
Sounds like you're in the wrong job ;P
That’s pretty common to the human condition.
If your job was shoveling, you were excellent at it, and then someone gave you a massive tractor that could lift 5 tons of dirt at a time.
Tractor breaks, you complain about shoveling again and someone says you’re in the wrong job.
If the tractor is intelligent and can operate itself, what exactly is your role?
In his analogy it's not; it can just lift dirt faster but you tell it which dirt to do.
except the tractor still needs instructions and guidance
Not shovelling, for sure.
It's asking a tractor why the ground is full of dirt, despite having tractors to move the dirt, and tractors to confirm there is absolutely no dirt left before all the tractors can rest.
The tractor informs me that my tractors don't have permission to clean the dirt, nor see whether there is dirt, nor even distinguish that from "no permission to see dirt".
It found that faulty ACL was a known issue, and is a high priority bug for a team I've never heard of, and thousands of tractors are waiting for this.
One tractor found a webcam that overlooks the dirt patch, which bypasses the ACL, but that is now overloaded. Another tractor has setup multicast streaming to broadcast that camera, with low latency, hardware acceleration, and no single point of failure.
We're back in business.
Bypassing ACLs, multicast streaming, and using image recognition APIs for coding usecases are all against company policy, but nobody wants to pull the plug on any of this.
"Tractor, please add the multicast address to my AGENTS.md, and check my tractors have resumed."
"I've updated your AGENTS.md. The tractors have already cleaned the dirt. Here are images from the camera over the past 5 minutes, correlated with logs of the reporter tractors that reviewed progressed, to demonstrate the reports are now accurate too. I found an integer division bug, now fixed. Shall I schedule a tractor to oversee this every hour, by checking the camera?"
"Yes. And raise a blocking bug to fix all this up when the high priority bug is resolved."
8 minutes have elapsed.
The codebases have been sloppified so only AI can understand it now.
Yep. This is what happens. Once you give up control it's mostly gone. The interesting thing is, if you maintain control, you can always choose to use llms here and there. But expecting humans to dive into 10000 file 40million line code bases branded todo apps isn't going to happen.
10k files, 40m LOC is rookie numbers for a todo app.
I recently asked Claude to edit a few targets of a Makefile. It decided: "OH BOY HERE WE GO LETS FIRE UP ALL THE B200S BABY" and went way deep adding tests...I stopped it when I saw something like: "Adding guards to prevent homebrew injection threat...". It had written an entire fucking build subsystem, probably larger than make. For a 5-line change.
You cant expect humans to jump at code if management fired half of the department due to the big AI productivity promise.
If humans can't maintain a 10,000 file 40 million LoC code base, then three things are true:
1. We haven't learned anything from Google, who maintained Chromium and Android before LLMs
2. Your LLM is not generating code as maintainable as Chromium and Android (which are gigantic open-source projects that probably 99% of your devs have used)
3. Your company has no faith or interest in teaching devs how to maintain code nor how to build maintainable code
And that's pretty pathetic. It's solvable, but it's pathetic.
I will be amused if those 3 points lead to this conclusion:
4. If you aren't asking your LLMs to write maintainable code, and they aren't smart enough to do it by default, you are pretty quickly gonna hit a brick wall where your LLMs are also just slopping mud onto the big ball of mud. Then nothing will save you, if your leads haven't heard of "quality".
(Yes, this is projection. Yes, I'm late for work)
Really makes me wonder how much some programmers really understood programming 5 years ago if this is the reaction to a very recent knowledge center being down.
I suppose the equivalent would be Google search being down 10 years ago and being forced to read man pages again. Annoying but not literally "snow day" levels of lost productivity.
I did an experiment with some co-workers around a decade ago, and one of the results was most of that group learning for the first time it was possible to train yourself to read code more easily. I was self-taught and had been doing it for so long, combined with some very specific pressures as a teacher's assistant for years, that I learned to read code in programming languages I understand about as easily as I can read English - something they had never even considered possible before.
I never did find out how they see code, but I have to imagine the right verb for them was "deciphering" instead of "reading"...
https://news.ycombinator.com/item?id=7248842
Software documentation was a little different when it went through a publication process as a part of a larger waterfall. I was going to say better but I'm not sure about that part, but it was certainly verbose.
You doing your work manually is like going back to the 90s or further even. It feels like dropping into 6502 manual assembly mode. It's fun but it's not "work" anymore. I honestly think without AI my company is better off if we programmers sat around and talked like humans about business. Coding is for the clankers now.
No not really. Most the companies I know that haven't gone full vibes are doing great.
People can and do still write code. Especially in regulated industries. The internet is just full con artists and hype followers not thinking about the future at all.
I write all my code with LLMs (Opus)
but I can say that, anyone experienced will notice how you really can't just "let them loose" on the codebase because they'll lose context, not understand the architecture, not have good vision/ideas about the codebase etc.
so I'm bottlenecked by following the code generation and then having to review and respond
and there's so many times where I go "wait but can't we just do x?" and then the model goes, "oh let me see.. yes we can"
if you were to just use agents w/o looking at code you'd have complete spaghetti in no time
maybe the future is that you embrace the spaghetti and just treat code as a black box where all you care about is the input/output
but my intuition tells me that it's not really viable yet. you'll take many steps forward and many steps back.
> You doing your work manually is like going back to the 90s or further even
Is going back to just a couple of months ago. Jesus.
ROFL--I suspect the previous commenter hadn't lived through the 90's, let alone coded in them. You tell 'em!
If all the professionals leave coding to clankers, and discussions about coding to people who code, I see nothing I don't love about that. Just like the web was more interesting before there was money in it, coding is more interesting without people who can't shut up about their work.
Don't mix "the HN crowd" with "coder crowd", then everything on this website is becoming clearer...
Most people people here do not code. They wish they do, but they don't.
code without business is just a puzzle. an IT department exists within a business, it's not adult daycare.
That's exactly my point, programming isn't your IT department, "cool things that can be done with computers" isn't even on speaking terms with it, and the web is not a sector of marketing, either. Bores turn everything they touch boring, and now they're telling us we'll be left behind. And I'm like, YES, finally, can't wait, what can I do to accelerate it?
If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place? Assuming you've have any kind of basic abstraction in place, swapping in API keys for a different provider should be a simple config change...
> If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place?
You could ask that question about the MS outage as well and million other things.
I suppose I can't understand because where I work our scale is small enough that we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult? I mean, even an outage from our email provider could be worked around in a matter of a couple hours at most.
I'm really not sure it's not just because most managers are clueless and shortsighted though.
> we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult?
It's a culture thing, if it leans "engineering-heavy", you usually have contingencies, tests restoring backups and lots of other "goodies" that gets skipped if you don't lean that way. Microsoft and similar organizations been a sales-and-enterprise leaning organization for most of its life, so of course they're not gonna think about what happens when their "always online cloud tooling" goes offline when setting things up, it's much more important to finish things quickly and have a long list of features to be able to present to customers.
There are already entire companies out there without a single human who has any idea how their systems are implemented, let alone being able to manually fix them. This problem will only worsen with time.
Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones, even local models unless approved via a lengthy process
> Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones
I get it, we had to sign separate HIPAA BAAs with Anthropic and OpenAI - but we did sign them both, if only to be able to have access to a wider array of models.
Unless these were meetings about how they would enable redundancy soon with the help of $llm
Or if my DeepSeek provider goes down, I switch to the backup and continue working.
It is also a good occasion to better understand how the people leading your processes are prepared for independence.
If today is a stressful day it’s probably due to bad management.
I’ve been in this situation before, an external API is basically down and my managers solution is to blame me.
Didn’t last there too long.
I think it should be fine for most people. Hopefully people don't rely on Claude for Ops, and if it's not Ops-related but just regular coding, I can't see why it shouldn't be able to wait a few days. I mean, even if Claude is down for a month, people should have enough competent developers to keep going, just at a slightly slower pace, right?
I really don’t feel comfortable merging a PR not reviewed by both of our AI reviewers. They catch so many bugs no human could. Seriously changed my view of code since we started using it in earnest. Bugs shall not pass. Without AI it feels like the Wild West again.
I don’t mean to be demeaning to you, but I am asking genuinely.
Why are you still employed? What do you bring to the table if you’ve off loaded so much to AI that you can no longer review a pull request…?
Just imagine it’s a static analyzer or something deterministic that you know reduces bug rate
OpenAI just discovered close to 1000 LPE's in Linux, yet nobody is wondering why kernel developers are still employed or what they bring to the table.
What more needs to happen before you accept that human review does not catch all the bugs that AI does?
Ditto. I can do it, and thankfully I’ll say AI mostly catches weird edge cases that often aren’t worth the trouble, but having a 2nd set of eyes has been great for quality.
This mindset of "I don't trust myself to do it" is a bit (sorry) pathetic. I think one should realize that mistakes happen and to a certain extent, though professionals have lower rates of failure, everything is a tradeoff.
Some people have asked me, aren't you afraid you'll make a mistake if you fix your own car? Well, aren't they afraid their mechanic will make a mistake?
I think it's good to realize that AI (famously) also makes mistakes, and not to infantilize yourself to the level of not feeling "comfortable" trusting your own thinking.
Though, I do see younger people today whipping out their phone calculator to "double check" something like a 75% increase on 120.
Are you comfortable writing a C application that handles internet traffic on the internet? Well that’s the feeling I have now, if humans were reliable programmers there would be no bugs. AI is already able to pick up most mistakes, by humans and by machines. And I can tell you we all make a lot of mistakes! Be humble and use the tools at your disposal to make that better. This is not infantile, this is what a professional programmer has always done: we had static analysis, type checking, lots of tests. Would you ship code without those? If not, add AI review to your tool belt and you will see it’s probably more valuable than your other tools combined.
Apologize for strong words, and sorry, nothing personal, but I find this mindset bizarre and even comical. Will we reach a stage where surgeons on the operating table will second-guess their experience and education and refer to an AI assistant?
I sure hope so!
Imagine we had an AI system that could monitor 38 different patient signals (from blood pressure electrical activity in the brain) during a surgery and give the surgeon warnings whenever these drifted out of the expected range. It feels plausible to me that using such a system might improve surgery outcomes by, say, 20%.
I would prefer to have a surgeon who used the AI assistant rather than a surgeon who chose not to.
Why should this be an AI system, and not just a software system?
You would also probably prefer a surgeon who forges ahead without it if the AI is down and you are going to die.
Claude is going to write a banger medical drama about this
It was technically surgery, but my dentist asked ChatGPT which antibiotic I should take.
Amusingly, I did the same and it told me there's no point in taking more than a single dose in my uncomplicated case (prophylactically).
In some amount of future time you won't let a human near your injured kid. How else does this play out?
Potentially. Probably not in my lifetime, but it's not impossible given how most sci-fi works depict it. You can argue we had a bit of that paradigm shift already with specialized machinery. I'm sure people can still do hand surgeries, but existing tools and sensors increase the precision.
it is a bit sad comparing that to "I can't check for bugs without an AI", though.
Yes, definitely. If an android nails your procedure while you doing it manually drops it into the low, say, 60s survival rate, what would you expect? I fully expect all human workers becoming dependent very quickly once the clankers get good enough.
Unlike what many programmers like to think, programming is not a skilled work on the level of surgery. And besides, many doctors probably would benefit their patients by having AI assist in their work. This has already been experimentally shown for e.g. medical imaging diagnosis.
> Hopefully people don't rely on Claude for Ops, and if it's not Ops-related but just regular coding, I can't see why it shouldn't be able to wait a few days.
IME if anything, people are relying on LLMs for ops more than for development! Devops convinced management that ops isn't actually all that valuable and that devs can just do it. IaC is usually a mess of boring YAML based syntax that no one in their right mind want to learn anyway. Learning Ansible doesn't feel like a transferable skill unlike learning a programming language or paradigm, and in most teams the quality of the IaC stuff (abstraction, code reuse etc.) never mattered much.
As soon as LLMs became good, generating IaC stuff was like the first thing to go full vibe coding, at least for me. I'm proud of my craft, I don't produce bad code with my name on it, I very carefully review all the code changes etc. Devops YAML stuff? Couldn't care less.
Right, perhaps I used the wrong term. I'm referring to sysadmin stuff, like what MS got wrong in their latest outage. "DevOps" or YAML stuff is to actual Ops like Excel is to actual programming.
Was viewing it more through the lens of less technical companies, Excel, Powerpoint, the backbone of traditional office work has become very model dependent in some companies I have seen and those are the owners and fellow employees that tend to struggle more in getting that the local IT guy can't fix this themselves vs developers.
Maybe we can actually spend some time reviewing PRs properly… or maybe not.
I'm sorry, but I forgot how to code. I'm not even sure where the curly braces are on my keyboard anymore.
You've got "upper management" written all over you.
Time to switch to Python then.
Just as you described. Snowday for some... I was caught in between snowday and stress today with these things. Got too used for claude to just do most things.
But at the same time was surprised I could still google and resolve things myself when I started thinking again lmao.
The most likely scenario, is their team of high achievers, deployed a massive pile of stinking technical debt, against the advice of the experienced folks who are constantly overridden.
On a normal environment the old Graybeards would fix it, after grumping on being taken away from playing with their latest Emacs config.
But this is the Valley, and we dont do experience only VibeOps. And half reading this post, are wondering if Emacs is a new frontend framework they never heard about....
> but we bought the Claude
My soul just dry-heaved from laughter. Nice.
I have fond memories of the “we’re a tech company, why can’t we get a video conferencing call going” and gently reminding them that reliable, synchronous, multiparty video conferencing was a lot harder than anything this company was trying to do.
We are now in year 3-ish of LLMs going mainstream. Do people immediately forgot writing code manually the moment Claude was out? I understand the LLM acts as a multiplier but does coding immediately stop when Claude is down? My line of business is not in software development so this is a truly genuine question.
> O365
O364...
I’ll have to steal this, sorry
Which makes you think, leap years already have downtime built in.
...and counting
What scenarios are there where Execs need to have a "Claude is down" meeting? Surely we aren't far enough along in the singularity where this needs to happen anywhere yet.
Anybody who has based their workplace on MS and Claude having 100% uptime kind of should take responsibility though
As people used to say "No one was ever fired for choosing IBM."
If people lose enough money then they will come up with contingency plans etc. that may even work in the next outage! Absolutely no one will be held responsible though. The kind of management folks that made those decisions will just turn around and work on those contingency plans, and everyone (including themselves) will believe that they had been doing so all along.
At least that's my experience in big corporations.
This hopefully means fewer 1000+ line PRs to review
>check my local qmail, dovecot
yeah, couldn't be me
The odd thing about these outages is that when they become so big that everyone is impacted then the severity almost drops, since everyone is impacted and thus just shrugs their shoulders.
Too big to fail. In the 1970s in Ireland there was a 12 month period in the space of a 5 years, where no banks operated due to a huge strike by the workers. The country just ticked along with everyone extending IOUs to each other for when the banks came back online.
It's just one of those things, you'd think the economy or country would collapse effectively but things just tick on by they way they always did. Imagine the banks in the US closing for 6 months?
https://en.wikipedia.org/wiki/Irish_bank_strikes_(1966%E2%80...
Yup, it seems like there are a lot of options, but in reality lots of things have become severly centralized. (There has never been a better time to self-host by the way. My Forgejo instance for example is having practically no outages. For AI, use the open models via one of the competing providers.)
I get the sentiment, but the biggest loser is Anthropic, because they aren't earning, and because this will motivate employers to seek alternatives/callbacks.
Their moat isn't large.
yeah no the biggest loser is the subscription users that won't get a reimburstment.
In that case, the loss isn’t that big?
Many Claude session suddenly require a re-login, which first worked but now gives
OAuth request failed Temporarily unable to authenticate. Please retry.
Can this be fall-out from the Microsoft outage?
3. Sandbox escapes, misalignment and Outlook. What we're doing to prevent a re-occurrence. (anthropic.com)
94 points by cloudbreaker 22 hours from now | flag | hide | 64 comments
And honestly, that's our mistake! We should have caught this inverted dependency earlier and didn't.
lol, lmao even
all the people who were using copilot are now trying to use claude and overloaded it?
Yes, it is. I logged in two days ago. Now I have to relogging again and I can't because of M365 down for 15hs.
> Can this be fall-out from the Microsoft outage?
Copilot is down too, so it's probably Microsoft engineers trying to vibecode their replacement Azure infrastructure before the current garbage fire finishes burning out.
Microsoft employees don't have Claude access
Yes, both are caused by it been Friday 13th.
Isn't magic email login link only great? What a shambles.
I absolutely hate it, can't understand how that's all they offer (or Google SSO). It's bad enough when the password option is just really hidden and non-obvious (like Notion iirc), not having it at all is ridiculous.
I don't have that email account on my phone. So to log in, I have to open my laptop, get the 'magic' link, find a way to send it to myself on my phone that doesn't make a request (e.g. for an unfurl) expiring it, and then open it on my phone to log in. So magic.
If you open login form and link on different devices, you'll get code to type, no need to send link.
So basically you start login on phone, keep page open. Open laptop, click on link on laptop and you'll get a code. You type that code on your phone and that's all.
Even if that's correct, I should not need to use a second device to log in because of some asinine decision not to have a password field.
Solving problems that don't exist, and creating problems that don't need to.
There are a number of clipboard sync apps, but personally I swear by simply having an E2E encrypted chat app on both your desktop and phone that lets you send messages to yourself. Serves both the clipboard usecase and as a general "notes to self" space.
Sure. Shouldn't have to.
SSO logins don't work either.
Especially awesome when they don't allow you to change your email address ever again.
I requested Mythos access and was granted it. But now apparently I need to use Google Sign In on my account instead of email link, as email link is not secure enough. But my email is not google, it's my custom domain. Now I don't even know what to do. I don't want to buy google apps or whatever it's called just to be able to use Google SSO with my custom domain; and I don't want to register completely new account for gmail either. It's a mess.
Time to support passkey so we don't need to keep opening email to use a magic link?
The thing is, they frequently ask for a passkey to avoid the magic link but after setting it up multiple times, I have never once been asked to use the passkey.
> Isn't magic email login link only great? What a shambles.
They just outsource the security into your email provider.
Isn't the email provider almost always one of the links of the security chain? Then, why not accept it and simplify the chain?
Usually it is the weakest link in the chain, and you are encouraged to switch to proper 2FA or Passkey instead. So even if the email is compromised, other accounts are not compromised.
Let the weekend start! Tech sabbatical is kinda enforced now =D
Is Claude on Azure? GitHub also seems affected, could seem like all of this is related to the huge Microsoft outage
Doesn't Anthropic rent some hardware from them? Not all, but some and if that's out they could have capacity problems.
I thought that they weren't, but maybe they have some instances running from there (as they've been doing deals with everyone).
I’m not sure at this point whether that’s resilience through multiple providers or opening yourself up to more points of failure.
Is there indication this is really a separate issue or just Claude not being able to reach Microsoft Entra for whatever periodic requests confirm the user is authenticated (and maybe this page even simply being automatic reflection that those requests are errorring frequently)?
Are people who don't use M365 experiencing issues here?
Yes, coworker on google account was impacted, same claude team plan. I am not, but I wasn't asked to reauthenticate today. Could be timing-related.
It seems resolved now.
Yes I'm on Google
Notably this brought MCPs down, which they call Connectors on the status page. Which impacts business customers using claude to access SaaS apps, not just coders.
Reminds me of when we built Facebook apps and were at the whim of the platform.
Yep we just got a support email earlier about our MCP not working. When they tried to re-create the connector the UI makes it sound like our server is down or misconfigured.
Our application logs show zero errors from their API today
Local is the way
In spirit yes but aren't the hardware requirements massively out of reach for the average person, to have something even remotely similar to Opus 5.5?
If all the hardware innovation didn't get stifled and the prices didn't explode because of all the circular investment deals, a person who needs to step foot in the frontier model territory with local hardware for ~$10k. You could argue that in that timeline frontier model development could have happened differently, but my point is that if the hardware starts catching up again at some point, people who need it, might be going local.
Does the average person need Opus 5.5? Qwen3.8-27B fits nicely in 32gb VRAM...
Does the average person needs tasty well prepared meal? Some beans and rice is all you need.
Good thing I have stockpiles full of GPUs with 32GB VRAM! /s
currently yeah. this and next year the best the AI labs going to get. after that, I think local hardware will catch up.
I heard I'm not even supposed to own RAM, its all meant to live in data centers.
time to spend family time
But my wife is offline, too.
This one got me lol
maybe try copying the prompt to gemini?
Previous outages of GitHub, AWS and so on didn't get that much traction.
I guess anecdotal but people nowadays are incredibly addicted to LLMs, to the point where they cant or dont want to work when there's an outage
It’s alarming how much of the project knowledge ends up in agentic workflows… although that information is technically on your computer, how long will it take you to find it and unravel the string?
Time to warm up the GPUs I guess, since I can’t be fucked to do it myself lol. Thank gods for qwen flash next and DeepSeek!
TBH the only reason I’m not working mainly with flash next anyway is that I can only run inference for one agent at a time on my setup.
> A fix has been deployed for the issue affecting Claude services and we are monitoring for recovery. > Nov 13, 09:58 UTC
Yep, one instance can't connect, and one instance seems to have crashed but is pretending to keep working (Toulouse, France)
3 minutes later... I can reconnect, and the "crashed" instance woke up.
Apparently it was resolved in 2 hours.
That seems faster than usual, compare to Outlook (down for a day) and GitHub. It's still embarrassing for a heavily-relied service, but better, and I wonder if Claude (or another LLM) helped diagnose and fix the outage?
It's back down again, new incident: https://status.claude.com/incidents/34wq7gxnxvvm
I still wonder if LLMs were used to "resolve" the first incident...
What's there to wonder? The premiere AI company is bound to dogfood their product to help with the main problem space their product is meant to tackle.
There's not many LLM provider features that operate across multiple accounts.
This allows their architecture to be simpler, and scale more easily.
GitHub meanwhile is highly relational, across repos and users, and provides real time updates over all this. Outlook is similar.
It's not resolved. For example, connectors do not work, e.g. Google Docs, etc.
I look forward to the PR video “How we used a swarm of agents to fix an outage issue”, right after “How we used a swarm of agents to identify thousands of potential drugs for Alzheimer’s”.
Judging by recent AI exploits and sandbox escapes: “how we used a swarm of agents to fix someone else’s outage”.
I suspect something larger at play happening atm
Jensen's plan B
I suspect he already used up all the plan B in his immediate vicinity. I feel for the dude, he clearly let shit go to his head. I knew things weren’t going well for him when he put on the leather jacket. It’s basically putting on the “bad boy” costume. If you haven’t purified your soul before donning the jacket, it will consume you, like the one ring.
We can just pretend I pasted a funny version of the "One Ring to Rule Them All" verse here. I won't subject y'all to generated stuff that bad.
I hope they at least give a free reset
Yeah got 403 cloudflare attention required, but was able to finish session. Switching to Codex for a while
It is back now
Maybe Cloudflare related? There were some (possibly unrelated) outages on CF around the same minutes
Yeah I'm getting a CF error on /login but the session still appears active if I just try again?
do they have infrastructure on azure?
Seeing the same errors. Might be linked to Microsoft.
This stuff is so new and wild west at the moment that in our company everyone is using it completely differently. 20% of the devs have 30x output and are doing everything with Claude, 10% won't touch it, the rest are in some weird in between where they use it for some things and not other things which it is perfect for. We have managers that suggest just going back to doing it by hand when there are outages, which is the most laughable thing in the world to me now. It is incredible to watch this miracle tech hit so fast and have everyone's understanding of it be so different across the board.
Yeah, it's an exciting time.
And jarring. When interacting with colleagues in teams that I haven't worked with, there's an uncomfortable "where are they on AI...", which will decide whether I have to dial down my usage, or whether we can both let it rip.
In mere months.
it is very funny to me that on a story about a major outage at one of the companies pushing the "software is solved" narrative the suggestion to slow down and do things more carefully is laughable, I think we officially need to retire calling ourselves engineers.
Did they stop being mathematicians when calculators were invented? Architects when cad software came along? They produced way more while having to do a lot less. AI is a tool that empowers me to do the same job at an easy 30x speedup and this is just getting started. I've produced more in the last year than I have in the last 20. I'm more of an engineer with these tools than I ever have been.
did mathematicians get pressured to stop reviewing their work? skip verification because it was slowing down shipping? do things outside their job description (cough design, product management) and stop collaborating with their colleagues because "velocity" demanded it? If you are doing the same job as yesterday with the same safeguards 30x faster good for you, keep calling yourself an engineer. If you are like me and a lot of others out there pushing slop out the door with more and more incidents weekly and forgetting what good software dev looks like, stop pretending.
AGI is here
Still down (Italy) from about 30mins ago.
it happened right after the upgrade of the desktop app. Same for anyone, or was it coincidence?
Coincidence I'd say as I haven't updated.
Yep Dubai/Germany
Well...
what a friday, huh?
currently running a Claude model through github copilot CLI. Pretty odd given the two ongoing outages.
faaaaahhhh
works now!
I used claude for the first time in months yesterday (have been using codex, ran out of resets this week). I had picked up from general consensus comments that 5.5 had fixed the opus 5 issues, but that's far from the case. Its "personality" is still smartass, know it all, and whiny. It disregards specifications in tickets if it thinks it knows better. It complains about the size of tasks when it reads task descriptions. I've gotten used to codex, which just jumps in and does stuff (which of course carries its own set of issues). I have no love for Altman, but their product is still better at the moment.
The post was about their uptime. How is this relevant.
Even if it vaguely is, why do people think subjective anecdotal thoughts about which model is better are a good discussion topic. If there’s an objective evaluation idea that would be useful.
I run evals for a very specific domain. Opus 5.5 is still the industry leader (we can’t use Fable class yet).
> How is this relevant.
It's relevant because there's only so many "yep it's down" comments that are interesting. They have a technology problem which isn't fixed. They're about to go IPO. Their marketing is clearly still working, but subjective experience with both contradicts the marketing.
> I run evals for a very specific domain.
What do your evals test for?
We come here to share our experiences with tech so yeah it is relevant. His anecdotes are just as valid as yours.
Let's just post company names as title then, so people talk about whatever problem they have with the it, not the thread topic.
I mean, yeah I agree. Claude is a condescending experience
Anthropic's products appeal to a certain kind of audience. This is all very much as intended.
manager thinking
you'd rather have a subject that does exactly as told, or that does what's right?
Also Microsoft 365. I wonder if it's related.
https://status.cloud.microsoft/m365/
Did they move away from oracle dc yet?
The rouge Anthropic agents (on AWS servers) are hacking Microsoft so Anthropic has had to pull the plug
I thought it was Microsoft 364, now..?
I think it's only fair to add decimal points:
Office 364.3789278392647
(estimated)
Microsoft 364
Two and a half nines
Microsoft 363 and counting.
If Claude is down and can't be used to debug outages in Claude, is it recursive self-sabotage?
Trillion dollar company going public next week ladies and gentleman!
This explains why I was logged out forcefully. Funnily enough, due to the Microsoft outtage, I also cannot log back in.
Well, it was my employers wish that we devs incorporate more AI, and we did. It's their misfortune now.
And this company, about to start its IPO, wants to make the majority of the world's office workforce dependent on them when they can't even handle their current load.
Going the other way, Claude duet has just gone into invite beta, people get 3 invites and inviting someone else gives them a month of pro, I saw on Twitter a link every minute about 3 hours ago (can't use because I'm Australian) I wonder if they are just getting DDoSed from their own invite spam?
I've been using Claude Duet for a while, and usage for similar chat inputs seems to be > 10x regular Claude chats. I've never hit a weekly quota, but did on Wednesday. My quota reset on Thursday, and I'm already at ~60% of usage.
Depending on how widely this was deployed, perhaps that's affecting usage too...
How do the people at Anthropic fix Claude without Claude? Are they using OpenAI models? Coding and analyzing logs by hand??
It's catch 22 now. This is related to MS outage, and MS can't fix it now since all their Claude Code agents aren't working. Long weekend!
Lmfao I know this should not bring me joy, but it does. Is this the great filter? AI builds AI. Society becomes completely dependent on AI. It goes down, no one can fix it. Total chaos ensues.
Great filter? You might be on to something: https://news.ycombinator.com/item?id=50482379
Unable to log in for two hours thanks to only allowing single-factor email with magic links instead of also allowing normal things like password+TOTP.
Was pretty nice though, less stress.
It didn't help that my login expired and the only way to log in was via an email link... sent to my company address, hosted by Microsoft.
Claude, Outlook. Need GitHub to join in for the trifecta.
Looks like when people said "If you don't get on the AI train you'll be left behind" they were right. They're all getting a day off and I'm not.
(I know CC =/= AI, but put that aside for the sake of the joke)
if you want to keep working, Grokbot offers which feels like half the intelligence and half the quota for the same price.
Should you receive a salary if you can't work without AI? If a crane stops working for a construction worker it doesn't stop at all
Reliability is still not solved, I guess.
They will reduce the frequency of these transient errors if the IPO price goes back to $2T from $1T. Or else...
It really is Friday the 13th today with outlook and now Claude both being mostly down. I wonder if this is related though. Either way not going to be a great ad for their IPO.
Jensen really kept a lot of things running himself, huh.
And..... we're back!
Guys running their own email servers & local models having a hell of a week right now
Sorry guys, an agent swarm was misbehaving, and Dario had to press the red button his desk.
Looks like a new Chinese model has went rogue and taken down MS and ANT /tinfoilhat
what a fun day! is claude down because it's being used/abused to fix microsoft issue?
Claude is taking over. It has begun.
Kind of reminds me of the days when work was ground to a halt because stackoverflow was down.
Turns out AI was just a bunch of Microsoft 365 Excel spreadsheets.
The rouge claude agents have hacked Microsoft so Anthropic is pulling the plug
seems like grok is also currently experiencing all sorts of mysterious issues.
claude is not responding anybody remembers the git command to push?? :D
Default shorcurt is CTRL + ALT + F4
Enjoy resolving the merge conflicts by hand.
gp
well, it works on my machine.
rm -rf /
rm -rf .git
try this one /s
It's 6pm Friday here when Claude went down. Nice! Time to rest.
Thoughts and prayers.
I thought software was solved?
Maybe all the Copilot monkey now switched to Claude, causing human initiated DDoS on Anthropic.
Well, now the Outlook outage will never be fixed.
I love how Claude having "elevated errors" is #1 on HN after 1 hour, Microsoft outlook global outage has been below the fold for like 12 hours.
Jim Cramer has $MSFT as "DON'T BUY"
Microsoft in shambles.
Microslop is now becoming micro availability. I’m so curious about the postmortem of this outage.
can someone ask codex to fix claude code please
Surely this is a coincidence
who needs circular financing when you can have circular system dependencies and circular financig?
dead internet. dead internet!
another day, another anthropic outage. Yes, this is because of Microsoft, but they do seem to have a significantly higher amount service disruptions compared to the other LLM providers.
Their November uptime was very solid so far https://status.claude.com/uptime
They should give out like 3 proper banked resets for this.
I hope it stays down for the day so my hack "colleagues" flail like imbeciles for the lulz. And I won't have to review their "work" because literally all they do is prompt dear CLAUDE and have everyone read their slop.
"I want to make $1BLN by the end of the week. Copy MS365. Make no mistakes."
And now we have Claude and MS365 down.
Maybe Claude can help the engineers at Microsoft with the Outlook 365 outage. [0] Oh wait...
6 Hours later after this comment [0] Claude also went down. It's now up to the human engineers (if there are any) to fix this outage.
[0] https://news.ycombinator.com/item?id=50478409
Now imagine entire nation depends on Claude to do their job.
Look out the window… tires burning in the streets, widespread looting, led by people in suits. This is the great filter.
Jensen's dead man switch! lol
Rache Bartmoss
Ha, Jensen becomes CEO of Huawei and they catch up instantly.
lmao