Conversation

IT'S HAPPENING

GITHUB, THE FIRST ENTERPRISE CLOUD SOLUTION TO REACH ZERO NINES RELIABILITY

https://mrshu.github.io/github-statuses/

10
20
4

I am going to once again clarify that a) this is an independent third party tracker b) it tracks ten subsystems and overlays all incidents on one timeline to arrive at the sub-90% overall reliability; it does not mean that the github site is just completely dead 10% of the time.

2
0
1

@0xabad1dea

There are two nines in their uptime number!

No one said they had to be leading digits…

0
0
0

@0xabad1dea sure, if you're going to be a stick in the mud and only count nines at the start of the number.

If you get rid of that restriction, they've still got two nines.

0
0
1

@0xabad1dea i see two nines here, we can do better microsoft

67%!!!!

0
0
1

I am in a hell entirely of my own making; a hell where I get the reply “but there are still two nines in that number,” forever

2
0
0

@0xabad1dea I love that I am reading this while waiting for GitHub to fix their API throwing HTTP 503 errors :)

2
0
0

@0xabad1dea Also, I note, an issue that never made it to their status page!

1
0
0

@mini yeah, the official status page is *comically* conservative because of misaligned incentives.

0
0
0

@0xabad1dea Paraphrasing Queeg, "it's got a nine in it".
I've worked for enough companies that I've seen teams who couldn't even manage nine fives.

0
0
0
What do you mean? I see two nines right there in the middle.
0
0
0

I'll assume the half of these that I can't actually read because they use the "only visible to people logged in to bluesky" toggle are all, to the last, the same "two nines" reply 😂

1
0
0

@0xabad1dea numbers are not my forte. I'll admit I'm an idiot. what in the name of crimes against statistics is going on here?

1
0
0

@Netraven

- major web service providers generally sign agreements with their largest customers to provide "five nines" of uptime: 99.999%.

- Github, one of the most important pieces of infrastructure for computer programming in general, has been getting increasingly unstable over the last several months.

- Github's own official downtime tracker is extremely, uh, conservative, because the more they officially acknowledge as downtime, the more trouble they're in with major customers. But even by their rosiest estimates, they've lost several nines

- This third party tracker concludes that Github has dropped below 90%, that is to say, to zero nines, for the last 90 days. Note that this is counting any big observable problem as downtime, even if the entire site isn't completely dead.

0
1
0

@mini @0xabad1dea the silliest github error we have enraccountered was when we were trying to raccall some API methods to figure out what raccommit is the latest ones and it would time out sometimes (not a big repo!) and that timeout would get raccached!

0
0
0

@0xabad1dea I mentioned this development to my partner, and quickly afterwards said "don't say there's two nines in that number"

they said "of course, I know how nines work. I'm just glad $WORK hosts our own stuff."

I love them so much

0
0
0

@0xabad1dea they're working toward 5 nines - 9.9999% uptime

0
0
0

@misty no one’s been unhinged at me at least, I’ve just gotten the same joke reply dozens of times

0
0
0