GPUs Go Brrr
how make gpu fast?
Hasnain says:
“From a philosophical point of view, we think a frame shift is in order. A “register” certainly shouldn’t be a 32-bit word like on the CPUs of old. And a 1024-bit wide vector register, as CUDA uses, is certainly a step in the right direction. But to us a “register” is a 16x16 tile of data. We think AI wants this -- after all this time, it’s still just matrix multiplies, reductions, and reshapes. And we think the hardware wants this, too -- small matrix multiplies are just begging for hardware support beyond just the systolic mma.
In fact, more broadly we believe we should really reorient our ideas of AI around what maps well onto the hardware. How big should a recurrent state be? As big can fit onto an SM. How dense should the compute be? No less so than what the hardware demands. An important future direction of this work for us is to use our learnings about the hardware to help us design the AI to match.”
Posted on 2024-05-13T00:52:26+0000
Biden Administration Probe Of Israeli Conduct In Gaza Says Military Aid Can Continue
The president's report "ignores the big question" of whether the U.S. government thinks Israel has violated international humanitarian law, a U.S. official told HuffPost.
Hasnain says:
“Senator Chris Van Hollen on the Blinken-Netanyahu report: ""If this conduct complies with international standards, God help us all".”
Posted on 2024-05-11T06:04:13+0000
Yiddish Anarchists' Break Over Palestine
An exchange in the anarchist newspaper Di fraye arbeter shtime after the 1929 Hebron massacre offers a case study in Jewish discourse and political reaction after immense violence.
Hasnain says:
Powerful words written by anti-Zionist Jews - all the way back in 1929. How prescient and relevant to the modern day, sadly.
“The Zionist devil, with its criminal, irresponsible demagogic agitation, has convinced the “helpless” Jews, the naïve masses, that it will return them to their national home under the protection of the expansive, powerful wings of that great biblical people, the English. The gullible, naïve masses took this at face value and set upon the conquest of Palestine’s land with cries of “Hurrah!” under the British flag and assisted by English battalions. This pitiful people, agitated by Zionist demagoguery, was not content with just conquering the land, with just becoming the owners of the land, but they also joyfully began a new campaign: the conquest of labor[5] with the slogan “Swój do swego,”[6] under which they themselves suffered in their land of Poland and condemned as an injustice.
It was not enough simply to steal the Arab’s land; we needed to then drive him from his land! Jews wanted to consolidate all rights for themselves. When it looked like a certain right would fall into the hands of the Arabs and do them good, the Zionists began an outcry: “The Philistines are upon you, Israel!” The goal is to turn the Arab into a disenfranchised, degraded creature which should never stop shaking in fear at the thought of the Jewish landowner.”
Posted on 2024-05-11T06:00:16+0000
Google Cloud accidentally deletes UniSuper’s online account due to ‘unprecedented misconfiguration’
Super fund boss and Google Cloud global CEO issue joint statement apologising for ‘extremely frustrating and disappointing’ outage
Hasnain says:
This is insane.
“They said the outage was caused by a misconfiguration that resulted in UniSuper’s cloud account being deleted, something that had never happened to Google Cloud before.
“Google Cloud CEO, Thomas Kurian has confirmed that the disruption arose from an unprecedented sequence of events whereby an inadvertent misconfiguration during provisioning of UniSuper’s Private Cloud services ultimately resulted in the deletion of UniSuper’s Private Cloud subscription,” the pair said.”
Posted on 2024-05-10T19:33:32+0000
Lessons from building an automated SDK pipeline
During Developer Week 2024, we announced the revamped SDKs that are automatically generated using our OpenAPI schemas. Today, we’re taking a deeper look at how the pipeline works and share lessons we’ve learned along the way.
Hasnain says:
“Depending on the age of your APIs, you will have a diverging history of how they are represented to customers. That may be as simple as path parameters being inconsistent or perhaps something more complex like different HTTP methods for updates. While you can handle these individually at any sort of scale, that just isn’t feasible. As of this post, Cloudflare offers roughly 1,300 publicly documented endpoints, and we needed a more automatable solution. For us, that was codemods. Codemods are a way of applying transformations to perform large scale refactoring of your codebase. This allows you to programmatically rewrite expressions, syntax or other parts of your code without having to manually go through every file. Think of it like find and replace, but on steroids and with more context of the underlying language constructs.”
Posted on 2024-05-08T05:18:36+0000
Onslaught of violence against women and children in Gaza unacceptable: UN experts
GENEVA (6 May 2024) – UN experts* today condemned the continued and systematic onslaught of violence committed against Palestinians in Gaza, with most victims being women and children over the past seven months.“We are horrified at details emerging from mass graves recently unearthed in the Gaza...
Hasnain says:
““Israel must cease all hostilities and States must end the export of all weapons immediately. These States can no longer ignore the fact that the weapons are being used to kill and maim innocent women and children. There can be no more excuses,” the experts said. “Women and children are entitled to special protection under international humanitarian law and human rights law”.”
Posted on 2024-05-07T05:02:00+0000
EXCLUSIVE: “You Have Been Warned”: Republican Senators Threaten the ICC Prosecutor over Possible Israel Arrest Warrants
Read the full letter, obtained by Zeteo, which threatens sanctions in defense of Netanyahu.
Hasnain says:
This is mob like behavior.
““Target Israel and we will target you,” the senators tell Khan, adding that they will “sanction your employees and associates, and bar you and your families from the United States.”
Rather ominously, the letter concludes: “You have been warned.””
Posted on 2024-05-06T14:45:31+0000
Senior UN official says northern Gaza is now in 'full-blown famine'
Cindy McCain, the American director of the U.N. World Food Program, became the most prominent official so far to declare that trapped civilians in northern Gaza had gone over the brink into famine.
Hasnain says:
“Acute malnutrition rates there among children under 5 have surged from 1% before the war to 30% five months later, the USAID official said. The official called it the fastest such climb in hunger in recent history, more than in grave conflicts and food shortages in Somalia or South Sudan.
One of the few medical facilities still operating in northern Gaza, Kamal Adwan hospital, is besieged by parents bringing in thousands of children with malnutrition for treatment, the official said. Aid officials believe many more starving children remain unseen and in need, with families unable to bring them through fighting and checkpoints for care.”
Posted on 2024-05-05T23:06:54+0000
Judge mulls sanctions over Google’s “shocking” destruction of internal chats
Punishing Google for being the best would be “unprecedented,” lawyer argued.
Hasnain says:
Google argues this was a standard policy and wasn’t malicious, which is kinda hilarious given the below HN comment (and the fact that they were ordered to change this default by the court and just… didn’t).
“We have evidence that Google execs instructed their relations to turn off chat specifically to avoid future discovery [1]. Excerpt from this document :
> In one Chat, Mr. Pichai began discussing a substantive topic, and then immediately wrote: “also can we change the setting of this group to history off.”1 Then, nine seconds later, Mr. Pichai apparently attempted (unsuccessfully) to delete this incriminating message.”
“>All this time, Google falsely told the United States that Google had "put a legal hold in place" that "suspends auto-deletion." Indeed, during the United States' investigation and the discovery phase of this litigation, Google repeatedly misrepresented its document preservation policies, which conveyed the false impression that the company was preserving all custodial chats. Not only did Google unequivocally assert during the investigation that its legal hold suspended auto-deletion, but Google continually failed to disclose—both to the United States and to the Court—its 24-hour auto-deletion policy. Instead, at every turn, Google reaffirmed that it was preserving and searching all potentially relevant written communications.”
Posted on 2024-05-05T14:43:07+0000
CNN's Disgraceful Propaganda
This segment from Dana Bash on the Palestine protest movement is one of the most shameful things I have ever seen on cable news.
Hasnain says:
“Perhaps the most important thing about this segment, though, is that it exists at all—that it was deemed acceptable for Bash to air something so clearly biased and incendiary about such a sensitive topic. CNN executives would have lost their minds if Bash compared pro-Israel protesters to Nazi sympathizers, or even if she used disputed terms like “apartheid” or “genocide” to describe Israel’s behavior. But this kind of unhinged screed against the pro-Palestinian movement is apparently just fine. People supporting Palestine get to be written off as violent, Nazi-like extremists without a second thought, and CNN viewers tuning in for a supposedly fact-based look at the world get told that this is objective reality.
It’s just shameful. It’s so, so, so shameful. Bash and CNN disgraced themselves with this segment. The one good thing to come from this is that we know exactly who they are now.”
Posted on 2024-05-03T02:41:25+0000