Why Meta’s latest large language model survived only three days online
Galactica was supposed to help scientists. Instead, it mindlessly spat out biased and incorrect nonsense.
Hasnain says:
“And it wasn’t just the fault of Meta’s marketing team. Yann LeCun, a Turing Award winner and Meta’s chief scientist, defended Galactica to the end. On the day the model was released, LeCun tweeted: “Type a text and Galactica will generate a paper with relevant references, formulas, and everything.” Three days later, he tweeted: “Galactica demo is off line for now. It’s no longer possible to have some fun by casually misusing it. Happy?”
It's not quite Meta's Tay moment. Recall that in 2016, Microsoft launched a chatbot called Tay on Twitter—then shut it down 16 hours later when Twitter users turned it into a racist, homophobic sexbot. But Meta’s handling of Galactica smacks of the same naivete.
“Big tech companies keep doing this—and mark my words, they will not stop—because they can,” says Shah. “And they feel like they must—otherwise someone else might. They think that this is the future of information access, even if nobody asked for that future.””
Posted on 2022-11-19T22:39:03+0000
Former Anti-Abortion Leader Alleges Another Supreme Court Breach
Years before the leaked draft opinion overturning Roe v. Wade, a landmark contraception ruling was disclosed, according to a minister who led a secretive effort to influence justices.
Hasnain says:
So. Much. Corruption. Alito likes to complain when people call the court illegitimate, but he’s one of the main people that made it so!
“The ruling this year thrilled anti-abortion supporters, though it has proved deeply unpopular among the majority of Americans. After the draft was leaked, Mr. Schenck said, he felt compelled to come forward about his attempts to influence the court.
“You can position yourself in a special category with regard to the Justices,” he said. “You can gain access, have conversations, share prayer.”
Even when his group was most active at the court, he said, “I would look up at that phrase that’s chiseled into the building itself, ‘Equal Justice Under Law,’” he recalled. “I would think, ‘Not really.’””
Posted on 2022-11-19T15:38:01+0000
Hundreds of employees say no to being part of Elon Musk’s ‘extremely hardcore’ Twitter
“It will be extremely hard for Twitter to recover from here”
Hasnain says:
lol.
“Multiple “critical” teams inside Twitter have now either completely or near-completely resigned, said other employees who requested anonymity to speak without Musk’s permission. That includes Twitter’s traffic and front end teams that route engineering requests to the correct backend services. The team that maintains Twitter’s core system libraries that every engineer at the company uses is also gone. “You cannot run Twitter without this team,” a departing employee said.
Several members of Twitter’s “Command Center” team, a group of engineers that is on call 24/7 and acts as the clearing house for problems internally, also tweeted about their departures. “If they go down, there is no one to call when shit breaks,” said a person familiar with how the team operates. The team that manages Twitter API for developers has also been severely gutted.
In a tweet Thursday evening, Musk said: “The best people are staying, so I’m not super worried.””
Posted on 2022-11-18T05:43:59+0000
Alex Heath on Twitter
“Word inside Twitter is that A LOT of employees are not saying “yes” to staying at Musk’s “extremely hardcore Twitter 2.0.” He has been meeting today with engineers to convince them to stay. His deadline to decide to stay or leave expired 6 min ago. https://t.co/IErjQTMRE6”
Hasnain says:
I hate sharing a twitter link but this is too funny to not share: most people called Elon’s bluff and are now quitting - and he’s begging people to stay: https://twitter.com/alexeheath/status/1593365103331577856?s=46&t=wrqExQQ5qhV_VfOsEVeM-g
And future update (will link in comments) - they’ve closed offices and locked people out, presumably fearing sabotage
Posted on 2022-11-18T00:10:59+0000
Pakistan's lost city of 40,000 people
In the dusty plains of present-day Sindh in southern Pakistan lie the remains of one of the world's most impressive ancient cities that most people have never heard of.
Hasnain says:
"Archaeologists first came across the ancient city in 1911 after hearing reports of some brickwork in the area. However, the Archaeological Survey of India (ASI) dismissed the bricks as not having any kind of antiquity and the site remained undisturbed for several more years. It wasn't until 1922 that R D Banerji, an ASI officer, believed he saw a buried stupa, a mound-like structure where Buddhists typically meditate. This led to large-scale excavations – most notably by British archaeologist Sir John Marshall – and the eventual naming of Mohenjo-daro as a Unesco World Heritage Site in 1980. The remains they uncovered revealed a level of urbanisation not previously seen in history, with Unesco lauding Mohenjo-daro as the "best preserved" ruin of the Indus Valley.
Perhaps the city's most surprising feature was a sanitation system that was far beyond its contemporaries. While drainage and private toilets were seen in Egypt and Mesopotamia, they were luxuries of the rich. In Mohenjo-daro, concealed toilets and covered drains were everywhere. Since excavations began, more than 700 wells have been recovered, in addition to a system of private baths, including a 12m x 7m "Great Bath" for communal use. Incredibly, toilets were found in many private residences, and waste was covertly disposed of through a sophisticated, city-wide sewage system."
Posted on 2022-11-16T05:27:13+0000
Sapling: Source control that’s user-friendly and scalable
Meta has open sourced Sapling, a new, Git-compatible source control client that scales to the largest repositories in the world.
Hasnain says:
I am so so excited by this that words are failing me (yes, this is not a common statement).
Using git for side projects has honestly sucked after the great experiences I've had with sapling and I'm glad to see I can use it again. Can't wait to set it up now for my private repos; and ... my mind is blown that there's an accompanying review UI too that's optimized for stacks.
stacked diffs, `hg ssl`, `hg commit`, `hg absorb`, and `hg histedit`, how I missed thee.
"I hope you find Sapling as pleasant to use as we do, and that Sapling might start a conversation about the current state of source control and how we can all hold the bar higher for the source control of tomorrow.See the Getting Started page to try Sapling today."
Posted on 2022-11-15T21:46:36+0000
This flu season is looking really scary, in one chart
This season’s flu numbers are 12 times higher than before the pandemic.
Hasnain says:
"Additionally, more than five times as many people have been hospitalized for the flu so far this season than at the same point in any of the last 10 years. And unlike RSV, which poses the biggest threat to the youngest and oldest, the severe disease flu causes is more evenly spread across age groups. About one-third of the people who’ve been hospitalized for flu this year were 65 or older, while another quarter were ages 18 to 49."
Posted on 2022-11-15T05:07:44+0000
Performance Optimizations Can Have Unexpectedly Large Effects When Combined With Caches
Performance Optimizations Can Have Unexpectedly Large Effects When Combined With Caches This post is about a non-obvious interaction between performance optimizations and LRU/time limited caching. In 2017, I was working a major performance issue. We were onboarding a large customer, and a batch proc...
Hasnain says:
"It's common wisdom that systems with caches can fail badly when the caches are cold. When every request misses the cache, the system is overloaded, and never recovers. What I observed was the mirror image."
Posted on 2022-11-15T04:47:16+0000
Musk Publicly Punishes Twitter Engineers Who Call Him Out Online
Twitter Inc. owner Elon Musk, who has called himself a “free speech absolutist,” has resorted to firing company engineers who publicly criticize him on the social-media service.
Hasnain says:
My list of funny Elon related drama stories is so long it’s hard to pick what to share. This one takes the cake though - so much for free speech.
Currently tied with how he’s turning off 80% of micro services soon. 2FA already broke, locking people out.
Posted on 2022-11-15T01:41:34+0000
Elixir, OpenTelemetry, and the Infamous N+1
Using OpenTelemetry with Grafana to debug performance issues in Phoenix LiveView and Elixir.
Hasnain says:
Great read.
“To recap, we learned about the various pillars of observability and took a deep dive into the tracing pillar. We learned about setting up an Elixir application with the OpenTelemetry tooling and even deployed our application along with some supporting monitoring tools to Fly.io. We then compared trace results between two different LiveView pages and were able to see the effects that an N+1 query would have on our application's performance.”
Posted on 2022-11-15T01:12:26+0000