GFS: Evolution on Fast-forward - ACM Queue
June 15, 2019 | Palace Hotel, San Francisco ACM-IMS Interdisciplinary Summit on the Foundations of Data Science ACM and the Institute of Mathematical Statistics are bringing together speakers and panelists to address topics such as deep learning, reinforcement learning, fairness, ethics, and the fut...
This was a very interesting technical read on the design challenges behind a large scale distributed system. Covers an insane amount of consistency and scaling challenges.
“Perhaps an even more important issue here is that the engineers making this decision owned not just the file system but also the applications intended to run on the file system. According to Gobioff, "The thing is that we controlled both the horizontal and the vertical—the file system and the application. So we could be sure our applications would know what to expect from the file system. And we just decided to push some of the complexity out to the applications to let them deal with it."”Posted on 2019-06-09T01:40:52+0000