Functors to Monads: A Story of Shapes

For many years now I’ve been using a mental model and intuition that has guided me well for understanding and teaching and using functors, applicatives, monads, and other related Haskell abstractions, as well as for approaching learning new ones. Sometimes when teaching Haskell I talk about this concept and assume everyone already has heard it, but I realize that it’s...
Locking Mechanisms in High-Load Systems

In the world of concurrent systems, especially when we're dealing with high-load distributed environments, finding a balance between data consistency and system performance is a constant headache. The main catch here is synchronization mechanisms, especially locks. These guys ensure that processes don't step on each other's toes when sharing resources. In this blog post, let's break down what locks are,...
Functional programming in Go

submitted by /u/AlexandraLinnea [link] [comments]
OpenAI's new "Orion" model reportedly shows small gains over GPT-4

Language model development seems to have hit a ceiling. OpenAI's upcoming Orion model barely outperforms GPT-4, its predecessor, according to a new report. This slowdown affects the entire AI industry. The Information reports that OpenAI's next major language model, codenamed "Orion," delivers much smaller performance gains than expected. The quality improvement between GPT-4 and Orion is notably less significant than what...
Storage Disaggregated Databases and Shared Transaction Log Architecture In Comparison

There are two great papers published recently regarding database storage architecture:Understanding the Performance Implications of the Design Principles in Storage-Disaggregated Databases — Xi Pang et. al., Sigmod, June 2024 (I will call it the “LogDB” in this post, a term from the paper.)Taming Consensus in the Wild (with the Shared Log Abstraction) — M. Balakrishnan, ACM SIGOPS Operating Systems Review, August 2024 (I will call...
GenMC: Model checking for concurrent C programs

GenMC: A model checker for weak memory models Summary GenMC is an open-source state-of-the-art model checker for verifying concurrent C/C++ programs under the RC11, IMM, and LKMM memory models. GenMC is based on a stateless model checking algorithm that is parametric in the choice of memory model. Subject to a few basic conditions about the memory model, our algorithm is sound, complete and optimal, in that it...

Tag: yarn

Is there a future for Map/Reduce?

Published by Arnon Rotem-Gal-Oz on June 3, 2014

Google’s Jeffrey Dean and Sanjay Ghemawat filed the patent request and published the map/reduce paper 10 year ago (2004). According to WikiPedia Doug Cutting and Mike Cafarella created Hadoop,…

Hadoop YARN overview

Published by Arnon Rotem-Gal-Oz on May 27, 2014

I did a short overview of Hadoop YARN to our big data development team. The presentation covers the motivation for YARN, how it works and…

and with YARN the game changes

and with YARN the game changes

Published by Arnon Rotem-Gal-Oz on October 17, 2013

I’ve been working with Hadoop for a few years now and the platform and ecosystems has been advancing at an amazing pace with new features…