Skip to content

Functors to Monads: A Story of Shapes

For many years now I’ve been using a mental model and intuition that has guided me well for understanding and teaching and using functors, applicatives, monads, and other related Haskell abstractions, as well as for approaching learning new ones. Sometimes when teaching Haskell I talk about this concept and assume everyone already has heard it, but I realize that it’s...
Locking Mechanisms in High-Load Systems

In the world of concurrent systems, especially when we're dealing with high-load distributed environments, finding a balance between data consistency and system performance is a constant headache. The main catch here is synchronization mechanisms, especially locks. These guys ensure that processes don't step on each other's toes when sharing resources. In this blog post, let's break down what locks are,...
Functional programming in Go

submitted by /u/AlexandraLinnea [link] [comments]
OpenAI's new "Orion" model reportedly shows small gains over GPT-4

Language model development seems to have hit a ceiling. OpenAI's upcoming Orion model barely outperforms GPT-4, its predecessor, according to a new report. This slowdown affects the entire AI industry. The Information reports that OpenAI's next major language model, codenamed "Orion," delivers much smaller performance gains than expected. The quality improvement between GPT-4 and Orion is notably less significant than what...
Storage Disaggregated Databases and Shared Transaction Log Architecture In Comparison

There are two great papers published recently regarding database storage architecture:Understanding the Performance Implications of the Design Principles in Storage-Disaggregated Databases — Xi Pang et. al., Sigmod, June 2024 (I will call it the “LogDB” in this post, a term from the paper.)Taming Consensus in the Wild (with the Shared Log Abstraction) — M. Balakrishnan, ACM SIGOPS Operating Systems Review, August 2024 (I will call...
GenMC: Model checking for concurrent C programs

GenMC: A model checker for weak memory models Summary GenMC is an open-source state-of-the-art model checker for verifying concurrent C/C++ programs under the RC11, IMM, and LKMM memory models. GenMC is based on a stateless model checking algorithm that is parametric in the choice of memory model. Subject to a few basic conditions about the memory model, our algorithm is sound, complete and optimal, in that it...

Tag: Hadoop

Intro to Apache Spark (slides)

Intro to Apache Spark (slides)

Published by Arnon Rotem-Gal-Oz on December 16, 2020

I gave a general overview of Apache Spark to our R&D teams. You can find the slides below

Big data isn’t – well, almost

Big data isn’t – well, almost

Published by Arnon Rotem-Gal-Oz on March 23, 2019

Back in ancient history (2004) Google’s Jeff Dean & Sanjay Ghemawat presented their innovative idea for dealing with huge data sets – a novel idea…

Continue reading

Hadoop and the OpenDataPlatform

Hadoop and the OpenDataPlatform

Published by Arnon Rotem-Gal-Oz on February 17, 2015

Pivotal, IBM and Hortonworks announced today the “Open Data Platform” (ODP) – an attempt to standardize Hadoop. This move seems to be backed up by…

Continue reading

Random thoughts on big data

Random thoughts on big data

Published by Arnon Rotem-Gal-Oz on February 10, 2015

I began blogging in 2005, back then I managed to post something new almost everyday. Now, 10 years after, I hardly post anything. I was…

Continue reading

Apache Spark, ETL and Parquet

Apache Spark, ETL and Parquet

Published by Arnon Rotem-Gal-Oz on September 14, 2014

(Edit 10/8/2015 : A lot has changed in the last few months – you may want to check out my new post on Spark, Parquet…

Continue reading