Skip to content

Run Apache Spark workloads 3.5 times faster with Amazon EMR 6.9

The Amazon EMR runtime for Apache Spark is a performance-optimized runtime for Apache Spark that is 100% API compatible with open-source Apache Spark. With Amazon EMR release 6.9.0, the EMR runtime for Apache Spark supports equivalent Spark version 3.3.0. With Amazon EMR 6.9.0, you can now run your Apache Spark 3.x applications faster and at lower cost without requiring any...
How to Lose Functional Programming at Work

Hi! If you’re looking to lose functional programming at work, here are a bunch of mistakes I’ve made on JS-heavy web teams over the years that can help you do the same. Enjoy! Note: if sarcasm and self-deprecation aren’t your thing, you can skip to the real-talk takeaways. PDF version Here is the much prettier PDF version that is also useful for sending to your teammates or using...
RT @datafying: Simpson’s Paradox and Interpreting Data

Arnon Rotem-Gal-Oz (@arnonrgo) retweeted:Simpson’s Paradox and Interpreting Data towardsdatascience.com/simpsons-parad…- datafying (@datafying)06:27 - Sep 25, 2022
Diff Models – A New Way to Edit Code

CarperAI is releasing a series of diff models—models trained to predict a code diff, trained on millions of commits scraped from GitHub. We are releasing 3 models of different sizes, all fine-tuned from Salesforce’s CodeGen code synthesis models: The dataset of diffs we scraped to train these models will be released separately in the near future. We hope these models will...
Rust Books Grouped by Level

Awesome Rust Books Rust Books Books Starter Books Welcome! This book will teach you about the Rust programming language. Rust is a systems programming language focused on three goals: safety, speed, and concurrency. It maintains these goals without having a garbage collector, making it a useful language for several use cases other languages aren’t good at: embedding in other languages, programs with...
RT @ClickHouseDB: Postgres is our favorite application database, but did you know you can also use it for analytics (without having to setu…

Arnon Rotem-Gal-Oz (@arnonrgo) retweeted:Postgres is our favorite application database, but did you know you can also use it for analytics (without having to setup a complicated ETL workflow)?We wrote a blog post on how you can use @supabase + @ClickHouseDB for extremely fast analytics queries:clickhouse.com/blog/migrating…- ClickHouse (@ClickHouseDB)11:36 - Jan 27, 2023

Tag: Architecture

Big data in the cloud – welcome to cost oriented design

Big data in the cloud – welcome to cost oriented design

Published by Arnon Rotem-Gal-Oz on April 1, 2016

A couple of weeks ago I presented @ BDX2016 The slides are available on Slideshare Big data in the cloud – welcome to cost oriented…

Continue reading

Data’s hierarchy of needs

Data’s hierarchy of needs

Published by Arnon Rotem-Gal-Oz on June 1, 2015

This post originally published in the AppsFlyer blog. A couple of weeks ago Nir Rubinshtein and I presented AppsFlyer’s data architecture in a meetup ofBig…

Continue reading

Services, Microservices, Nanoservices – oh my!

Services, Microservices, Nanoservices – oh my!

Published by Arnon Rotem-Gal-Oz on March 25, 2014

Apparently there’s this new distributed architecture thing called microservices out and about – so last week I went ahead and read Martin Fowler’s & James…

Continue reading

Fallacies of massively distributed computing

Published by Arnon Rotem-Gal-Oz on April 29, 2013

In the last few years, we see the advent of highly distributed systems. Systems that have clusters with lots of servers are no longer the…

Continue reading

The Saga pattern and that architecture vs. design thing

The Saga pattern and that architecture vs. design thing

Published by Arnon Rotem-Gal-Oz on January 24, 2013

It has been few months since SOA Patterns was published and so far the book sold somewhere between 2K-3K copies which I guess is not…

Continue reading