ClickHouse Vs DuckDB

Introduction The rise of OLAP databases has been hard to ignore, with the relentless growth of data and demand for powerful, fast analytics tools. OLTP databases have been invaluable for transaction-heavy applications but often fall short when faced with the sheer complexity of modern analytical workloads. Enter OLAP databases, designed to make slicing through massive datasets feel nearly effortless. In exploring OLAP...
Latency and System Design

submitted by /u/Martynoas [link] [comments]
OrioleDB beta7: Benchmarks

OrioleDB is a storage extension for PostgreSQL which uses PostgreSQL's pluggable storage system. Designed as a drop-in replacement for PostgreSQL's existing Heap storage, OrioleDB aims to overcome scalability bottlenecks and fully utilize modern hardware capabilities. By integrating seamlessly with PostgreSQL, it offers improved performance, efficiency, and scalability without sacrificing the robustness and reliability that PostgreSQL is known for. Today we’re releasing...
Show HN: SeekStorm – open-source sub-millisecond search in Rust

SeekStorm is an open-source, sub-millisecond full-text search library & multi-tenancy server implemented in Rust. Development started in 2015, in production since 2020, Rust port in 2023, open sourced in 2024, work in progress.
SeekStorm is open source licensed under under the Apache License 2.0 Blog Posts:
SeekStorm is now Open Source and
SeekStorm gets Faceted search, Geo proximity search, Result sorting
SeekStorm high-performance search...
What happens if we remove 50 percent of Llama?

Author(s) Eldar Kurtić Senior Machine Learning Research Engineer Alexandre Marques Manager of Machine Learning Research Mark Kurtz CTO, Neural Magic Dan Alistarh Principal Research Scientist Shubhra Pandit Senior Machine Learning Researcher A Sparse Summary Sparse Foundation Model: The first sparse, highly accurate foundation model built on top of Meta’s Llama 3.1 8B with 98% recovery on Open LLM Leaderboard v1 and full recovery across fine-tuning tasks, including math, coding, and chat. Hardware-Accelerated...
Show HN: Vicinity – Fast, Lightweight Nearest Neighbors with Flexible Back Ends

Vicinity: Lightweight Nearest Neighbors Vicinity is a light-weight, low-dependency vector store. It provides a simple and intuitive interface for nearest neighbor search, with support for different backends and evaluation. There are many nearest neighbors packages and methods out there. However, we found it difficult to compare them. Every package has its own interface, quirks, and limitations, and learning a new package can...

Tag: map/reduce

Is there a future for Map/Reduce?

Published by Arnon Rotem-Gal-Oz on June 3, 2014

Google’s Jeffrey Dean and Sanjay Ghemawat filed the patent request and published the map/reduce paper 10 year ago (2004). According to WikiPedia Doug Cutting and Mike Cafarella created Hadoop,…

Develop Map/Reduce with reduced assumptions

Develop Map/Reduce with reduced assumptions

Published by Arnon Rotem-Gal-Oz on April 16, 2012

It all started with this odd bug… One of our teams is writing a service, that among other things, runs map/reduce jobs built as pig…