Cirrus Minor - Page 3 of 19 - The nexus of technology, business & people

Skip to content

GitHub Models API now available

You can now use the GitHub Models REST API to programmatically explore and run inference with models hosted on GitHub. This includes: GET /catalog/models — List all available models, including publisher, modality support, and rate limits. POST /inference/chat/completions — Run a chat completion using any supported model. POST /orgs/{org}/inference/chat/completions — Attribute inference requests to a GitHub organization. These endpoints support streaming and non-streaming completions,...
Show HN: KVSplit – Run 2-3x longer contexts on Apple Silicon

Run larger context windows and heavier LLMs on your Mac by applying different quantization precision to keys vs values in the attention mechanism's KV cache. KVSplit enables you to: Reduce memory usage by up to 72% with minimal quality loss Run 2-3x longer contexts in the same memory budget Maintain or improve inference speed compared to FP16 Optimize for Apple Silicon with full Metal...
Introducing Strands Agents, an Open Source AI Agents SDK

Today I am happy to announce we are releasing Strands Agents. Strands Agents is an open source SDK that takes a model-driven approach to building and running AI agents in just a few lines of code. Strands scales from simple to complex agent use cases, and from local development to deployment in production. Multiple teams at AWS already use Strands...
The first year of free-threaded Python

Last week, the CPython developers rolled out CPython 3.14.0b1. This week, PyCon 2025 kicks off in Pittsburgh, PA. Both events mark a significant milestone for the effort to ship and stabilize free-threaded Python. This is the story of the first year of that effort and how our team at Quansight played a key role in enabling experimental use of the free-threaded build with real production...
Takeaways from Coding with AI

I thought I’d offer a few takeaways and reflections based on last week’s first AI Codecon virtual conference, Coding with AI: The End of Software Development as We Know It. I’m also going to include a few short video excerpts from the event. If you registered for Coding with AI or if you’re an existing O’Reilly subscriber, you can watch...
Open-sourcing Pyrefly: A faster Python type checker written in Rust

Back in 2017, engineers at Meta sought to create a type checker for Instagram’s typed Python codebase. Years later, as the type system continued to evolve, that type checker eventually became Pyrefly. Pyrefly is a new type checker and IDE experience for Python, written with Rust, and now available for the entire Python community to use! It’s open-source, supports both CLI...

A year of almost blogging

A year of almost blogging

Published by Arnon Rotem-Gal-Oz on December 28, 2018

2019 is around the corner and I am looking at how many blog posts I wrote this year and the number is a resounding zero.…

Continue reading

Services and Aspects -when everyone is super no-one is

Services and Aspects -when everyone is super no-one is

Published by Arnon Rotem-Gal-Oz on March 7, 2017

For me, one of the telltale signs the whole microservices hoopla is a consultant marketing ploy is the whole microservices vs. monoliths thing – as…

Continue reading

Microservices – it’s déjà vu all over again

Published by Arnon Rotem-Gal-Oz on December 19, 2016

I gave this presentation today @ SWSte 2016. Slides are available on slideshare: Microservices past and future – it's déjà vu all over again from…

Continue reading

Big data in the cloud – welcome to cost oriented design

Big data in the cloud – welcome to cost oriented design

Published by Arnon Rotem-Gal-Oz on April 1, 2016

A couple of weeks ago I presented @ BDX2016 The slides are available on Slideshare Big data in the cloud – welcome to cost oriented…

Continue reading

Don’t let your architecture become the new hardware

Don’t let your architecture become the new hardware

Published by Arnon Rotem-Gal-Oz on March 14, 2016

Yesterday I presented “Big data in the cloud – Welcome to cost oriented design” @ BDX2016 (slides are available here, and I think the video…

Continue reading