Arcee Mergekit Our Commitment To Open Source

Arcee AI | Arcee AI + mergekit: our commitment to open source

Trinity Large Thinking: Available on OpenRouter.

Try now ↗

ENTERPRISE

Research

COMPANY

Get API

Blog / Arcee AI + mergekit: our commitment to open source

Arcee AI + mergekit: our commitment to open source Mary MacCarthy ,

•

March 6, 2024

On Day 3 of March Merge Madness we're striking a bit of a serious note, with a discussion about our very serious commitment to the open source community.

When Arcee merged with mergekit last month, we promised to uphold mergekit Founder Charles Goddard ’s commitment to keeping the repo open source. When Goddard – a former NASA and Apple engineer – first started experimenting with LLMs, he quickly became interested in the innovative new techniques based on model merging. Charles started reading all the literature on the topic that he could find – but soon discovered that the code was not readily available. He was impressed by the high level of innovative research in the papers, but was disappointed by the lack of accompanying code releases. On the rare occasion that code was included, it wasn't in easily accessible form – usually just a Jupyter notebook that's barely been looked at, or code written to run on a researcher's particular cluster. These roadblocks led Charles to one conclusion: if he was going to experiment with model merging, he'd need to write his own code. That led him to create a repo he called "mergekit," which quickly became popular on Github. In February, mergekit merged Arcee – with Charles joining Arcee's staff as a Senior Research Engineer. Both Charles and Arcee are committed to keeping the mergekit library open source, as they lead the way in model merging, LLM, and SLM (Small Language Model) research and development.

Check out the video interview below to hear more from Charles about why he’s so passionate about open source. TRANSCRIPT : Charles Goddard, mergekit Founder There are all these huge tech companies that are producing incredible breakthroughs in the fields of natural language processing and artificial intelligence. But those results are staying more or less siloed behind corporate firewalls and going towards specific products, but not going out to the greater community. And that's absolutely understandable. They've invested huge amounts of money into that and it's their IP. But I really want to basically be driving forward the frontiers of human knowledge in a way that's accessible to humans – other than the people building it. So, I made mergekit open source with the thought that I can do a bunch of experiments with model merging, but that's only so many. If I release the tools for this kind of thing to the world at large, then suddenly you've got thousands of people playing with this and doing different merges, trying out different techniques, figuring out the best hyperparameters. In a week, more interesting results come out of the open source community than I could do in months.

Related Blogs

Open-Source Toolkits • October 6, 2025

IBM Research Uses Arcee MergeKit in Granite 4.0 Model Development

MergeKit helped evaluate merged checkpoints and select top performers, reflecting a broader enterprise shift to open models & reproducible tooling.

Open-Source Toolkits • February 5, 2025

Meet MergeKit v0.1: Expanded Model Support, Arcee Fusion, & Multi-GPU Acceleration

MergeKit changed the game when it came to model merging, and today we're excited to bring you some game-changing updates to MergeKit–with what we're calling MergeKit v0.1. Starting today, you'll be able to unlock the power of model merging more than ever, with enterprise hosting, premium features, and expert support.

Open-Source Toolkits • August 1, 2024

DistillKit v0.1 by Arcee Labs: The Technical Paper

Read the DistillKit v0.1 by Arcee AI Technical Paper: our new open-source tool that's set to change how we create and distribute Small Language Models (SLMs).

View More