togethercomputer/sprocket

togethercomputer/sprocket

Description: Sprocket SDK for building inference workers on Together Dedicated Containers

Language: Python

Stars: 1

Forks: 0

Open issues: 1

Created: 2026-02-11T23:32:00Z

Pushed: 2026-05-14T17:37:49Z

Default branch: main

Fork: no

Archived: no

README:

Sprocket

Build inference workers for Together's Dedicated Containers. You implement setup() and predict() — Sprocket handles the queue, file transfers, and HTTP server.

Installation

pip install sprocket --extra-index-url https://pypi.together.ai/

Example

import sprocket

class MyModel(sprocket.Sprocket):
def setup(self):
self.model = load_your_model()

def predict(self, args: dict) -> dict:
return {"output": self.model(args["input"])}

if __name__ == "__main__":
sprocket.run(MyModel(), "my-org/my-model")

Deploy with the Jig CLI:

together beta jig deploy

Together provisions GPUs, handles autoscaling, and routes jobs to your workers.