Composio

Using Composio With Together AI

Composio allows developers to integrate external tools and services into their AI applications. It handles tool calling, web-hooks, authentication, and more.

You need to register on a Composio account - Sign up here if you haven’t already to get their API key https://platform.composio.dev/

Install Libraries

Python

pip install together composio-togetherai

npm install @composio/core @composio/vercel @ai-sdk/togetherai ai

Set your TOGETHER_API_KEY environment variable.

Shell

export TOGETHER_API_KEY=***
export COMPOSIO_API_KEY=***

Example

In this example, we will use Together AI to star a repository on GitHub using Composio Tools.

Python

from composio_togetherai import ComposioToolSet, App
from together import Together

client = Together()
toolset = ComposioToolSet()

/*
We use the Vercel AI SDK with the Together provider to 
enable type checking to work correctly for tools and 
to simplify the Composio integration. 
This flow enables us to directly execute tool calls
without having to use composio.provider.handleToolCalls.
*/

import { Composio } from "@composio/core";
import { VercelProvider } from "@composio/vercel";
import { createTogetherAI } from "@ai-sdk/togetherai";
import { generateText } from "ai";

export const together = createTogetherAI({
  apiKey: process.env.TOGETHER_API_KEY ?? "",
});

const composio = new Composio({
  apiKey: process.env.COMPOSIO_API_KEY ?? "",
  provider: new VercelProvider(),
});

Connect your GitHub account

You need to have an active GitHub Integration in Composio. Learn how to do this here

Python

request = toolset.initiate_connection(app=App.GITHUB)
print(f"Open this URL to authenticate: {request.redirectUrl}")

composio login
composio add github

Get All Github Tools

You can get all the tools for a given app as shown below, but you can get specific actions and filter actions using usecase & tags.

Python

tools = toolset.get_tools(apps=[App.GITHUB])

const userId = "default"; // replace with user id from composio
const tools = await composio.tools.get(userId, {
  toolkits: ['github'],
});

Create a Chat Completion with Tools

Python

response = client.chat.completions.create(
    tools=tools,
    model="meta-llama/Llama-3.3-70B-Instruct-Turbo",
    messages=[
        {
            "role": "user",
            "content": "Star the repo 'togethercomputer/together-cookbook'",
        }
    ],
)

res = toolset.handle_tool_calls(response)
print(res)

const responseGithub = await generateText({
    model: together("meta-llama/Llama-3.3-70B-Instruct-Turbo"),
    messages: [
      {
        role: "user",
        content: "Star the repo 'togethercomputer/together-cookbook'",
      },
    ],
    tools,
    toolChoice: "required",
});

console.log(responseGithub);

Next Steps

Composio - Together AI Cookbook

Explore our in-depth Composio Cookbook to learn how to automate emails with LLMs.