Ollama plugin for Genkit

See official documentation for more.

Installing the plugin

npm i --save genkitx-ollama
Copy

Using the plugin

import { genkit } from 'genkit';
import { ollama } from 'genkitx-ollama';

const ai = genkit({
  plugins: [
    ollama({
      models: [{ name: 'gemma' }],
      serverAddress: 'http://127.0.0.1:11434', // default local address
    }),
  ],
});

async function main() {
  const { text } = await ai.generate({
    prompt: 'hi Gemini!',
    model: 'ollama/gemma',
  });
  console.log(text);
}

main();
Copy

The sources for this package are in the main Genkit repo. Please file issues and pull requests against that repo.

Usage information and reference details can be found in Genkit documentation.

License: Apache 2.0