@genkit-ai/next
TypeScript icon, indicating that this package has built-in type declarations

1.13.0 • Public • Published

Genkit Next.js Plugin

This plugin provides utilities for conveninetly exposing Genkit flows and actions via Next.js app routs for REST APIs.

// /genkit/simpleFlow.ts
const simpleFlow = ai.defineFlow(
  'simpleFlow',
  async (input, streamingCallback) => {
    const { text } = await ai.generate({
      model: gemini15Flash,
      prompt: input,
      streamingCallback: (chunk) => streamingCallback(chunk.text),
    });
    return text;
  }
);
// /app/api/simpleFlow/route.ts
import { simpleFlow } from '@/genkit/simpleFlow';
import { appRoute } from '@genkit-ai/nextjs';

export const POST = appRoute(simpleFlow);

APIs can be called with the generic genkit/beta/client library, or @genkit-ai/nextjs/client

import { runFlow, streamFlow } from '@genkit-ai/nextjs/client';
import { simpleFlow } from '@/genkit/simpleFlow';

const result = await runFlow<typeof simpleFlow>({
  url: '/api/simpleFlow',
  input: 'say hello',
});

console.log(result); // hello

// set auth headers (when using auth policies)
const result = await runFlow<typeof simpleFlow>({
  url: `/api/simpleFlow`,
  headers: {
    Authorization: 'open sesame',
  },
  input: 'say hello',
});

console.log(result); // hello

// and streamed
const result = streamFlow<typeof simpleFlow>({
  url: '/api/simpleFlow',
  input: 'say hello',
});
for await (const chunk of result.stream()) {
  console.log(chunk.output);
}
console.log(await result.output());

The sources for this package are in the main Genkit repo. Please file issues and pull requests against that repo.

Usage information and reference details can be found in Genkit documentation.

License: Apache 2.0

Package Sidebar

Install

npm i @genkit-ai/next

Weekly Downloads

100,944

Version

1.13.0

License

Apache-2.0

Unpacked Size

50.9 kB

Total Files

18

Last publish

Collaborators

  • pavelgj
  • i2amsam
  • apascal07
  • google-wombot