⏩ Preview (#1354)

* 🔥 remove disable indexing

* 🍱 update continue logo

* 🐛 fix language undefined bug

* 🐛 fix merge mistake

* 📝 rename googlepalmapi.md to googlegeminiapi.md

* 📝 update mistral models

* Rename to geminiapi & change filename this time

* ✨ global request options (#1153)

* ✨ global request options

* 🐛 fix jira context provider by injecting fetch

* ✨ request options for embeddings providers

* ✨ add Cohere as Reranker (#1159)

* ♻️ use custom requestOptions with CohereEmbeddingsProvider

* Update preIndexedDocs.ts (#1154)

Add WordPress and WooCommerce as preIndexedDocs.

* 🩹 remove example "outputDir" from default config

* Fix slash command params loading (#1084)

Existing slash commands expect an object named
"params" so mapping to "options" here caused
params to be undefined within the run scope. I
renamed from 'm' to 's' just to avoid potential
confusion with the model property mapping above.

* 🐛 don't index if no open workspace folders

* 💄 improve onboarding language

* 🚸 improve onboarding

* 🐛 stop loading when error

* 💄 replace text in input box

* Respect Retry-After header when available from 429 responses (#1182)

* 🩹 remove dead code for exponential backoff

This has been replaced by the withExponentialBackoff helper

* 🩹 respect Retry-After header when available

* 🚸 update inline tips language

* ✨ input box history

* 📌 update package-locks

* 🔊 log errors in prepackage

* 🐛 err to string

* 📌 pin llama-tokenizer-js

* 📌 update lockfile

* 🚚 change /docs to docs.

* 📦 package win-ca dependencies in binary

* 🔥 remove unpopular models from UI

* 🍱 new logo in jetbrains

* 🎨 use node-fetch everywhere

* 🚸 immediately select newly added models

* 🚸 spell out Alt instead of using symbol

* 🔥 remove config shortcut

* 🐛 fix changing model bug

* 🩹 de-duplicate before adding models

* 🔧 add embeddingsProvider specific request options

* 🎨 refactor to always use node-fetch from LLM

* 🔥 remove duplicate tokens generated

* 🔊 add timestamp to JetBrains logs

* 🎨 maxStopWords for Groq

* 🐛 fix groq provider calling /completions

* 🐛 correctly adhere to LanceDB table name spec

* 🐛 fix sqlite NOT NULL constraint failed error with custom model

* Fix issue where Accept/Reject All only accepts/rejects a single diff hunk. (#1197)

* Fix issues parsing Ollama /api/show endpoint payloads. (#1199)

* ✨ model role for inlineEdit

* 🩹 various small updates

* 🐛 fix openai image support

* 🔖 update gradle version

* 🍱 update jetbrains icon

* 🐛 fix autocomplete in notebook cells

* 🔥 remove unused media

* 🔥 remove unused files

* Fix schema to allow 'AUTODETECT' sentinel for model when provider is 'groq'. (#1203)

* 🐛 small improvements

* Fix issue with @codebase provider when n becomes odd due to a divide by 2 during the full text search portion of the query. (#1204)

* 🐛 add skipLines

* ✨ URLContextProvider

* 🥅 improved error handling for codebase indexing

* 🏷️ use official Git extension types

* ➕ declare vscode.git extension dependency

* ⚡️ use reranker for docs context provider

* 🚸 Use templating in default customCommand

* 🎨 use U+23CE

* 🚸 disable autocomplete in commit message box

* 🩹 add gems to default ignored paths

* ⚡️ format markdown blocks as comments in .ipynb completions

* 🐛 don't strip port in URL

* 🐛 fix "gemini" provider spacing issues

* 📦 update posthog version

* CON-1067: Failed state seems to be toggling as intended

* 🏷️ update types.ts

* 🐛 fix copy/paste/cut behavior in VS Code notebooks

* ✨ llama3 prompt template

* Rework for proper initialization on start up

* CON-1067 Clean-up

* CON-1067 more clean-up

* Add indexingNotLoaded state

* CON-1067 communicate progress to frontend

* 🐛 fix undefined prefix, suffix and language for `/edit` (#1216)

* 🐛 add .bind to fix templating in systemMessage

* CON-1067 clean up

* 🐛 small improvements to autocomplete

* Update DocsContextProvider.ts (#1217)

I fixed a bug where you were sending the query variable (which holds the base URL of the doc) to the rerank method, and it made no sense to rerank the chunks based on a URL. So I changed it to extras.fullInput because it should rerank based on the user input, which should provide better results.

* 📝 select-provider.md update

* 🐛 fix merge errors

* Nate/autocomplete-metrics (#1230)

* ⚡️ use context.selectedCompletionInfo, deduplicate logs

* ⚡️ don't reject if user keeps typing same as completion

* ⚡️ vscode autocomplete edge cases

* 🚧 WIP on vscode autocomplete

* ⚡️ better bracket handlng

* ⚡️ improved multi-line detection

* Active file default context (#1231)

* 🚸 include currently active file by default

* 🚸 warn if non-autocomplete model being used

* ✨ try hole filling template for gpt

* 💄 ui for no context

* ⚡️ leave out bottom of excessively large files

* 🚧 experimenting with perplexity style streaming

* 🐛 fix #1237

* 💚 fix type error

* ⚡️ improve LSP usage in autocomplete

* 🐛 fix content parsing regression in /edit

* add PySide6 docs to preindexed docs (#1236)

* CON-232 bring custom docs to top, alphabetize doc results, make scrol… (#1239)

* CON-232 bring custom docs to top, alphabetize doc results, make scrollable

* CON-232 cleanup

---------

Co-authored-by: Justin Milner <[email protected]>

* CON-1067 condense some things

* 🚚 [Auxiliary -> Continue] Sidebar

* 🔊 log completion options in ~/.continue/sessions

* CON-1067 wrong ret val fix

* CON-1067: fixes from testing

* ⚡️ filter out completions that are only punctuation/space

* ⚡️ inject intellisense docs, no multi-line on comments

* ⚡️ crawl type definitions for autocomplete

* ⚡️ truncate function text

* ⚡️ cache LSP calls

* ⚡️ find recently edited ranges with perfect prefix match

* 🐛 fix gif paths

* ⚡️ bring back double new line stop words

* 📌 add yarn lock files

* 🐛 allow language keywords to be generated

* 💄 toggle on help button

* 🎨 defaultContext option

* 🐛 fix lancedb bug by upgrading

* 🐛 fix groq stop tokens

* 🐛 preventDefault to avoid double paste

* 🚸 don't repeatedly override cmd+J

* 🧑‍💻 fix npm run test in core

* 📝 change description

* 🐛 silence Ollama invalid server state warning

* ⚡️ more accurate getTerminalContents

* ⚡️ make getTerminalContents more accurate

* 🧑‍💻 use yarn instead of npm

* 👷 fix yarn add --no-save in prepackge

* 🐛 correctly read entire notebook file contents

* ➕ import handlebars

* 🔥 remove unnecessary migrations

* ⚡️ improve /comment prompt

* Add debug terminal context menu (#1261)

* Add --no-dependencies to vsce package (#1255)

This is not needed because we bundle first with esbuild, and
vsce pack has issues with modern package managers.

see: microsoft/vscode-vsce#421 (comment)

* ui: change line decoration color to use vscode theme (#1253)

* ui: change line decoration color to use vscode theme

to give user a more consistent experience by letting the decoration color to user the color defined in the theme.

* fix: incorrect color item

should be line background not text background
because the decoration is for the whole line

* 🎨 refactor indexing state into a single object

* CON-223 Correct diff streaming abort (#1263)

Co-authored-by: Justin Milner <[email protected]>

* 📦 switch to pnpm (#1265)

* 🎨 use pnpm instead of yarn

* ➕ make dependencies explicit for pnpm

* 🐛 add powershell to extension mapping, and default to ext

* Add stream support for Bedrock Anthropic

* 🎨 make llamatokenizer commonjs compatible

* ➕ add esbuild optional deps

* 🚚 rename vendor/node_modules -> modules

* 🔖 update core version

* 🐛 fixes for transformers.js compatibility

* 🔖 update core version

* 🎨 set modelPath in constructor

* 🎨 fix transformers.js import

* 🎨 eslint enforce import extensions

* 🎨 require -> import

* 🚸 notify user if not diff in /commit

* 💄 Improve colors of the IntelliJ tool window icon (#1273)

Without this fix, the continue icon sticks out from the other toolwindow icons,
resulting in an inconsistent appearance of the whole IDE and creates a feeling
that the continue plugin "doesn't fit, something must be broken".

According to
https://plugins.jetbrains.com/docs/intellij/icons.html#new-ui-icon-colors
specific colors are needed to work nicely with dark and light modes. Bonus is
that the active tool window icon color then changes automatically to white.

Co-authored-by: Lukas Baron <[email protected]>

* ✨ send Bearer token to Ollama if apiKey set

* 🐛 fix slash command bug

* 🧑‍💻 add onnxruntime (--save-dev) for types

* 🐛 don't apply to file when running code block in terminal

* 🐛 avoid double paste

* ✨ gpt-4o

* 🎨 pass uniqueId to constructor

* 🚸 focus without scrolling into vie

* 🎨 refactoring for continue-proxy LLM (#1277)

* 🐛 continue server client fixes

* 🎨 refactor OpenAI _getHeaders

* 🎨 pass ideSettings to llmFromDescription

* ⚡️ improve add docstring command

* 💚 ci updates

* 🐛 fix repeated paste bug

* 🐛 fix build script

* 🩹 various small improvements

* 📌 pin esbuild 0.17.19

* 🧑‍💻 pnpm i gui in prepackage

* 🐛 show all diff changes in vscode

* 🩹 getMetaKeyName

* 🐛 fix reading of unopened ipynb files

* ⚡️ gpt-4o system prompt

* 💄 make font size configurable in config.json ui.fontSize

* 🩹 properly dispose of diff handler

* 🐛 fix indexing status display

* ⚡️ context pruning

* 🎨 update free trial models

* fix: remove some backup files generated by pkg if present (#1287)

* adjust toCopy (#1305)

Co-authored-by: Justin Milner <[email protected]>

* Nate/prompt-file (#1308)

* ✨ .prompt files

* 🧑‍💻 back to npm  : (

* 🎨 nicer dropdown icon

* 🎨 full switch back to npm

* 🧑‍💻 uninstall script for fresh start

* 🎨 updated package-locks

* 🔥 remove hello from continuerc.json

* 🔥 remove example files

* 🎨 update test prompt

* 🎨 update prompt

* 🎨 update test prompt

* 👷 create out/node_modules in prepackage.js

* Log prompt-tokens to devdb and show in 'My Usage' view (#1309)

* Also log the number of prompt tokens to the dev-db

* Show prompt tokens in 'My Usage' view

* 🔥 remove console logs

* add lm studio tab-autocomplete walkthrough (#1298)

* 📝 update autocomplete LM Studio docs

* 💚 fix prepackage.js

* ⬆️ upgrade lancedb version

* 🚸 make it easier to continue past trial

* 🚸 improve model setup process

* 📌 update package-lock.jsons

* 🐛 fix prompt file loading bug

* docs: add setup guide for OpenRouter (#1284)

* Update preIndexedDocs.ts (#1292)

Add Bootstrap and Alpine.js as pre indexed docs.

* add toString (#1324)

* add toString

* Fix indentation

---------

Co-authored-by: Justin Milner <[email protected]>

* don't overwrite all models in onboarding

* 🔧 override headers with custom headers

* ✨ allow overwriting slash command description

* feature flag (#1327)

* ➕ feature flags dependency

* 🎨 make getHeaders awaitable

* 🔒️ token count for abuse monitoring

* 👷 remove win32-arm64 target

* Update build.js (#1330)

Fix error: EBUSY: resource busy or locked, rmdir '...\continue\binary\tmp\continue-node_modules-lancedb'

* 📌 pin onnxruntime version to match transformers.js

* 🎨 transformers cleanup, extensionVersion header

* 🔥 remove lingering pnpm

* 🎨 update default models

* 🎨 update defaults

* 👷 fix version in build post-check

* 🎨 test.js in dev

* 🧑‍💻 cleaning

* Add Gemini 1.5 Flash as a model (#1337)

* 🎨 log dev data for tokens generated

* Expose custom context provider registration through a vscode extension api. (#1288)

---------

Co-authored-by: Peter Zaback <[email protected]>
Co-authored-by: Maxime Brunet <[email protected]>
Co-authored-by: Jose Vega <[email protected]>
Co-authored-by: Nejc Habjan <[email protected]>
Co-authored-by: Chad Yates <[email protected]>
Co-authored-by: Justin Milner <[email protected]>
Co-authored-by: 小颚虫 <[email protected]>
Co-authored-by: 5eqn <[email protected]>
Co-authored-by: Pixel <[email protected]>
Co-authored-by: Justin Milner <[email protected]>
Co-authored-by: Devin Gould <[email protected]>
Co-authored-by: Dipta Mahardhika <[email protected]>
Co-authored-by: Ruben Kostandyan <[email protected]>
Co-authored-by: tnglemongrass <[email protected]>
Co-authored-by: Lukas Baron <[email protected]>
Co-authored-by: Fernando <[email protected]>
Co-authored-by: Tijs Zwinkels <[email protected]>
Co-authored-by: DJ Johnson <[email protected]>
Co-authored-by: sam <[email protected]>
Co-authored-by: Pratik Parmar <[email protected]>
Co-authored-by: Sam El-Husseini <[email protected]>

.vscode/launch.json

@@ -49,10 +49,13 @@
       "args": [
         // Pass a directory to manually test in
         "${workspaceFolder}/extensions/vscode",
-        "${workspaceFolder}/extensions/vscode/manual-testing-sandbox/example.ts",
+        "${workspaceFolder}/extensions/vscode/manual-testing-sandbox/test.js",
         "--extensionDevelopmentPath=${workspaceFolder}/extensions/vscode"
       ],
-      "outFiles": ["${workspaceFolder}/extensions/vscode/out/**/*.js"],
+      "outFiles": [
+        "${workspaceFolder}/extensions/vscode/out/**/*.js",
+        "/Users/natesesti/.continue/config.ts"
+      ],
       "preLaunchTask": "vscode-extension:build"
     },
     // Has to be run after starting the server (separately or using the compound configuration)

core/config/handler.ts

@@ -1,4 +1,4 @@
-import { ContinueConfig, ContinueRcJson, IDE, ILLM } from "../index.js";
+import { ContinueConfig, ContinueRcJson, IDE, ILLM, IContextProvider } from "../index.js";
 import { IdeSettings } from "../protocol.js";
 import { Telemetry } from "../util/posthog.js";
 import {
@@ -10,6 +10,7 @@ import {
 export class ConfigHandler {
   private savedConfig: ContinueConfig | undefined;
   private savedBrowserConfig?: BrowserSerializedContinueConfig;
+  private additionalContextProviders: IContextProvider[] = [];
 
   constructor(
     private readonly ide: IDE,
@@ -82,6 +83,10 @@ export class ConfigHandler {
       ideInfo.extensionVersion,
     );
 
+    (this.savedConfig.contextProviders ?? []).push(
+      ...this.additionalContextProviders,
+    );
+
     return this.savedConfig;
   }
 
@@ -95,4 +100,9 @@ export class ConfigHandler {
 
     return model;
   }
+
+  registerCustomContextProvider(contextProvider: IContextProvider) {
+    this.additionalContextProviders.push(contextProvider);
+    this.reloadConfig();
+  }
 }

core/index.d.ts

@@ -568,6 +568,7 @@ export type ModelName =
   // Gemini
   | "gemini-pro"
   | "gemini-1.5-pro-latest"
+  | "gemini-1.5-flash-latest"
   // Mistral
   | "mistral-tiny"
   | "mistral-small"

core/indexing/ignore.ts

@@ -58,6 +58,7 @@ const DEFAULT_IGNORE_FILETYPES = [
   "*.profraw",
   "*.gcda",
   "*.gcno",
+  "go.sum",
 ];
 export const defaultIgnoreFile = ignore().add(DEFAULT_IGNORE_FILETYPES);
 export const DEFAULT_IGNORE_DIRS = [

core/llm/autodetect.ts

@@ -62,6 +62,7 @@ const MODEL_SUPPORTS_IMAGES: string[] = [
   "claude-3",
   "gemini-ultra",
   "gemini-1.5-pro",
+  "gemini-1.5-flash",
   "sonnet",
   "opus",
   "haiku",

core/llm/index.ts

@@ -13,6 +13,7 @@ import {
   RequestOptions,
   TemplateType,
 } from "../index.js";
+import { logDevData } from "../util/devdata.js";
 import { DevDataSqliteDb } from "../util/devdataSqlite.js";
 import { fetchwithRequestOptions } from "../util/fetchWithOptions.js";
 import mergeJson from "../util/merge.js";
@@ -217,7 +218,11 @@ ${settings}
 ${prompt}`;
   }
 
-  private _logTokensGenerated(model: string, prompt: string, completion: string) {
+  private _logTokensGenerated(
+    model: string,
+    prompt: string,
+    completion: string,
+  ) {
     let promptTokens = this.countTokens(prompt);
     let generatedTokens = this.countTokens(completion);
     Telemetry.capture("tokens_generated", {
@@ -226,7 +231,18 @@ ${prompt}`;
       promptTokens: promptTokens,
       generatedTokens: generatedTokens,
     });
-    DevDataSqliteDb.logTokensGenerated(model, this.providerName, promptTokens, generatedTokens);
+    DevDataSqliteDb.logTokensGenerated(
+      model,
+      this.providerName,
+      promptTokens,
+      generatedTokens,
+    );
+    logDevData("tokens_generated", {
+      model: model,
+      provider: this.providerName,
+      promptTokens: promptTokens,
+      generatedTokens: generatedTokens,
+    });
   }
 
   fetch(url: RequestInfo | URL, init?: RequestInit): Promise<Response> {
@@ -533,4 +549,3 @@ ${prompt}`;
     }
   }
 }
-

docs/static/schemas/config.json

@@ -438,14 +438,12 @@
             "properties": {
               "model": {
                 "enum": [
-                  "gpt-4-turbo",
                   "gpt-4o",
                   "llama3-70b",
                   "gpt-3.5-turbo",
                   "phind-codellama-34b",
                   "gemini-pro",
                   "mistral-8x7b",
-                  "claude-3-opus-20240229",
                   "claude-3-sonnet-20240229",
                   "claude-3-haiku-20240307",
                   "starcoder-7b",

extensions/intellij/src/main/resources/config_schema.json

@@ -438,14 +438,12 @@
             "properties": {
               "model": {
                 "enum": [
-                  "gpt-4-turbo",
                   "gpt-4o",
                   "llama3-70b",
                   "gpt-3.5-turbo",
                   "phind-codellama-34b",
                   "gemini-pro",
                   "mistral-8x7b",
-                  "claude-3-opus-20240229",
                   "claude-3-sonnet-20240229",
                   "claude-3-haiku-20240307",
                   "starcoder-7b",

extensions/vscode/config_schema.json

@@ -610,7 +610,8 @@
                 "enum": [
                   "chat-bison-001",
                   "gemini-pro",
-                  "gemini-1.5-pro-latest"
+                  "gemini-1.5-pro-latest",
+                  "gemini-1.5-flash-latest"
                 ]
               }
             }
@@ -985,6 +986,7 @@
                       "chat-bison-001",
                       "gemini-pro",
                       "gemini-1.5-pro-latest",
+                      "gemini-1.5-flash-latest",
                       "mistral-tiny",
                       "mistral-small",
                       "mistral-medium",

extensions/vscode/continue_rc_schema.json

@@ -474,14 +474,12 @@
             "properties": {
               "model": {
                 "enum": [
-                  "gpt-4-turbo",
                   "gpt-4o",
                   "llama3-70b",
                   "gpt-3.5-turbo",
                   "phind-codellama-34b",
                   "gemini-pro",
                   "mistral-8x7b",
-                  "claude-3-opus-20240229",
                   "claude-3-sonnet-20240229",
                   "claude-3-haiku-20240307",
                   "starcoder-7b",

extensions/vscode/src/activation/activate.ts

@@ -7,6 +7,7 @@ import registerQuickFixProvider from "../lang-server/codeActions";
 import { getExtensionVersion } from "../util/util";
 import { getExtensionUri } from "../util/vscode";
 import { setupInlineTips } from "./inlineTips";
+import { VsCodeContinueApi } from "./api";
 
 export async function activateExtension(context: vscode.ExtensionContext) {
   // Add necessary files
@@ -34,4 +35,12 @@ export async function activateExtension(context: vscode.ExtensionContext) {
       extensionVersion: getExtensionVersion(),
     });
   }
+
+  const api = new VsCodeContinueApi(vscodeExtension);
+  const continuePublicApi = {
+    registerCustomContextProvider: api.registerCustomContextProvider.bind(api),
+  };
+
+  // 'export' public api-surface
+  return continuePublicApi;
 }

extensions/vscode/src/activation/api.ts

@@ -0,0 +1,10 @@
+import { VsCodeExtension } from "../extension/vscodeExtension";
+import { IContextProvider } from "core";
+
+export class VsCodeContinueApi {
+  constructor(private readonly vscodeExtension: VsCodeExtension) {}
+
+  registerCustomContextProvider(contextProvider: IContextProvider) {
+    this.vscodeExtension.registerCustomContextProvider(contextProvider);
+  }
+}

extensions/vscode/src/extension.ts

@@ -9,7 +9,7 @@ import { getExtensionVersion } from "./util/util";
 async function dynamicImportAndActivate(context: vscode.ExtensionContext) {
   const { activateExtension } = await import("./activation/activate");
   try {
-    await activateExtension(context);
+    return activateExtension(context);
   } catch (e) {
     console.log("Error activating extension: ", e);
     vscode.window
@@ -30,7 +30,7 @@ async function dynamicImportAndActivate(context: vscode.ExtensionContext) {
 }
 
 export function activate(context: vscode.ExtensionContext) {
-  dynamicImportAndActivate(context);
+  return dynamicImportAndActivate(context);
 }
 
 export function deactivate() {

extensions/vscode/src/extension/vscodeExtension.ts

@@ -1,6 +1,7 @@
 import { ConfigHandler } from "core/config/handler";
 import { ContinueServerClient } from "core/continueServer/stubs/client";
 import { CodebaseIndexer, PauseToken } from "core/indexing/indexCodebase";
+import { IContextProvider } from "core";
 import { IdeSettings } from "core/protocol";
 import { getConfigJsonPath, getConfigTsPath } from "core/util/paths";
 import fs from "fs";
@@ -308,4 +309,8 @@ export class VsCodeExtension {
       console.log("Codebase Indexing Complete");
     }
   }
+
+  registerCustomContextProvider(contextProvider: IContextProvider) {
+    this.configHandler.registerCustomContextProvider(contextProvider);
+  }
 }

gui/src/components/mainInput/inputModifiers.ts

@@ -2,5 +2,5 @@ import { InputModifiers } from "core";
 
 export const defaultInputModifiers: InputModifiers = {
   useCodebase: false,
-  noContext: false,
+  noContext: true,
 };

gui/src/util/modelData.ts

@@ -454,6 +454,18 @@ const gemini15Pro: ModelPackage = {
   icon: "gemini.png",
   providerOptions: ["gemini", "freetrial"],
 };
+const gemini15Flash: ModelPackage = {
+  title: "Gemini 1.5 Flash",
+  description: "Fast and versatile multimodal model for scaling across diverse tasks",
+  params: {
+    title: "Gemini 1.5 Flash",
+    model: "gemini-1.5-flash-latest",
+    contextLength: 1_000_000,
+    apiKey: "<API_KEY>",
+  },
+  icon: "gemini.png",
+  providerOptions: ["gemini"],
+};
 
 const deepseek: ModelPackage = {
   title: "DeepSeek-Coder",
@@ -660,6 +672,7 @@ export const MODEL_INFO: (ModelPackage | string)[] = [
   "Gemini",
   gemini15Pro,
   geminiPro,
+  gemini15Flash,
   "Open Source",
   llama3Chat,
   deepseek,
@@ -863,7 +876,7 @@ export const PROVIDER_INFO: { [key: string]: ModelInfo } = {
         required: true,
       },
     ],
-    packages: [gemini15Pro, geminiPro],
+    packages: [gemini15Pro, geminiPro, gemini15Flash],
   },
   mistral: {
     title: "Mistral API",