Basic/WIP implementation of Copliot into the AI System, as well as Support for Scratch projects. #8088
Conversation
…PI key support Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
…ebGPU acceleration Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
…are assistance Co-authored-by: charlieduzstuf <99685295+charlieduzstuf@users.noreply.github.com>
…and-api-keys Add local AI model support with unlimited requests, custom API keys, production-ready local inference with WebGPU acceleration, Scratch project import, and VS Code Copilot Chat integration
There was a problem hiding this comment.
Pull request overview
This PR adds three major features to GDevelop: local AI model support, custom API key integration, and Scratch project import functionality. The implementation provides unlimited AI requests through local models and user-provided API keys.
Key Changes:
- Local AI model infrastructure with download scripts and management UI
- Custom API key configuration for OpenAI, Anthropic, Google AI, and HuggingFace
- Scratch (.sb3) project import with block-to-event conversion
- GitHub Copilot-inspired chat interface with specialized agents
Reviewed changes
Copilot reviewed 35 out of 35 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| Local AI Models (18 files) | Infrastructure for downloading and running local LLMs with transformers.js |
| Scratch Importer (4 files) | Parser and converter for importing Scratch projects into GDevelop |
| Copilot Chat (3 files) | VS Code Copilot-inspired agent system for code assistance |
| UI Integration (3 files) | Dialog components and AI request routing with unlimited request support |
| Configuration (2 files) | AI preset configuration with local model detection |
| Tests & Docs (5 files) | Unit tests and comprehensive documentation |
| CI/CD (1 file) | GitHub Actions workflow for model downloads |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| if (isUsingCustomKeys && !isLocal) { | ||
| // Use direct API call with custom keys | ||
| return createDirectAiRequest(params); | ||
| } | ||
|
|
||
| // Use GDevelop's backend (default) | ||
| return gdCreateAiRequest(getAuthorizationHeader, params); | ||
| }; | ||
|
|
There was a problem hiding this comment.
Duplicate code block detected. Lines 66-73 are identical to lines 54-63, creating unreachable code. The second block will never execute.
| if (isUsingCustomKeys && !isLocal) { | |
| // Use direct API call with custom keys | |
| return createDirectAiRequest(params); | |
| } | |
| // Use GDevelop's backend (default) | |
| return gdCreateAiRequest(getAuthorizationHeader, params); | |
| }; |
| export { | ||
| saveApiKeys, | ||
| loadApiKeys, | ||
| getApiKeyForProvider, | ||
| clearApiKeys, | ||
| setActiveLocalModel, | ||
| getActiveLocalModel, | ||
| setUseLocalModel, | ||
| shouldUseLocalModel, | ||
| type ApiKeyConfig, | ||
| } from './LocalStorage'; |
There was a problem hiding this comment.
Missing type export. The type ApiKeyConfig is imported from './CustomApiKeysDialog' but the CustomApiKeysDialog file exports it. However, this export is then re-exported in LocalStorage.js line 7, but the index.js file should export it from LocalStorage, not from CustomApiKeysDialog to maintain consistency.
| export const saveApiKeys = (apiKeys: Array<ApiKeyConfig>): void => { | ||
| try { | ||
| localStorage.setItem(API_KEYS_STORAGE_KEY, JSON.stringify(apiKeys)); | ||
| } catch (error) { | ||
| console.error('Failed to save API keys:', error); | ||
| } | ||
| }; |
There was a problem hiding this comment.
Security concern: API keys are stored in plain text in localStorage. While mentioned as "encrypted by browser," localStorage does not encrypt data by default. Any script running on the page can access these keys. Consider using a more secure storage mechanism or warning users about this limitation.
| .filter(([_, key]) => key && key.trim() !== '') | ||
| .map(([provider, apiKey]) => ({ | ||
| provider, | ||
| // $FlowFixMe - We know apiKey is a string |
There was a problem hiding this comment.
The Flow type suppression comment "// $FlowFixMe - We know apiKey is a string" is unnecessary. The Object.entries() return type is correct, and the filter ensures only non-empty strings remain. Remove this suppression as the type is already correct.
| // $FlowFixMe - We know apiKey is a string |
| @@ -0,0 +1,59 @@ | |||
| // @flow | |||
There was a problem hiding this comment.
The PR title and description contain a spelling error: "Copliot" should be "Copilot".
1 participant
Very basic/wip, but what this does:
Seemed like a cool PR to make tbh.