Skip to content
This repository was archived by the owner on Oct 18, 2026. It is now read-only.
This repository was archived by the owner on Oct 18, 2026. It is now read-only.

feat: Add comprehensive device parameter access beyond remote control limitations #15

Open

Description

@zsoltcs1123

Hi there. This is an amazing project with so much possibilities. The most exciting aspect would be opening up the internal parameters of Bitwig devices (or VST's if they expose any) to AI-based sound design, effectively programming these devices via prompts. Below is an AI generated description I created after checking out the repo. Not sure if the assumptions are correct.

I may try to create a POC out of it, I think this feature would be a game changer.

🎯 Feature Request: Comprehensive Device Parameter Access

Problem Statement

Currently, WigAI can only access device parameters through remote control pages, limiting AI agents to 8 parameters per page. This severely restricts AI-driven sound design capabilities, as most devices have 50-300+ internal parameters that remain inaccessible.

Proposed Solution

Implement direct access to ALL device parameters using Bitwig's internal parameter API methods, bypassing remote control page limitations entirely.

Technical Approach

Instead of relying on cursorDevice.createCursorRemoteControlsPage(128), use direct parameter access:

// Current limitation (Epic 2 implementation):
RemoteControlsPage deviceParameterBank = cursorDevice.createCursorRemoteControlsPage(128);

// Proposed enhancement:
public List<InternalParameterInfo> getAllDeviceParameters() {
    List<InternalParameterInfo> params = new ArrayList<>();
    Device device = cursorDevice;
    
    // Direct parameter enumeration (needs API research)
    for (int i = 0; i < getDeviceParameterCount(); i++) {
        Parameter param = device.getParameter(i); // or similar method
        if (param.exists()) {
            params.add(new InternalParameterInfo(
                i, 
                param.name().get(), 
                param.value().get(),
                param.displayedValue().get(),
                param.getUnit(),
                param.getMinValue(),
                param.getMaxValue()
            ));
        }
    }
    return params;
}

Benefits

  • 🚀 Complete Parameter Universe: Access to 100s of parameters vs 8
  • 🎵 True AI Sound Design: AI can manipulate every aspect of a device
  • ⚡ Simpler Architecture: No page navigation complexity
  • 🔄 Immediate Access: No UI state dependencies

API Enhancement Proposal

Add new MCP tools:

  • get_all_device_parameters - Returns ALL device parameters
  • set_device_parameter_by_name - Set parameters by name (more intuitive)
  • get_device_parameter_metadata - Get parameter constraints and units

Example Output

{
  "device": "Wavetable",
  "total_parameters": 247,
  "parameters": [
    {
      "index": 0,
      "name": "Osc1.Wavetable.Position", 
      "value": 0.5,
      "display_value": "50%",
      "unit": "%",
      "min_value": 0.0,
      "max_value": 1.0
    },
    {
      "index": 1,
      "name": "Osc1.Unison.Voices",
      "value": 0.3,
      "display_value": "3 voices", 
      "unit": "voices",
      "min_value": 1,
      "max_value": 16
    }
    // ... 245 more parameters
  ]
}

Implementation Plan

  1. Research exact Bitwig API methods for direct parameter access
  2. Create InternalParameterController class
  3. Implement parameter enumeration and access methods
  4. Add new MCP tools for comprehensive parameter control
  5. Update documentation and tests

Research Sources

Relationship to Existing Roadmap

This enhancement would:

  • Complement Epic 8: Provide alternative to complex page navigation
  • Extend Epic 2: Enhance current parameter control with comprehensive access
  • Enable Epic 9: Advanced AI sound design capabilities

Impact

This would make WigAI the most comprehensive AI-DAW integration available, enabling true AI-driven sound design that's impossible in other DAWs due to their closed architectures.


Activity

  1. zsoltcs1123 commented on Aug 14, 2025

    @zsoltcs1123
    Author

    Ok, I just realized the AI hallucinated a bit as on the page linked the getparameter() method is still within the context of a remote page. bummer.

  2. zsoltcs1123 commented on Aug 14, 2025

    @zsoltcs1123
    Author

    🎯 OFFICIAL CONCLUSION:

    YES, comprehensive parameter access IS possible! Not through direct internal parameter access, but through multiple parameter page types:

    ✅ Available Parameter Access:

    1. Remote Control Pages (8 params each) - Navigate with setParameterPage(int)
    2. Envelope Parameters - Access with getEnvelopeParameter(int)
    3. Common Parameters - Access with getCommonParameter(int)
    4. Page Navigation - previousParameterPage(), nextParameterPage()

    🚀 Potential Parameter Count:

    • Remote pages: 8 parameters × multiple pages (could be 5-15 pages)
    • Envelope parameters: Unknown count (possibly 10-20)
    • Common parameters: Unknown count (possibly 10-30)
    • Total: Potentially 100-200+ parameters per device
  3. fabb commented on Aug 15, 2025

    @fabb
    Owner

    getEnvelopeParameter and getCommonParameter are deprecated.

    It would be great to be able to modify parameters without switching between remote control pages, but i‘m not yet sure if that is possible. Open for suggestions!

    Ideally all MCP tool calls would work independent of the current UI state (except when targeting the currently selected device/track/clip), so tool calls can work independent of the parallel without getting into each other’s way. But not sure if that‘s how the bitwig api works.

  4. zsoltcs1123 commented on Aug 15, 2025

    @zsoltcs1123
    Author

    Oh you can certainly create a parameter bank for any device on any track, not just the currently selected one. That's something the Bitwig API is capable of. I've done it in some of my controller scripts. You can also target any page on that bank without switching pages on the UI. Let me see if I can dig up some examples!

  5. fabb commented on Aug 15, 2025

    @fabb
    Owner

    Thank you!

  6. fabb commented on Aug 15, 2025

    @fabb
    Owner

    Btw I now added feature/bug ticket templates with some rules for AI to keep the tiresome enthusiasm of Sonnet and others down and the output short ;-)

  7. zsoltcs1123 commented on Aug 15, 2025

    @zsoltcs1123
    Author

    Yeah sorry about that! I was in a hurry.

    Here's what I dig up from my Controller Script. It is in Javascript, but it's subset of what a Java extension can do, so in theory anything that's possible in a script should be possible in an extension.

    This is from the init() method:

    `...

    currentTrackIndex =1
    
    // Setup track bank
    trackBank = host.createTrackBank(8, 0, 0, false);
    currentTrack = trackBank.getItemAt(currentTrackIndex);
    
    // Setup current track remote controls (top row knobs -> page 0)
    currentTrackRemoteControls = currentTrack.createCursorRemoteControlsPage("TopKnobs", 8, null);
    currentTrackRemoteControls.selectedPageIndex().set(0);
    
    // Setup current track remote controls page 1 (MUTE/SOLO buttons -> page 1)
    currentTrackRemotePage1 = currentTrack.createCursorRemoteControlsPage("MuteSolo", 8, null);
    currentTrackRemotePage1.selectedPageIndex().set(1);
    

    `

    So you create a trackbank with all the tracks in the project. Then you get a reference to the currentTrack by index. This is different than the user selected track!

    So next what you do is create separated variables for the different Remote Control Pages by calling createCursorRemoteControlsPage and the setting the selectedPageIndex on each. So now you have reference to all pages!

  8. zsoltcs1123 commented on Aug 15, 2025

    @zsoltcs1123
    Author

    You can do the same on Devices. Continuing the script:

    // Setup child track 1 controls childTrack1 = childTrackBank.getItemAt(0); // Track-level remote controls (middle row knobs page 0, faders page 1) childTrack1RemotePage0 = childTrack1.createCursorRemoteControlsPage("Child1Page0", 8, null); childTrack1RemotePage0.selectedPageIndex().set(0); childTrack1RemotePage1 = childTrack1.createCursorRemoteControlsPage("Child1Page1", 8, null); childTrack1RemotePage1.selectedPageIndex().set(1); // Primary device remote controls (bottom row knobs page 0, buttons page 1) childTrack1PrimaryDevice = childTrack1.createCursorDevice("Primary"); childTrack1PrimaryDevicePage0 = childTrack1PrimaryDevice.createCursorRemoteControlsPage("Child1PrimaryPage0", 8, null); childTrack1PrimaryDevicePage0.selectedPageIndex().set(0); childTrack1PrimaryDevicePage1 = childTrack1PrimaryDevice.createCursorRemoteControlsPage("Child1PrimaryPage1", 8, null); childTrack1PrimaryDevicePage1.selectedPageIndex().set(1);

    This is navigating to child track 1 inside the currentTrack and then setting track-level and Primary Device Remote controls using the same method.

    And when I'm handling the incoming MIDI I'll just route it to the Remote Page I want to control

    `
    // Handle MUTE button
    if (note === NOTE.MUTE) {
    if (DEBUG) {
    host.println('MUTE button pressed - note=${note}, NOTE.MUTE=${NOTE.MUTE}');
    }
    const muteParam = currentTrackRemotePage1.getParameter(0);
    if (muteParam.exists().get()) {
    const currentValue = muteParam.value().get();
    const newValue = currentValue > 0 ? 0 : 127;
    muteParam.value().set(newValue, 128);

            if (DEBUG) {
                host.println('MUTE button -> group track page 1 parameter 0: ${currentValue} -> ${newValue}');
            }
        } else {
            if (DEBUG) {
                host.println('MUTE button pressed but parameter doesn't exist');
            }
        }
        return;
    }
    

    `

    (sorry about the formatting idk whats wrong)

  9. fabb commented on Aug 15, 2025

    @fabb
    Owner

    Ah thanks, there are 2 overloads of createCursorRemoteControlsPage, one with 1 parameter, and one with 3 parameters, and the one with 3 parameters does NOT correspond to the one selected in bitwig:

    Creates a cursor for a remote controls page in the device with the supplied number of parameters. This section will be independent from the current page selected by the user in Bitwig Studio's user interface. The supplied filter is an expression that can be used to match pages this section is interested in. The expression is matched by looking at the tags added to the pages. If the expression is empty then no filtering will occur.

    vs. the one with 1 parameter:

    Creates a cursor for the selected remote controls page in the device with the supplied number of parameters. This section will follow the current page selection made by the user in the application.

    Thanks, will look into this!

  10. fabb commented on Aug 15, 2025

    @fabb
    Owner

    Hm, somehow changing between pages does not work. I tried like this:

            for (int p = 0; p < deviceParameterBank.pageCount().get(); p++) {
                deviceParameterBank.selectedPageIndex().set(p);
    
                for (int i = 0; i < deviceParameterBank.getParameterCount(); i++) {
                    RemoteControl parameter = deviceParameterBank.getParameter(i);
    

    But the deviceParameterBank.selectedPageIndex().set(p) seems not to have an impact, and then I just get the params of the first page repeated a few times (as often as there are pages) :-/

  11. fabb commented on Aug 16, 2025

    @fabb
    Owner

    Looks like it’s a common problem: https://youtu.be/Mg12mR9RSus

    The timeout of 500ms used in the solution in the video is a problem though when requesting the parameters synchronously. On the discord server i heard the solution can be buggy too.

  12. zsoltcs1123 commented on Aug 19, 2025

    @zsoltcs1123
    Author

    In this code:

    `
    currentTrackIndex =1

    // Setup track bank
    trackBank = host.createTrackBank(8, 0, 0, false);
    currentTrack = trackBank.getItemAt(currentTrackIndex);

    // Setup current track remote controls (top row knobs -> page 0)
    currentTrackRemoteControls = currentTrack.createCursorRemoteControlsPage("TopKnobs", 8, null);
    currentTrackRemoteControls.selectedPageIndex().set(0);

    // Setup current track remote controls page 1 (MUTE/SOLO buttons -> page 1)
    currentTrackRemotePage1 = currentTrack.createCursorRemoteControlsPage("MuteSolo", 8, null);
    currentTrackRemotePage1.selectedPageIndex().set(1);
    `

    Setting the page works and it stays set... maybe because I have different variables for each? idk... but I can route the incoming MIDI to the appropriate page no problem... been using this script and it works

  13. zsoltcs1123 commented on Aug 19, 2025

    @zsoltcs1123
    Author

    Ideally bitwig should fix these stupid limitations. And expose ALL internal params of the devices too. That could make them the first AI - enabled Sound Design environment ever... I hope they realize this.

  14. fabb commented on Aug 19, 2025

    @fabb
    Owner

    I asked support and they replied that they don’t offer support for the controller extension api, but they will look into it if they have time.

  15. fabb commented on Aug 19, 2025

    @fabb
    Owner

    Maybe it’s a timing issue because I’m changing the page index in a loop and the bitwig api needs some time to switch the page asynchronously? I hope not, because then I would need to change the while MCP tool response to work asynchronously.

  16. glassdimly commented on Oct 17, 2026

    @glassdimly

    We've implemented this as far as the API allows, in PR #21 and in a fork with releases: https://github.com/glassdimly/wigai-full

    get_device_parameters / set_device_parameters read and write every remote-control page of any device on any track, by parameter name or by page + index, without moving the user's selection. Parameters that aren't on any remote-control page are still out of reach; the API doesn't expose them.

    On the timing question above: yes, page switching is asynchronous. Waiting synchronously inside the tool call works fine: select the page, poll selectedPageIndex() until it reports the new page, then read. One more catch: value().set() is silently ignored for these controls, while setImmediately() works.

    We'd prefer this merged here and the fork deleted.

  17. fabb commented on Oct 18, 2026

    @fabb
    Owner

    @glassdimly very nice! Unfortunately i don’t have the time to maintain this repo and verify PRs in Bitwig anymore, especially since i don’t use this extension actively. I should update the readme accordingly and mention some forks as replacement, like yours. The way of open source i guess.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions