Skip to content

feat: [ACCESSIBILITY] Floating TalkBack remote - #718

Open
florent37 wants to merge 3 commits into
mainfrom
feat/accessibility-talkback-remote
Open

florent37 wants to merge 3 commits into
mainfrom
feat/accessibility-talkback-remote

Conversation

@florent37

Copy link
Copy Markdown
Contributor

Description

Replaces the accessibility focus bar of the desktop app with a floating TalkBack remote, and adds an "activate" action (the TalkBack double tap).

Desktop

  • New AccessibilityRemote: a card that floats over the Accessibility screen. It shows the focused element (class, title, bounds, position) and has these buttons:
    • previous / OK / next
    • "Get focused element"
  • The remote can be dragged by its handle and stays inside the screen. It starts at the bottom end and can collapse into a bubble. The position and collapsed state are UI state only.
  • New ActivateAccessibilityFocusedNodeUseCase, wired through the repository and the to-device data source.
  • The event list now takes the full height (the old AccessibilityFocusedNodeCard is removed).

Protocol / SDK

  • New Desktop → Mobile method Activate in both Protocol.kt, documented in protocol/accessibility.md.
  • Android: clicks the element that has the accessibility focus (ACTION_CLICK on a View, or through the Compose accessibility node provider), then replies with FocusedNode. Other platforms reply with an empty FocusedNode.
  • Backward compatible: an older SDK ignores the unknown method.

Checks

  • :accessibility:jvmTest, :accessibility-no-op:compileKotlinJvm, :accessibility:compileAndroidMain
  • :composeApp:compileKotlinDesktop, :domain:allTests, :data:core:allTests, :mcp:allTests, ktlintCheck
  • Not checked at runtime: dragging, collapsing and the click on a real device.

/gemini review

@rteyssandier
rteyssandier force-pushed the feat/accessibility-talkback-remote branch from 5de6443 to b14f533 Compare October 30, 2026 19:32
@rteyssandier
rteyssandier marked this pull request as ready for review October 30, 2026 22:15
@florent37 florent37 changed the title feat: [ACCESSIBILITY] Floating TalkBack remote with an activate (OK) button feat: [ACCESSIBILITY] Floating TalkBack remote Oct 31, 2026
@rteyssandier
rteyssandier force-pushed the feat/accessibility-talkback-remote branch from 78d2b1e to 63ff9a3 Compare November 2, 2026 08:22

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants