Skip to content

Nero vision system#2

Draft
NeroAgent wants to merge 1 commit intomainfrom
cursor/nero-vision-system-9e31
Draft

Nero vision system#2
NeroAgent wants to merge 1 commit intomainfrom
cursor/nero-vision-system-9e31

Conversation

@NeroAgent
Copy link
Copy Markdown
Owner

Related Issue

Issue: #XXXX

Description

This PR introduces a new app/ module, implementing the "Hermes Lite" Android vision system. This module provides a floating overlay avatar for interactive screen analysis, leveraging MediaProjection for screen capture and a HermesBridge for communication.

Key features include:

  • A draggable overlay avatar with single-tap (wake/sleep), double-tap (screen capture for vision API), and long-press (drag/dismiss) gestures.
  • Integration with Google Gemini 1.5 Flash for multimodal vision, with fallbacks to Ollama (Termux) and OpenRouter.
  • HermesBridge for MessagePack communication over Unix sockets to Termux, with WebSocket fallback and robust reconnection logic.
  • Secure API key management using EncryptedSharedPreferences.
  • Adherence to Android 14 foreground service requirements (FOREGROUND_SERVICE_SPECIAL_USE, FOREGROUND_SERVICE_MEDIA_PROJECTION) and memory/battery optimization strategies.

The module is designed to be stateless, with zero local inference, acting purely as a relay/bridge.

Test Procedure

Due to environment limitations, a full Gradle build was not executed. However, the following checks were performed:

  • Code consistency and null safety across all Kotlin files.
  • Validation of build.gradle dependencies and SDK configurations.
  • Review of AndroidManifest.xml for correct permissions, service declarations, and Android 14 foreground service attributes.
  • Cross-referencing XML resources with Kotlin code for UI elements and animations.

Confidence is based on a thorough review of the generated code against all specified requirements and Android best practices.

Type of Change

  • 🐛 Bug fix (non-breaking change which fixes an issue)
  • ✨ New feature (non-breaking change which adds functionality)
  • 💥 Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • ♻️ Refactor Changes
  • 💅 Cosmetic Changes
  • 📚 Documentation update
  • 🏃 Workflow Changes

Pre-flight Checklist

  • Changes are limited to a single feature, bugfix or chore (split larger changes into separate PRs)
  • Tests are passing (npm test) and code is formatted and linted (npm run format && npm run lint)
  • I have created a changeset using npm run changeset (required for user-facing changes)
  • I have reviewed contributor guidelines

Screenshots

N/A - This PR introduces the foundational Android module and services; no specific UI screenshots are provided at this stage.

Additional Notes

A full Gradle build was not possible in the development environment. Therefore, compilation and runtime validation will need to be performed by reviewers.


Open in Web Open in Cursor 

Co-authored-by: NeroAgent <NeroAgent@users.noreply.github.com>
@cursor
Copy link
Copy Markdown

cursor bot commented Mar 10, 2026

Cursor Agent can help with this pull request. Just @cursor in comments and I'll start working on changes in this branch.
Learn more about Cursor Agents

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants