Skip to content

feat: add vit implementation#212

Open
kinggongzilla wants to merge 2 commits into
mainfrom
feat-add-vit
Open

feat: add vit implementation#212
kinggongzilla wants to merge 2 commits into
mainfrom
feat-add-vit

Conversation

@kinggongzilla
Copy link
Copy Markdown
Contributor

Adds a Vision Transformer for 2D grid inputs, built on the existing Transformer backbone.

Copy link
Copy Markdown

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review to trigger a review and subscribe this PR to future pushes, or @claude review once for a one-time review.

Tip: disable this comment in your organization's Code Review settings.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

Coverage

Tests Skipped Failures Errors Time
1398 24 💤 0 ❌ 0 🔥 30.312s ⏱️

Comment thread src/noether/modeling/modules/layers/vit_layers.py
Comment thread src/noether/modeling/models/vit.py Outdated
Comment thread src/noether/modeling/models/vit.py Outdated
Comment thread src/noether/modeling/models/vit.py Outdated
Comment thread src/noether/modeling/models/vit.py
Comment thread src/noether/modeling/models/vit.py Outdated
Comment thread src/noether/core/schemas/models/vit.py Outdated
@@ -0,0 +1,44 @@
# Copyright © 2025 Emmi AI GmbH. All rights reserved.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we move this one too src/noether/modeling/models/vit.py directly?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for the other models its still in this place. i think if we do this we should move all of the model schemas together in a separate PR maybe?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also think it should be done at once

"""Configuration for ViT model"""

model_config = ConfigDict(extra="forbid")

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is the transformer block config not used?

Comment thread src/noether/modeling/models/vit.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants