Skip to content

chore(mobile): bump agent-device to 0.21.28 - #1181

Merged
okwasniewski merged 1 commit into
mainfrom
oskar/bump-agent-device
Oct 15, 2026
Merged

okwasniewski merged 1 commit into
mainfrom
oskar/bump-agent-device

Conversation

@okwasniewski

@okwasniewski okwasniewski commented Oct 15, 2026 •

Copy link
Copy Markdown
Member

What and why

Verified

Ran it locally: yes - pnpm check, typecheck, mobile (273) and limrun (14) unit tests. Device behavior relies on the iOS and Android CI suites.

Checklist

  • Changeset added (pnpm changeset) for any change to a published package, or the change is testbed, docs, or CI only.
  • Breaking change: title carries !, the changeset body names what breaks and what replaces it, and the deprecation warning landed a window earlier (stability policy in CONTRIBUTING.md).
  • Docs updated in the same PR: the docs/**/*.mdx page for the behavior, and skills/e2e/ if the skill describes it.
  • Contract change: emitted .d.ts reviewed, tests/types/sdk-types.ts updated; wire change edits the schema and both fixtures.
  • Engine contract change (e2e/engine): changesets for e2e, @e2e-dev/web, and @e2e-dev/mobile.

View guided diff Turn on auto-fix

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 5 files

View guided diff | Turn on auto-fix | Re-trigger cubic

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e web: 91 passed

All 91 tests in 41 files
Test Time
🟢 tests/aria-hidden-flow.e2e.ts · 2 passed 719ms
🟢 aria hidden flow › picks the Pro plan by its visible text and confirms it 542ms
🟢 aria hidden flow › another plan shows the error and keeps the picker open 177ms
🟢 tests/async-states.e2e.ts · 2 passed 7.0s
🟢 async states › reads the code off the transient toast and verifies it once the button enables 2.3s
🟢 async states › a wrong code is rejected after the toast has gone 4.7s
🟢 tests/canvas-only.e2e.ts · 2 passed 351ms
🟢 canvas only › taps square, circle, then diamond at their pixel coordinates 184ms
🟢 canvas only › a shape out of order paints the error and resets progress 167ms
🟢 tests/canvas-whiteboard.e2e.ts · 2 passed 469ms
🟢 canvas whiteboard › drags both shapes into their slots and saves 276ms
🟢 canvas whiteboard › bounces a shape off the wrong slot and refuses to save early 193ms
🟢 tests/cart-totals.e2e.ts · 2 passed 491ms
🟢 cart totals › increasing a quantity updates the line total but the order summary stays stale (planted bug) 277ms
🟢 cart totals › a quantity never drops below one 214ms
🟢 tests/checkout-review.e2e.ts · 1 passed 214ms
🟢 shows a raw greeting token and an undefined delivery date (planted bug), yet places the order 214ms
🟢 tests/context-menu-trap.e2e.ts · 2 passed 696ms
🟢 context menu trap › right-click opens nothing; the row menu renames the file 363ms
🟢 context menu trap › the decoy menu items refuse and keep the file 333ms
🟢 tests/control-inventory.e2e.ts · 8 passed 4.0s
🟢 control inventory › check sets the checkbox and the radio without flipping a set one 363ms
🟢 control inventory › check picks a radio the pick replaces with its summary 269ms
🟢 control inventory › a long press and a double click are told apart from a tap 1.1s
🟢 control inventory › the file menu opens on right-click only and Rename renames the file 308ms
🟢 control inventory › setInputFiles attaches files named from the project root 190ms
🟢 control inventory › the details view is left through the browser history 250ms
🟢 control inventory › scrollIntoView brings the footnote into view 185ms
🟢 control inventory › every exercise done shows the success message 1.4s
🟢 tests/css-content-ui.e2e.ts · 2 passed 440ms
🟢 css content ui › the tile labelled Ship it advances and confirming ships 245ms
🟢 css content ui › a wrong tile shows the CSS-rendered error and keeps the picker 195ms
🟢 tests/date-picker.e2e.ts · 2 passed 804ms
🟢 date picker › navigates three months ahead and books the required date 457ms
🟢 date picker › confirming without the exact date shows the error 347ms
🟢 tests/debounced-search.e2e.ts · 2 passed 2.9s
🟢 debounced search › a decoy one character off is refused 1.5s
🟢 debounced search › picking the exact item adds it to the cart 1.5s
🟢 tests/deferred-dialog.e2e.ts · 1 passed 1.1s
🟢 one submit opens one confirm, even when double-clicked 1.1s
🟢 tests/div-soup.e2e.ts · 2 passed 879ms
🟢 div soup › a wrong code is rejected 399ms
🟢 div soup › the right code grants access after the delete tile fixes a typo 480ms
🟢 tests/drag-and-drop.e2e.ts · 2 passed 714ms
🟢 drag and drop › an out-of-order item resets the dropzone 350ms
🟢 drag and drop › dropping Banana then Cherry passes 364ms
🟢 tests/filter-deep-link.e2e.ts · 2 passed 289ms
🟢 filter deep link › filtering writes the query to the URL 162ms
🟢 filter deep link › opening a shared link restores the filter 127ms
🟢 tests/gift-card-purchase.e2e.ts · 3 passed 672ms
🟢 gift card purchase › refuses to buy without an amount 210ms
🟢 gift card purchase › refuses a recipient without an at sign 227ms
🟢 gift card purchase › sends the gift card 235ms
🟢 tests/hover-menu.e2e.ts · 2 passed 548ms
🟢 hover menu › a decoy leaf is refused 235ms
🟢 hover menu › hovering Account, then Billing, reaches Redeem voucher 313ms
🟢 tests/iframe-form.e2e.ts · 2 passed 623ms
🟢 iframe form › a wrong code is refused by the host page 304ms
🟢 iframe form › the code read from one frame applies through the other 319ms
🟢 tests/image-only-ui.e2e.ts · 3 passed 551ms
🟢 image only ui › the icons have no names, so the bare svg locator is ambiguous 130ms
🟢 image only ui › a wrong icon shows the error image and keeps the icons 213ms
🟢 image only ui › tapping the star, then the heart, verifies the icons 208ms
🟢 tests/infinite-scroll.e2e.ts · 1 passed 4.8s
🟢 scrolls the feed until the Golden Ticket loads, then claims it 4.8s
🟢 tests/kanban-board.e2e.ts · 3 passed 822ms
🟢 kanban board › pointer drags move both cards into the goal layout 408ms
🟢 kanban board › a swipe along a path drags a card as well 185ms
🟢 kanban board › a plain tap moves nothing and the untouched board is rejected 229ms
🟢 tests/login-form.e2e.ts · 4 passed 926ms
🟢 login form › rejects a malformed email 195ms
🟢 login form › rejects a short password 199ms
🟢 login form › rejects an unknown account 204ms
🟢 login form › signs in and logs out 328ms
🟢 tests/lying-labels.e2e.ts · 4 passed 919ms
🟢 lying labels › the button whose accessible name says Pay now is the wrong one 207ms
🟢 lying labels › a text match for Pay now catches the decoy phrase too 165ms
🟢 lying labels › the field whose accessible name says Amount is the wrong one 266ms
🟢 lying labels › visible text drives the payment through 281ms
🟢 tests/native-dialogs.e2e.ts · 3 passed 659ms
🟢 native dialogs › answers the confirm, prompt, and alert chain 222ms
🟢 native dialogs › dismissing the confirm cancels the order 212ms
🟢 native dialogs › a wrong gift code is rejected 225ms
🟢 tests/newsletter-signup.e2e.ts · 1 passed 2.4s
🟢 subscribe renders no feedback and logs a TypeError (planted bug) 2.4s
🟢 tests/onboarding-wizard.e2e.ts · 5 passed 6.2s
🟢 onboarding wizard › back keeps what was typed and the brief comes back with it 352ms
🟢 onboarding wizard › the address step takes the brief through its bare-div dropdown 435ms
🟢 onboarding wizard › the profile step steers the calendar three decades back 1.6s
🟢 onboarding wizard › the preferences step flips the toggles the brief names and leaves the trap off 1.8s
🟢 onboarding wizard › the review step repeats the brief and finishes with the PIN 2.0s
🟢 tests/order-history.e2e.ts · 2 passed 1.5s
🟢 order history › overview and settings render their panels 231ms
🟢 order history › the orders tab never leaves its loading state (planted bug) 1.3s
🟢 tests/otp-auto-advance.e2e.ts · 3 passed 1.5s
🟢 otp auto-advance › focus advances with each digit and the full code verifies 502ms
🟢 otp auto-advance › backspace on an empty box clears and refocuses the previous one 161ms
🟢 otp auto-advance › a wrong code clears every box and starts over 808ms
🟢 tests/overlay-trap.e2e.ts · 1 passed 657ms
🟢 continues only after the banner and the overlay are gone 657ms
🟢 tests/playbook-cleanup.e2e.ts · 2 passed 640ms
🟢 playbook cleanup › deleting the draft removes it from an exact-name search 320ms
🟢 playbook cleanup › cancelling the dialog keeps the draft searchable 320ms
🟢 tests/price-sorting.e2e.ts · 3 passed 450ms
🟢 price sorting › opens in the featured order with sale prices struck through 139ms
🟢 price sorting › low to high sorts by the original price, not the paid one (planted bug) 146ms
🟢 price sorting › high to low is the same wrong order reversed (planted bug) 165ms
🟢 tests/product-reviews.e2e.ts · 1 passed 1.2s
🟢 the running-shoe page lists coffee-grinder reviews (planted bug) 1.2s
🟢 tests/promo-storefront.e2e.ts · 1 passed 1.4s
🟢 buys a deal once the promo chrome is out of the way 1.4s
🟢 tests/rich-text-editor.e2e.ts · 2 passed 625ms
🟢 rich text editor › bolding exactly the required word passes the check 309ms
🟢 rich text editor › bold that spills into the previous word fails the check 316ms
🟢 tests/saved-addresses.e2e.ts · 3 passed 714ms
🟢 saved addresses › adds an address and clears the form 250ms
🟢 saved addresses › ignores an add with an empty field 218ms
🟢 saved addresses › delete shows its toast but keeps the address, on retry too (planted bug) 246ms
🟢 tests/shadow-dom-form.e2e.ts · 2 passed 620ms
🟢 shadow DOM form › rejects a wrong access code 302ms
🟢 shadow DOM form › grants access with the code from the hint inside the root 318ms
🟢 tests/smoke.e2e.ts · 1 passed 387ms
🟢 home lists the scenarios and opens one 387ms
🟢 tests/stale-dom.e2e.ts · 1 passed 2.1s
🟢 taps the moving target three times across rebuilds of the list 2.1s
🟢 tests/sticky-chrome.e2e.ts · 1 passed 258ms
🟢 accepts the terms once the button clears the sticky footer 258ms
🟢 tests/virtualized-table.e2e.ts · 1 passed 1m 12s
🟢 scrolls the windowed table to the Golden Row and claims it 1m 12s
🟢 tests/wishlist.e2e.ts · 2 passed 1.7s
🟢 wishlist › saving toggles the button and the tab badge 311ms
🟢 wishlist › the wishlist tab renders the empty state despite the badge count (planted bug) 1.4s

e2e 0.21.1 · 2m 7s · web · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e web agent: 33 passed

34 agent steps · 26 replayed from cache · 20 model calls · 83.4k tokens (90% cached) · $0.0042

All 33 tests in 5 files
Test Agent Time
🟢 tests-agent/control-inventory.e2e.ts · 7 passed 7 steps 8.7s
🟢 control inventory › check sets the checkbox and the radio 1 step 1.2s
🟢 control inventory › check picks a radio the pick replaces with its summary 1 step 457ms
🟢 control inventory › a long press and a double click are chosen over a plain tap 1 step 1.1s
🟢 control inventory › a right-click opens the file menu and Rename renames the file 1 step 2.8s
🟢 control inventory › upload attaches the named project files 1 step 2.5s
🟢 control inventory › back returns from the details view to the inventory 1 step 338ms
🟢 control inventory › scroll_to brings the footnote into view 1 step 334ms
🟢 tests-agent/login-form.e2e.ts · 1 passed 1 step 462ms
🟢 act signs in with the benchmark account 1 step 462ms
🟢 tests-agent/planted-bugs.e2e.ts · 3 passed 4 steps · 7 calls 16.6s
🟢 cart totals: a judgment catches the stale order summary 2 steps · 3 calls 6.8s
🟢 checkout review: a judgment catches the broken copy 1 step · 1 call 2.3s
🟢 wishlist: a judgment catches the lost saved items 1 step · 3 calls 7.5s
🟢 tests-agent/scenarios.e2e.ts · 21 passed 21 steps · 13 calls 2m 39s
🟢 act completes shadow-dom-form 1 step · 3 calls 6.0s
🟢 act completes lying-labels 1 step · 4 calls 10.5s
🟢 act completes iframe-form 1 step · 3 calls 6.3s
🟢 act completes infinite-scroll 1 step 6.3s
🟢 act completes virtualized-table 1 step 1m 28s
🟢 act completes overlay-trap 1 step 1.3s
🟢 act completes sticky-chrome 1 step 1.4s
🟢 act completes async-states 1 step · 3 calls 9.8s
🟢 act completes debounced-search 1 step 2.2s
🟢 act completes hover-menu 1 step 1.6s
🟢 act completes drag-and-drop 1 step 836ms
🟢 act completes kanban-board 1 step 1.2s
🟢 act completes context-menu-trap 1 step 3.7s
🟢 act completes stale-dom 1 step 1.1s
🟢 act completes otp-auto-advance 1 step 1.1s
🟢 act completes date-picker 1 step 1.4s
🟢 act completes rich-text-editor 1 step 11.2s
🟢 act completes playbook-cleanup 1 step 809ms
🟢 act completes promo-storefront 1 step 1.4s
🟢 act completes gift-card-purchase 1 step 2.7s
🟢 act filters the list and the URL carries the filter 1 step 332ms
🟢 tests-agent/unique-cache.e2e.ts · 1 passed 1 step 390ms
🟢 act adds an address with a run-unique label 1 step 390ms

e2e 0.21.1 · 3m 7s · web · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e ios: 53 passed, 1 skipped

All 54 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 23 passed, 1 skipped 3m 33s
🟢 control inventory › a label query resolves a labeled text field 12.0s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 17.5s
🟢 control inventory › a placeholder query and attribute reads find the field 5.2s
🟢 control inventory › a secure field takes a fill and denies value reads 10.6s
🟢 control inventory › press sends a character and Enter through the soft keyboard 8.1s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 12.4s
🟢 control inventory › toBeFocused follows the focus 10.0s
🟢 control inventory › a switch checks, unchecks, and reports its state 11.9s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 9.8s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 15.2s
🟢 control inventory › a radio group reports the checked option 10.6s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 9.5s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 9.8s
🟢 control inventory › a header answers its accessible name 5.7s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 9.8s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 9.4s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 9.7s
🟢 control inventory › pointer verbs land at the point asked for 11.7s
🟢 control inventory › an ambiguous locator fails at once 6.8s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 15.2s
🟢 refusals › verbs a device never declares are refused before the engine 3ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 910ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.4s
🟢 tests/device-fixture.e2e.ts · 10 passed 1m 37s
🟢 device fixture › setAppearance flips the color scheme the app reads 14.9s
🟢 device fixture › setOrientation rotates the window the app measures 7.2s
🟢 device fixture › the clipboard reads back what was written 6.5s
🟢 device fixture › home leaves the app, openApp brings it back where it was 5.6s
🟢 device fixture › closeApp then openApp relaunches on the home list 7.9s
🟢 device fixture › closeApp leaves the next commands on the same device 14.3s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 7.5s
🟢 device fixture › device.back pops the scenario 7.9s
🟢 device fixture › setLocation and clearLocation change what the app reads 13.5s
🟢 device fixture › enrollBiometrics and setBiometrics answer a biometric prompt 11.8s
🟢 tests/device.e2e.ts · 2 passed 58.9s
🟢 sequential onboarding echoes the exact values 43.4s
🟢 onboarding rejects a malformed email before advancing 15.6s
🟢 tests/flows-lists.e2e.ts · 7 passed 3m 40s
🟢 infinite scroll reaches the target item 31.2s
🟢 product catalog adds exactly two of the right variant 11.4s
🟢 gestures: long-press, then swipe left 10.4s
🟢 sticky chrome: accept below the fold, then continue 12.7s
🟢 async states: load, pull to refresh, claim through the toast 12.4s
🟢 huge virtualized list reaches row 512 2m 7s
🟢 web view coupon form applies the code shown on the page 14.5s
🟢 tests/flows.e2e.ts · 7 passed 1m 17s
🟢 text inputs unlock the submit button 15.9s
🟢 filled text inputs report their values 11.5s
🟢 modal flow confirms through the native alert 11.9s
🟢 bottom tabs act inside the last tab 8.8s
🟢 error recovery retries, then confirms the delete 10.2s
🟢 choice controls place the exact order 8.6s
🟢 debounced search selects the target once results arrive 10.4s
🟢 tests/login-form.e2e.ts · 3 passed 44.9s
🟢 login form › rejects a malformed email 12.1s
🟢 login form › rejects an unknown account 12.1s
🟢 login form › signs in and logs out 20.7s
🟢 tests/smoke.e2e.ts · 1 passed 9.8s
🟢 home lists the scenarios and opens one 9.8s

e2e 0.21.1 · 6m 16s · ios-simulator · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e android: 55 passed, 1 skipped

All 56 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 24 passed, 1 skipped 3m 47s
🟢 control inventory › a label query resolves a labeled text field 29.3s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 16.8s
🟢 control inventory › a placeholder query and attribute reads find the field 7.3s
🟢 control inventory › a secure field takes a fill and denies value reads 8.7s
🟢 control inventory › press sends a character and Enter through the soft keyboard 9.6s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 14.7s
🟢 control inventory › toBeFocused follows the focus 13.5s
🟢 control inventory › a switch checks, unchecks, and reports its state 14.6s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 8.8s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 13.5s
🟢 control inventory › a tab role answers getByRole 5.3s
🟢 control inventory › a radio group reports the checked option 10.0s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 9.4s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 7.5s
🟢 control inventory › a header answers its accessible name 4.8s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 6.9s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 6.8s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 8.8s
🟢 control inventory › a double tap lands inside the 300 ms window 9.1s
🟢 control inventory › an ambiguous locator fails at once 6.0s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 13.7s
🟢 refusals › verbs a device never declares are refused before the engine 6ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 187ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device-fixture.e2e.ts · 9 passed 1m 30s
🟢 device fixture › setOrientation rotates the window the app measures 7.2s
🟢 device fixture › home leaves the app, openApp brings it back where it was 7.8s
🟢 device fixture › foregroundApp sees the home screen after home() 5.5s
🟢 device fixture › closeApp then openApp relaunches on the home list 9.1s
🟢 device fixture › closeApp leaves the next commands on the same device 9.5s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 5.9s
🟢 device fixture › device.back pops the scenario 6.5s
🟢 device fixture › setNetwork and setAirplaneMode change what the app sees 18.2s
🟢 device fixture › setLocation and clearLocation change what the app reads 20.3s
🟢 tests/device.e2e.ts · 4 passed 49.3s
🟢 permission prompt › allowing the system dialog enables the microphone 9.3s
🟢 permission prompt › a denied prompt recovers once the permission is granted outside 17.9s
🟢 sequential onboarding echoes the exact values 13.2s
🟢 onboarding rejects a malformed email before advancing 8.8s
🟢 tests/flows-lists.e2e.ts · 7 passed 2m 53s
🟢 infinite scroll reaches the target item 23.9s
🟢 product catalog adds exactly two of the right variant 13.0s
🟢 gestures: long-press, then swipe left 10.1s
🟢 gestures: double-tap completes the flow 11.7s
🟢 sticky chrome: accept below the fold, then continue 16.0s
🟢 async states: load, pull to refresh, claim through the toast 13.9s
🟢 huge virtualized list reaches row 512 1m 25s
🟢 tests/flows.e2e.ts · 7 passed 1m 3s
🟢 text inputs unlock the submit button 9.0s
🟢 filled text inputs report their values 7.9s
🟢 modal flow confirms through the native alert 10.2s
🟢 bottom tabs act inside the last tab 7.8s
🟢 error recovery retries, then confirms the delete 9.1s
🟢 choice controls place the exact order 10.3s
🟢 debounced search selects the target once results arrive 8.6s
🟢 tests/login-form.e2e.ts · 3 passed 31.3s
🟢 login form › rejects a malformed email 9.1s
🟢 login form › rejects an unknown account 9.1s
🟢 login form › signs in and logs out 13.1s
🟢 tests/smoke.e2e.ts · 1 passed 8.1s
🟢 home lists the scenarios and opens one 8.1s

e2e 0.21.1 · 10m 42s · android-emulator · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e android agent: 20 passed

24 agent steps · 15 replayed from cache · 43 model calls · 254.6k tokens (77% cached) · $0.0204

All 20 tests in 1 file
Test Agent Time
🟢 tests-agent/scenarios.e2e.ts · 20 passed 24 steps · 43 calls 10m 48s
🟢 act completes Login Form 1 step 53.8s
🟢 act completes Infinite Scroll List 1 step 37.5s
🟢 act completes Modal Flow 1 step 18.2s
🟢 act completes Bottom Tabs 1 step 13.5s
🟢 act completes Text Input Variations 1 step 15.7s
🟢 act completes Broken Accessibility 2 steps · 5 calls 53.4s
🟢 act completes Vision Only 2 steps · 1 call 14.0s
🟢 act completes Gestures 1 step · 9 calls 1m 6s
🟢 act completes Async States 1 step · 16 calls 2m 2s
🟢 act completes Debounced Search 1 step 7.9s
🟢 act completes Huge Virtualized List 1 step 1m 25s
🟢 act completes Flattened Registration Form 2 steps · 1 call 15.7s
🟢 act completes Flattened Login 2 steps · 6 calls 51.0s
🟢 act completes Sticky Chrome Target 1 step 11.3s
🟢 act completes WebView Accessibility 1 step · 5 calls 23.3s
🟢 act completes Permission Prompt 1 step 8.4s
🟢 act completes Product Catalog 1 step 11.9s
🟢 act completes Error Recovery 1 step 10.5s
🟢 act completes Choice Controls 1 step 15.4s
🟢 act completes Sequential Onboarding 1 step 14.4s

e2e 0.21.1 · 10m 49s · android-emulator · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e ios agent: 21 passed, 1 skipped

25 agent steps · 10 replayed from cache · 69 model calls · 421.6k tokens (81% cached) · $0.0301

All 22 tests in 1 file
Test Agent Time
⏭️ tests-agent/scenarios.e2e.ts · 21 passed, 1 skipped 25 steps · 69 calls 14m 15s
🟢 act completes Login Form 1 step · 10 calls 1m 44s
🟢 act completes Infinite Scroll List 1 step 45.8s
🟢 act completes Modal Flow 1 step 14.7s
🟢 act completes Bottom Tabs 1 step 11.0s
🟢 act completes Text Input Variations 1 step 19.6s
🟢 act completes Broken Accessibility 2 steps · 6 calls 1m 2s
🟢 act completes Vision Only 2 steps · 6 calls 48.4s
🟢 act completes Gestures 1 step · 11 calls 1m 34s
🟢 act completes Async States 1 step · 7 calls 45.9s
🟢 act completes Debounced Search 1 step · 3 calls 25.1s
🟢 act completes Flattened Registration Form 2 steps · 1 call 35.6s
🟢 act completes Flattened Login 2 steps · 11 calls 1m 45s
🟢 act completes Sticky Chrome Target 1 step 20.7s
🟢 act completes WebView Accessibility 1 step 14.5s
🟢 act completes Permission Prompt 1 step · 2 calls 34.0s
🟢 act completes Photo Picker 1 step · 2 calls 30.6s
🟢 act completes Product Catalog 1 step 11.6s
🟢 act completes Error Recovery 1 step 11.6s
🟢 act completes Choice Controls 1 step · 5 calls 49.4s
🟢 act completes Stripe PaymentSheet 1 step · 5 calls 58.6s
🟢 act completes Apple Pay 1 step 12.1s
⏭️ act completes Apple Pay Billing Address (skipped: the CI simulator's Apple Pay sheet skips the billing-address step, so the scenario cannot be completed there)

e2e 0.21.1 · 14m 15s · ios-simulator · run artifacts

@okwasniewski
okwasniewski merged commit fc5c350 into main Oct 15, 2026
29 checks passed
@okwasniewski
okwasniewski deleted the oskar/bump-agent-device branch October 15, 2026 16:36
amankansal-lt added a commit to LambdaTest/e2e that referenced this pull request Oct 16, 2026
Keep upstream's @e2e-dev/lightpanda in CONTRIBUTING.md and the root build
and test scripts, next to @e2e-dev/testmu. Upstream moved @e2e-dev/mobile to
agent-device 0.21.28 (tester-army#1181), so @e2e-dev/testmu's agent-device and
@agent-device/testmu pins follow.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant