Skip to content

Integrate metrics collection into ISC Pathways#214

Open
copybara-service[bot] wants to merge 1 commit intomainfrom
test_899626835
Open

Integrate metrics collection into ISC Pathways#214
copybara-service[bot] wants to merge 1 commit intomainfrom
test_899626835

Conversation

@copybara-service
Copy link
Copy Markdown

Integrate metrics collection into ISC Pathways

This change introduces a new metrics_collector module to track key metrics within the ISC Pathways client. The _ISCPathways context manager initializes and uses the MetricsCollector to record the below metrics if collect_isc_metrics flag is enabled:

  • Active user count on context entry and exit
  • Capacity in use based on requested TPU instances
  • Assignment time upon successful TPU placement
  • Successful request count
  • Low capacity failures when "FAILED_PRECONDITION" is detected in proxy logs

This change introduces a new `metrics_collector` module to track key metrics within the ISC Pathways client. The `_ISCPathways` context manager initializes and uses the `MetricsCollector` to record the below metrics if `collect_isc_metrics` flag is enabled:
-   Active user count on context entry and exit
-   Capacity in use based on requested TPU instances
-   Assignment time upon successful TPU placement
-   Successful request count
-   Low capacity failures when "FAILED_PRECONDITION" is detected in proxy logs

PiperOrigin-RevId: 899626835
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant