- Refactor elasticity retry logic into a reusable private method. by @copybara-service[bot] in #177
- Add a name parameter to the watchdog context manager. by @copybara-service[bot] in #199
- Use abstract types for return type hints in pathwaysutils. by @copybara-service[bot] in #198
- Update environment variables for JAX backend by @copybara-service[bot] in #203
- Enable Pathways profiling with jax.profiler.ProfileOptions. by @copybara-service[bot] in #201
- Refactor elastic retry decorators into a single elastic_retry method. by @copybara-service[bot] in #202
- Fix JaxRuntimeError during profiler stop_trace with profile options by @copybara-service[bot] in #205
- Add CLI mode to Shared Pathways Service by @copybara-service[bot] in #200
- Fix --proxy_options to use flags.DEFINE_list by @copybara-service[bot] in #191
- Refactor: Simplify Elasticity Manager to focus on slice availability. by @copybara-service[bot] in #167
- Make Pathways proxy server image user-configurable by @copybara-service[bot] in #159
- This change introduces reshard_with_intermediate_sharding which will first look for intermediate shardings, perform all intermediate resharding, and then perform the final reshard into the out sharding. by @copybara-service[bot] in #145
- Update active_slice_indices after waiting for slices within pause-resume. by @copybara-service[bot] in #174
- Add cleanup to restore JAX config and environment variables in tests. by @copybara-service[bot] in #185
- Change Pathways backend target from
localhostto127.0.0.1by @copybara-service[bot] in #186 - Move ifrt based reshard out of experimental. Leaving intermediate resharding and sidechannel resharding in experimental. by @copybara-service[bot] in #176
- Add support for passing environment variables to the Pathways proxy by @copybara-service[bot] in #187
- Extract lambda to a named function to ensure cache hits. by @copybara-service[bot] in #127
- Always write array metadata if self._array_metadata_store is not None. by @copybara-service[bot] in #125
- Add "Shared Pathways Service" for Pathways-on-Cloud by @copybara-service[bot] in #128
- Exposes
pathwaysutils.profiling._start_trace_from_profile_requestaspathwaysutils.experimental.profiling.start_trace. by @copybara-service[bot] in #141 - Patch internal JAX profiler functions (enabling
jax.profiler.trace) and add a test forjax.profiler.trace. by @copybara-service[bot] in #140 - Expose
_split_by_mesh_axisdirectly inpw_jax. by @copybara-service[bot] in #147 - Use Pathways
_transfer_to_shardingfor resharding in experimental reshard API. by @copybara-service[bot] in #148 - Allow specifying a custom proxy job name in _ISCPathways by @copybara-service[bot] in #157
- Update the github action for PyPI by @lukebaumann in #105
- Expose
is_pathways_backend_usedinpathwaysutils. by @copybara-service[bot] in #107 - Treat additional error types as potential slice down issues. by @copybara-service[bot] in #109
- Adding split_by_mesh_axis to experimental for use by a new experimental reshard. by @copybara-service[bot] in #112
- Update pathways.experimental.reshard so that PyTrees with arrays that have different device sets can be resharded. by @copybara-service[bot] in #113
- Update GitHub action unittest matrix by @lukebaumann in #111
- Handle new style PRNG keys in
reshardandCloudPathwaysArrayHandler
- Updates to Pathways orbax handler. In #81 #89 #90
- Improvements to pathwaysutils/elastic by @copybara-service[bot] inhttps://github.com//pull/72 #84 #85 #86 #99 #100 #102
- Handle JAX API interface compatibility by @copybara-service[bot] in #88 #93 #95
- Adding jax version to the github actions matrix by @lukebaumann in #94
- Added LRU cache and tests to pathwaysutils. by @copybara-service[bot] in #83
- Moving initialization logic into its own module by @copybara-service[bot] in #96
- Port the
collect_profilescript from JAX to PathwaysUtils - Remove support for legacy initialize
- Add collect_profile as a script of pathwaysutils
- Make CloudPathwaysArrayHandler compatible with async directory creation feature in orbax
- Bump the JAX requirement to 0.5.1
- Introduce
pathwaysutils.initialize()to remove relying on side-effects fromimport pathwaysutils. by @copybara-service in #47 - Add a test for proxy backend registration by @copybara-service in #55
- Adding debugging utilities by @copybara-service in #57
- Adding an elastic manager and reshard modules by @copybara-service in #58
- Update README for Colocated Python Sidecar. by @copybara-service in #60
- Disabled JAX's compilation cache
- Updated Orbax handler to use bulk APIs
- Updates to support JAX 0.5.0
- Updated
setup.pytopyproject.toml - Added this changelog
- Added unittests
- Prepared for PyPI release
- Decreased logging severity for most logs
- Persistence enabled
- General argument type fixes