Tpu7x recipe gcs by seonjunmoon · Pull Request #174 · AI-Hypercomputer/tpu-recipes

seonjunmoon · 2026-03-05T17:34:44Z

No description provided.

…aloading / checkpointing settings

…o tpu7x-recipe-gcs

…instructions in README

…nvironment configuration instructions for the DeepSeek3-671B workload

…equisites to the DeepSeek3-671B training README.

…environment variables and workload priority in run_recipe.sh

…and checkpoint

…guments

…ange in README

junjieqian

LGTM.. but please get an approval from storage TLs as well.
Thank you

…e bucket location in README.md

…t mount path in run_recipe.sh

seonjunmoon added 8 commits January 8, 2026 22:50

Add a recipe for deepseek3-671b/4k-bf16-tpu7x-4x4x8

94a4e53

Remove outdated deepseek3-671b tpu7x gcs recipe

e82597a

Add a recipe for deepseek3-671b/4k-bf16-tpu7x-4x8x8

9d078df

Configure DeepSeekV3 recipe with GCS storage configs and advanced dat…

f5381e8

…aloading / checkpointing settings

Merge branch 'main' of https://github.com/seonjunmoon/tpu-recipes int…

930ed78

…o tpu7x-recipe-gcs

Add XLA DVFS p-state and checkpoint storage concurrent GB parameters

1a1d58d

Replace detailed XPK workload setup with focused GCS bucket creation …

28e6835

…instructions in README

Update README with comprehensive XPK setup, Docker image build, and e…

bc02432

…nvironment configuration instructions for the DeepSeek3-671B workload

lepan-google reviewed Mar 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

lepan-google reviewed Mar 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md

lepan-google reviewed Mar 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

lepan-google reviewed Mar 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

Add detailed introduction, workload specifics, and comprehensive prer…

135b86a

…equisites to the DeepSeek3-671B training README.

lepan-google reviewed Mar 9, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

seonjunmoon added 3 commits March 10, 2026 18:37

Add workload configuration instructions to README and update default …

fdc05ff

…environment variables and workload priority in run_recipe.sh

Add PV/PVC setup instructions to the README

5a15621

Add PVC files and documentation for GCSFuse PV/PVC setup for dataset …

62244a2

…and checkpoint

seonjunmoon requested a review from lepan-google March 12, 2026 22:21

Update XPK version and refine MaxText training script with updated ar…

df68378

…guments

mkmg reviewed Mar 23, 2026

View reviewed changes

seonjunmoon added 2 commits March 24, 2026 21:02

Update XPK configuration and software versions

86fa183

Remove unused checkpoint PVC

739644a

seonjunmoon requested a review from mkmg March 24, 2026 21:07

seonjunmoon marked this pull request as ready for review March 30, 2026 22:53

mkmg reviewed Mar 31, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

seonjunmoon added 2 commits March 31, 2026 23:34

Relocate GCS bucket setup section and update Libtpu version

fc6c2d4

Update xpk installation script version to v1.8.0

819b942

seonjunmoon requested a review from mkmg March 31, 2026 23:39

Update xpk storage attach command and remove unnecessary directory ch…

14e7a3f

…ange in README

junjieqian reviewed Apr 1, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh

Clear default environment variable values and update documentation

705ff66

seonjunmoon requested a review from junjieqian April 2, 2026 22:40

junjieqian reviewed Apr 3, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

junjieqian approved these changes Apr 3, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh

Remove redundant MAXTEXT_ROOT path from run_recipe.sh and parameteriz…

f7c1c28

…e bucket location in README.md

mkmg reviewed Apr 3, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

Remove duplicated bucket creation instructions and set default datase…

ce4de41

…t mount path in run_recipe.sh

seonjunmoon requested a review from mkmg April 3, 2026 21:09

mkmg reviewed Apr 3, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

Update BASE_OUTPUT_DIR to use GCS bucket path in README

748a9f8

seonjunmoon requested a review from mkmg April 3, 2026 22:32

Add dataset bucket name configuration and update build script paths

d8a94f6

mkmg reviewed Apr 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/README.md Outdated

mkmg reviewed Apr 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

mkmg reviewed Apr 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

Update dataset storage reference from bucket name to volume name

e373435

seonjunmoon requested a review from mkmg April 6, 2026 21:16

mkmg reviewed Apr 6, 2026

View reviewed changes

Comment thread training/ironwood/deepseek3-671b/4k-bf16-tpu7x-4x8x8-gcs/xpk/run_recipe.sh Outdated

Remove comment from DATASET_VOLUME_NAME

7c83b42

seonjunmoon requested a review from mkmg April 6, 2026 22:39

mkmg approved these changes Apr 6, 2026

View reviewed changes

junjieqian merged commit a66b576 into AI-Hypercomputer:main Apr 13, 2026
1 check passed

Conversation

seonjunmoon commented Mar 5, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

junjieqian left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

junjieqian left a comment •

edited

Loading