MaxView

← Back to run

Log Summary

2026-04-16 13:56:12.787810: E external/local_xla/xla/stream_executor/cuda/cuda_platform.cc:51] failed call to cuInit: INTERNAL: CUDA error: Failed call to cuInit: UNKNOWN ERROR (303)
I0416 13:56:12.904119 135040099175552 max_utils.py:238] Skipping jax distributed system due to skip_jax_distributed_system=True flag.
I0416 13:56:45.196086 135040099175552 max_utils.py:800] System Information: Jax Version: 0.9.2
I0416 13:56:45.196204 135040099175552 max_utils.py:801] System Information: Jaxlib Version: 0.9.2
I0416 13:56:45.196240 135040099175552 max_utils.py:802] System Information: Jax Backend: PJRT C API
TFRT TPU v6 lite
Built on Apr 6 2026 20:48:10 (1775533690) cl/895581894
I0416 13:56:45.196267 135040099175552 train_utils.py:334] WARNING: 'dataset_path' might be pointing your local file system
I0416 13:56:45.196290 135040099175552 train_utils.py:347] WARNING: Sequence packing is essentially ignored for synthetic data. Please use a real dataset to use sequence packing.
I0416 13:56:45.196373 135040099175552 train.py:683] [DECOUPLED NO-OP] skipping cloud diagnostics wrapper.
W0416 13:56:45.288904 3897811 pjrt_executable.cc:642] Assume version compatibility. PjRt-IFRT does not track XLA executable versions.
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "~/maxtext/src/maxtext/trainers/pre_train/train.py", line 724, in <module>
    app.run(main)
  File "~/maxtext_venv/lib/python3.12/site-packages/absl/app.py", line 316, in run
    _run_main(main, args)
  File "~/maxtext_venv/lib/python3.12/site-packages/absl/app.py", line 261, in _run_main
    sys.exit(main(argv))
             ^^^^^^^^^^
  File "~/maxtext/src/maxtext/trainers/pre_train/train.py", line 720, in main
    train_func()
  File "~/maxtext/src/maxtext/trainers/pre_train/train.py", line 710, in train_func
    run(config, recorder, diagnostic_config)
  File "~/maxtext/src/maxtext/trainers/pre_train/train.py", line 689, in run
    train_loop(config, recorder)
  File "~/maxtext/src/maxtext/trainers/pre_train/train.py", line 516, in train_loop
    ) = train_utils.setup_train_loop(config, recorder)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "~/maxtext/src/maxtext/utils/train_utils.py", line 217, in setup_train_loop
    raise NotImplementedError("Pure NNX support has not been implemented yet.")
NotImplementedError: Pure NNX support has not been implemented yet.
[DECOUPLED NO-OP] gcs_storage: using stubs.
[DECOUPLED NO-OP] mldiagnostics: using stub.
[DECOUPLED NO-OP] mldiagnostics: using stub.
[DECOUPLED NO-OP] mldiagnostics: using stub.
[DECOUPLED NO-OP] workload_monitor: using stub.
[DECOUPLED NO-OP] vertex_tensorboard: using stub.