Correspondance from Legacy to Trainer#
If you are already familiar with the Legacy YAML specification and just want to find out how to specify a specific parameter in the Trainer YAML specification, please refer to the tables below.
eval_input
#
Legacy Specification |
Trainer Specification |
eval_input:
...
|
trainer:
fit:
val_dataloader:
...
trainer:
validate:
val_dataloader:
...
trainer:
validate_all:
val_dataloaders:
...
|
eval_input.micro_batch_size
#
Legacy Specification |
Trainer Specification |
eval_input:
micro_batch_size: ...
|
trainer:
init:
callbacks:
- ScopedValidateFlags:
csx.performance.micro_batch_size: ...
|
model
#
Legacy Specification |
Trainer Specification |
model:
...
|
trainer:
init:
model:
...
|
model.fp16_type
#
Legacy Specification |
Trainer Specification |
model:
fp16_type: ...
|
trainer:
init:
precision:
fp16_type: ...
|
Note
Some models expect this parameter and thus should be specified under
trainer.init.model
as well.
model.mixed_precision
#
Legacy Specification |
Trainer Specification |
model:
mixed_precision: ...
|
trainer:
init:
precision:
enabled: ...
|
Note
Some models expect this parameter and thus should be specified under
trainer.init.model
as well.
optimizer
#
Legacy Specification |
Trainer Specification |
optimizer:
...
|
trainer:
init:
optimizer:
...
|
optimizer.grad_accum_steps
#
Legacy Specification |
Trainer Specification |
optimizer:
grad_accum_steps: ...
|
trainer:
init:
loop:
grad_accum_steps: ...
|
optimizer.initial_loss_scale
#
Legacy Specification |
Trainer Specification |
optimizer:
initial_loss_scale: ...
|
trainer:
init:
precision:
initial_loss_scale: ...
|
optimizer.learning_rate
#
Legacy Specification |
Trainer Specification |
optimizer:
learning_rate:
...
|
trainer:
init:
schedulers:
...
|
optimizer.log_summaries
#
Legacy Specification |
Trainer Specification |
optimizer:
log_summaries: ...
|
trainer:
init:
callbacks:
- ComputeNorm: ...
trainer:
init:
precision:
log_loss_scale: ...
|
optimizer.loss_scaling_factor
#
Legacy Specification |
Trainer Specification |
optimizer:
loss_scaling_factor: ...
|
trainer:
init:
precision:
loss_scaling_factor: ...
|
optimizer.max_gradient_norm
#
Legacy Specification |
Trainer Specification |
optimizer:
max_gradient_norm: ...
|
trainer:
init:
precision:
max_gradient_norm: ...
|
optimizer.max_gradient_value
#
Legacy Specification |
Trainer Specification |
optimizer:
max_gradient_value: ...
|
trainer:
init:
precision:
max_gradient_value: ...
|
optimizer.max_loss_scale
#
Legacy Specification |
Trainer Specification |
optimizer:
max_loss_scale: ...
|
trainer:
init:
precision:
max_loss_scale: ...
|
optimizer.min_loss_scale
#
Legacy Specification |
Trainer Specification |
optimizer:
min_loss_scale: ...
|
trainer:
init:
precision:
min_loss_scale: ...
|
optimizer.steps_per_increase
#
Legacy Specification |
Trainer Specification |
optimizer:
steps_per_increase: ...
|
trainer:
init:
precision:
steps_per_increase: ...
|
runconfig.act_memory_gi
#
Legacy Specification |
Trainer Specification |
runconfig:
act_memory_gi: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.act_memory_gi: ...
|
runconfig.autoload_last_checkpoint
#
Legacy Specification |
Trainer Specification |
runconfig:
autoload_last_checkpoint: ...
|
trainer:
init:
checkpoint:
autoload_last_checkpoint: ...
|
runconfig.check_loss_values
#
Legacy Specification |
Trainer Specification |
runconfig:
check_loss_values: ...
|
trainer:
init:
callbacks:
- CheckLoss: ...
|
runconfig.checkpoint_path
#
Legacy Specification |
Trainer Specification |
runconfig:
checkpoint_path: ...
|
trainer:
fit:
ckpt_path: ...
trainer:
validate:
ckpt_path: ...
trainer:
validate_all:
ckpt_paths: ...
|
runconfig.checkpoint_steps
#
Legacy Specification |
Trainer Specification |
runconfig:
checkpoint_steps: ...
|
trainer:
init:
checkpoint:
steps: ...
|
runconfig.cmd_memory_gi
#
Legacy Specification |
Trainer Specification |
runconfig:
cmd_memory_gi: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.cmd_memory_gi: ...
|
runconfig.compile_crd_memory_gi
#
Legacy Specification |
Trainer Specification |
runconfig:
compile_crd_memory_gi: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.compile_crd_memory_gi: ...
|
runconfig.compile_dir
#
Legacy Specification |
Trainer Specification |
runconfig:
compile_dir: ...
|
trainer:
init:
backend:
compile_dir: ...
|
runconfig.compile_only
#
Legacy Specification |
Trainer Specification |
runconfig:
compile_only: ...
|
trainer:
init:
backend:
compile_only: ...
|
runconfig.credentials_path
#
Legacy Specification |
Trainer Specification |
runconfig:
credentials_path: ...
|
trainer:
init:
backend:
cluster_config:
credentials_path: ...
|
runconfig.debug_args
#
Legacy Specification |
Trainer Specification |
runconfig:
debug_args:
...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.debug_args:
...
|
runconfig.debug_args_path
#
Legacy Specification |
Trainer Specification |
runconfig:
debug_args_path: ...
|
trainer:
init:
callbacks:
- DebugArgsPath:
debug_args_path: ...
|
runconfig.disable_strict_checkpoint_loading
#
Legacy Specification |
Trainer Specification |
runconfig:
disable_strict_checkpoint_loading: ...
|
trainer:
init:
checkpoint:
disable_strict_checkpoint_loading: ...
|
runconfig.disable_version_check
#
Legacy Specification |
Trainer Specification |
runconfig:
disable_version_check: ...
|
trainer:
init:
backend:
cluster_config:
disable_version_check: ...
|
runconfig.dist_backend
#
Legacy Specification |
Trainer Specification |
runconfig:
dist_backend: ...
|
trainer:
init:
backend:
dist_backend: ...
|
runconfig.drop_data
#
Legacy Specification |
Trainer Specification |
runconfig:
drop_data: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.drop_data: ...
|
runconfig.dump_activations
#
Legacy Specification |
Trainer Specification |
runconfig:
dump_activations: ...
|
trainer:
init:
callbacks:
- DumpActivations: ...
|
runconfig.enable_act_frequency
#
Legacy Specification |
Trainer Specification |
runconfig:
enable_act_frequency: ...
|
trainer:
init:
logging:
enable_act_frequency: ...
|
runconfig.enable_distributed
#
Legacy Specification |
Trainer Specification |
runconfig:
enable_distributed: ...
|
trainer:
init:
backend:
enable_distributed: ...
|
runconfig.eval_frequency
#
Legacy Specification |
Trainer Specification |
runconfig:
eval_frequency: ...
|
trainer:
init:
loop:
eval_frequency: ...
|
runconfig.eval_steps
#
Legacy Specification |
Trainer Specification |
runconfig:
eval_steps: ...
|
trainer:
init:
loop:
eval_steps: ...
|
runconfig.execute_crd_memory_gi
#
Legacy Specification |
Trainer Specification |
runconfig:
execute_crd_memory_gi: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.execute_crd_memory_gi: ...
|
runconfig.experimental.listeners
#
Legacy Specification |
Trainer Specification |
runconfig:
experimental:
listeners:
...
|
trainer:
init:
callbacks:
- Listener:
listeners:
...
|
runconfig.init_method
#
Legacy Specification |
Trainer Specification |
runconfig:
init_method: ...
|
trainer:
init:
backend:
init_method: ...
|
runconfig.job_labels
#
Legacy Specification |
Trainer Specification |
runconfig:
job_labels:
...
|
trainer:
init:
backend:
cluster_config:
job_labels:
...
|
runconfig.job_priority
#
Legacy Specification |
Trainer Specification |
runconfig:
job_priority: ...
|
trainer:
init:
backend:
cluster_config:
job_priority: ...
|
runconfig.job_time_sec
#
Legacy Specification |
Trainer Specification |
runconfig:
job_time_sec: ...
|
trainer:
init:
backend:
cluster_config:
job_time_sec: ...
|
runconfig.lazy_initialization
#
Legacy Specification |
Trainer Specification |
runconfig:
lazy_initialization: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.lazy_initialization: ...
|
runconfig.load_checkpoint_states
#
Legacy Specification |
Trainer Specification |
runconfig:
load_checkpoint_states: ...
|
trainer:
init:
callbacks:
- LoadCheckpointStates:
load_checkpoint_states: ...
|
runconfig.log_initialization
#
Legacy Specification |
Trainer Specification |
runconfig:
log_initialization: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.log_initialization: ...
|
runconfig.log_input_summaries
#
Legacy Specification |
Trainer Specification |
runconfig:
log_input_summaries: ...
|
trainer:
init:
callbacks:
- LogInputSummaries: ...
|
runconfig.log_steps
#
Legacy Specification |
Trainer Specification |
runconfig:
log_steps: ...
|
trainer:
init:
logging:
log_steps: ...
|
runconfig.logging
#
Legacy Specification |
Trainer Specification |
runconfig:
logging: ...
|
trainer:
init:
logging:
log_level: ...
|
runconfig.main_process_id
#
Legacy Specification |
Trainer Specification |
runconfig:
main_process_id: ...
|
trainer:
init:
backend:
main_process_id: ...
|
runconfig.max_checkpoints
#
Legacy Specification |
Trainer Specification |
runconfig:
max_checkpoints: ...
|
trainer:
init:
callbacks:
- KeepNCheckpoints:
n: ...
|
runconfig.max_steps
#
Legacy Specification |
Trainer Specification |
runconfig:
max_steps: ...
|
trainer:
init:
loop:
max_steps: ...
|
runconfig.mgmt_address
#
Legacy Specification |
Trainer Specification |
runconfig:
mgmt_address: ...
|
trainer:
init:
backend:
cluster_config:
mgmt_address: ...
|
runconfig.mgmt_namespace
#
Legacy Specification |
Trainer Specification |
runconfig:
mgmt_namespace: ...
|
trainer:
init:
backend:
cluster_config:
mgmt_namespace: ...
|
runconfig.model_dir
#
Legacy Specification |
Trainer Specification |
runconfig:
model_dir: ...
|
trainer:
init:
model_dir: ...
|
runconfig.mount_dirs
#
Legacy Specification |
Trainer Specification |
runconfig:
mount_dirs:
...
|
trainer:
init:
backend:
cluster_config:
mount_dirs:
...
|
runconfig.num_act_servers
#
Legacy Specification |
Trainer Specification |
runconfig:
num_act_servers: ...
|
trainer:
init:
backend:
cluster_config:
max_act_per_csx: ...
|
runconfig.num_csx
#
Legacy Specification |
Trainer Specification |
runconfig:
num_csx: ...
|
trainer:
init:
backend:
cluster_config:
num_csx: ...
|
runconfig.num_epochs
#
Legacy Specification |
Trainer Specification |
runconfig:
num_epochs: ...
|
trainer:
init:
loop:
num_epochs: ...
|
runconfig.num_steps
#
Legacy Specification |
Trainer Specification |
runconfig:
num_steps: ...
|
trainer:
init:
loop:
num_steps: ...
|
runconfig.num_wgt_servers
#
Legacy Specification |
Trainer Specification |
runconfig:
num_wgt_servers: ...
|
trainer:
init:
backend:
cluster_config:
max_wgt_servers: ...
|
runconfig.num_workers_per_csx
#
Legacy Specification |
Trainer Specification |
runconfig:
num_workers_per_csx: ...
|
trainer:
init:
backend:
cluster_config:
num_workers_per_csx: ...
|
runconfig.op_profiler_config
#
Legacy Specification |
Trainer Specification |
runconfig:
op_profiler_config:
...
|
trainer:
init:
callbacks:
- OpProfiler:
...
|
runconfig.precision_opt_level
#
Legacy Specification |
Trainer Specification |
runconfig:
precision_opt_level: ...
|
trainer:
init:
precision:
precision_opt_level: ...
|
runconfig.python_paths
#
Legacy Specification |
Trainer Specification |
runconfig:
python_paths:
...
|
trainer:
init:
backend:
cluster_config:
python_paths:
...
|
runconfig.retrace_every_iteration
#
Legacy Specification |
Trainer Specification |
runconfig:
retrace_every_iteration: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.retrace_every_iteration: ...
|
runconfig.save_initial_checkpoint
#
Legacy Specification |
Trainer Specification |
runconfig:
save_initial_checkpoint: ...
|
trainer:
init:
checkpoint:
save_initial_checkpoint: ...
|
runconfig.seed
#
Legacy Specification |
Trainer Specification |
runconfig:
seed: ...
|
trainer:
init:
seed: ...
|
runconfig.steps_per_epoch
#
Legacy Specification |
Trainer Specification |
runconfig:
steps_per_epoch: ...
|
trainer:
init:
loop:
steps_per_epoch: ...
|
runconfig.sync_batchnorm
#
Legacy Specification |
Trainer Specification |
runconfig:
sync_batchnorm: ...
|
trainer:
init:
backend:
sync_batchnorm: ...
|
runconfig.target_device
#
Legacy Specification |
Trainer Specification |
runconfig:
target_device: ...
|
trainer:
init:
backend:
backend_type: ...
|
runconfig.transfer_processes
#
Legacy Specification |
Trainer Specification |
runconfig:
transfer_processes: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.performance.transfer_processes: ...
|
runconfig.validate_only
#
Legacy Specification |
Trainer Specification |
runconfig:
validate_only: ...
|
trainer:
init:
backend:
validate_only: ...
|
runconfig.wgt_memory_gi
#
Legacy Specification |
Trainer Specification |
runconfig:
wgt_memory_gi: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.wgt_memory_gi: ...
|
runconfig.wrk_memory_gi
#
Legacy Specification |
Trainer Specification |
runconfig:
wrk_memory_gi: ...
|
trainer:
init:
callbacks:
- GlobalFlags:
csx.debug.wrk_memory_gi: ...
|
runconfig.wsc_log_level
#
Legacy Specification |
Trainer Specification |
runconfig:
wsc_log_level:
...
|
trainer:
init:
logging:
wsc_log_level:
...
|
sparsity
#
Legacy Specification |
Trainer Specification |
sparsity: ...
|
trainer:
init:
sparsity:
sparsity: ...
|
sparsity
#
Legacy Specification |
Trainer Specification |
sparsity:
...
|
trainer:
init:
sparsity:
...
|
sparsity.add_summaries
#
Legacy Specification |
Trainer Specification |
sparsity:
add_summaries: ...
|
trainer:
init:
callbacks:
- LogSparsity: ...
|
train_input
#
Legacy Specification |
Trainer Specification |
train_input:
...
|
trainer:
fit:
train_dataloader:
...
|
train_input.micro_batch_size
#
Legacy Specification |
Trainer Specification |
train_input:
micro_batch_size: ...
|
trainer:
init:
callbacks:
- ScopedTrainFlags:
csx.performance.micro_batch_size: ...
|
wandb.group
#
Legacy Specification |
Trainer Specification |
wandb:
group: ...
|
trainer:
init:
loggers:
- WandbLogger:
group: ...
|
wandb.job_type
#
Legacy Specification |
Trainer Specification |
wandb:
job_type: ...
|
trainer:
init:
loggers:
- WandbLogger:
job_type: ...
|
wandb.project
#
Legacy Specification |
Trainer Specification |
wandb:
project: ...
|
trainer:
init:
loggers:
- WandbLogger:
project: ...
|
wandb.resume
#
Legacy Specification |
Trainer Specification |
wandb:
resume: ...
|
trainer:
init:
loggers:
- WandbLogger:
resume: ...
|
wandb.run_id
#
Legacy Specification |
Trainer Specification |
wandb:
run_id: ...
|
trainer:
init:
loggers:
- WandbLogger:
run_id: ...
|
wandb.run_name
#
Legacy Specification |
Trainer Specification |
wandb:
run_name: ...
|
trainer:
init:
loggers:
- WandbLogger:
run_name: ...
|