torch.nn.utils.skip_init
function skip_init<T extends Module>(module_cls: new (...args: any[]) => T, ...args: any[]): TGiven a module class object and args/kwargs, instantiate the module without initializing parameters/buffers.
This is useful when loading weights from a checkpoint, as it avoids the overhead of initializing parameters that will be immediately overwritten.
Parameters
module_clsnew (...args: any[]) => T- The module class to instantiate
argsany[]- Positional arguments to pass to the constructor
Returns
T– An uninitialized module instanceExamples
// Create a large model without initializing weights
const model = torch.nn.utils.skip_init(MyLargeModel, 1000, 1000);
// Load weights from checkpoint
model.load_state_dict(checkpoint);