U ʹj@sNddlmZddlmZmZmZddlmZddlm Z eGdddZ dS)) dataclass)ListUnionOptional)reduce)_remote_devicec@speZdZUdZdddgZeeed<eeed<ee ed<d eeeeee e e fdddZ d d Z dS) ShardMetadataaH Represents a shard of the overall Tensor including its offsets, lengths and device placement. Args: shard_offsets(List[int]): Offsets in the original tensor indicating the start offsets for this shard. Should have the same rank as the original tensor. shard_sizes(List[int]): Integers indicating the size of each dimension for this shard. Should have the same rank as the original tensor. placement(:class:`torch.distributed._remote_device`): Specifies the placement of this shard. shard_offsets shard_sizes placementN)r r r cCs||_||_t|tr"t||_n||_t|jt|jkrZtdt|jd|jdtt|jD]0}|j|dkrtd|j|dkrhtdqhdS)NzMshard_offsets and shard_sizes should have the same number of elements, found z and z respectivelyrzshard_offsets should be >=0zshard_sizes should be >= 0) r r isinstancestrrr len ValueErrorrange)selfr r r ir`/var/www/html/bwave/python/venv/lib/python3.8/site-packages/torch/distributed/_shard/metadata.py__init__s  zShardMetadata.__init__cCs4dd}t||jd}t||j|}|||j}|S)NcSs|d>t|S)N)hash)abrrr _hash_reduce7sz,ShardMetadata.__hash__.._hash_reduce%)rr r r )rrresrrr__hash__6s  zShardMetadata.__hash__)N)__name__ __module__ __qualname____doc__ __slots__rint__annotations__rrrr rrrrrrrs      rN) dataclassesrtypingrrr functoolsrZtorch.distributed.remote_devicerrrrrrs