Concept dictionary
Tensor
A tensor is a structured collection of numbers arranged across one or more dimensions, commonly used to represent model inputs, weights, or outputs.
- Review state
- Reviewed in POC
- Freshness
- Current
- Version
- 2
Also called
- Tensor
- Tensors
Remember it this wayA tensor is numbers arranged by dimensions.
In plain language
A tensor is an array of values arranged along one or more dimensions. Machine-learning systems use tensors to represent inputs, model parameters, and intermediate calculations.
Why it matters
Tensor shape and data type determine which operations are possible and how much memory and computation they require. Many model errors are really mismatches in shape, type, or device.
Example
A batch of 32 color images that are 224 pixels high and wide can be represented as a four-dimensional tensor with shape 32 by 3 by 224 by 224.
Common misconception
A tensor in machine-learning software is often a multidimensional array; it is not automatically the same mathematical object used in every branch of physics or geometry.
Related terms
Sources
- PyTorch, “Tensors”documents tensors as multidimensional arrays used for data and computation in PyTorch.
Learn more
- Compare [[parameters|Parameters]], [[weights|Weights]], [[compute|Compute]], and [[batch|Batch]] to place Tensor in the surrounding system.
- Follow the cited source material above for the method, standard, or research context behind this draft.