Scalar Multiplication

Scalar multiplication is a fundamental operation involving the multiplication of a vector by a single number. This number is known as a scalar. A scalar in linear algebra is simply a regular number (like 5, -2.7, or $\pi$), distinct from a vector or a matrix.

Scalar multiplication changes the magnitude (length) of the vector and, if the scalar is negative, its direction. It's like stretching, shrinking, or flipping the vector.

How Scalar Multiplication Works

To perform scalar multiplication, you multiply every element of the vector by the scalar value.

Mathematically, if you have a scalar $c$ and a vector $\mathbf{v}$ with $n$ elements:

$$\mathbf{v} = \begin{bmatrix} v_1 \\ v_2 \\ \vdots \\ v_n \end{bmatrix}$$

Then the scalar multiplication $c\mathbf{v}$ is defined as:

$$c\mathbf{v} = c \begin{bmatrix} v_1 \\ v_2 \\ \vdots \\ v_n \end{bmatrix} = \begin{bmatrix} c \cdot v_1 \\ c \cdot v_2 \\ \vdots \\ c \cdot v_n \end{bmatrix}$$

Each component of the original vector $\mathbf{v}$ is multiplied by the scalar $c$. The resulting vector has the same dimension as the original vector.

Geometric Interpretation

Geometrically, multiplying a vector $\mathbf{v}$ by a scalar $c$ results in a new vector that points in the same direction as $\mathbf{v}$ if $c > 0$, and in the opposite direction if $c < 0$. The length of the new vector is $|c|$ times the length of the original vector $\mathbf{v}$. If $c = 0$, the result is the zero vector (a vector with all elements equal to zero).

Consider a 2D vector $\mathbf{v} = \begin{bmatrix} 2 \\ 1 \end{bmatrix}$.

• If we multiply by $c=2$, we get $2\mathbf{v} = \begin{bmatrix} 2 \cdot 2 \\ 2 \cdot 1 \end{bmatrix} = \begin{bmatrix} 4 \\ 2 \end{bmatrix}$. This vector points in the same direction but is twice as long.
• If we multiply by $c=-1$, we get $-1\mathbf{v} = \begin{bmatrix} -1 \cdot 2 \\ -1 \cdot 1 \end{bmatrix} = \begin{bmatrix} -2 \\ -1 \end{bmatrix}$. This vector has the same length but points in the opposite direction.
• If we multiply by $c=0.5$, we get $0.5\mathbf{v} = \begin{bmatrix} 0.5 \cdot 2 \\ 0.5 \cdot 1 \end{bmatrix} = \begin{bmatrix} 1 \\ 0.5 \end{bmatrix}$. This vector points in the same direction but is half as long.

The original vector $\mathbf{v}$ (blue), scaled by 2 (green), and scaled by -1 (red). Scaling changes the length and potentially the direction.

Scalar Multiplication in Python with NumPy

NumPy makes scalar multiplication straightforward using the standard multiplication operator *.

Let's define our vector $\mathbf{v}$ and a scalar $c$.

import numpy as np

# Define the vector v
v = np.array([2, 1])

# Define the scalar c
c = 3

# Perform scalar multiplication
scaled_v = c * v

print(f"Original vector v: {v}")
print(f"Scalar c: {c}")
print(f"Scaled vector c*v: {scaled_v}")

Output:

Original vector v: [2 1]
Scalar c: 3
Scaled vector c*v: [6 3]

As expected, NumPy multiplied each element of the vector v by the scalar c=3.

Let's try scaling with a negative scalar:

# Define a negative scalar
c_neg = -1.5

# Perform scalar multiplication
scaled_neg_v = c_neg * v

print(f"Original vector v: {v}")
print(f"Negative scalar c_neg: {c_neg}")
print(f"Scaled vector c_neg*v: {scaled_neg_v}")

Output:

Original vector v: [2 1]
Negative scalar c_neg: -1.5
Scaled vector c_neg*v: [-3.  -1.5]

Again, each element [2, 1] was multiplied by -1.5 to get [-3.0, -1.5]. Notice that NumPy automatically handles the floating-point results.

Scalar multiplication is a basic building block used frequently in linear algebra and machine learning, often for adjusting the influence or scale of features represented by vectors.