Neural networks learn from (input, target) pairs. A sliding window manufactures those pairs out of one long sequence.
Window Controls
Window size3
The Math
sequence length N = 14
window size w = 3
training samples N - w = 11
Daily Temperature Sequence
Input X Target y
Generated Training Pairs
0 SAMPLES
#
Input X
Target y
Click "Slide One Step" to create the first training pair.
The Sliding Window: Turning One Sequence into Many Examples
How raw sequential data becomes the (X, y) pairs that supervised learning requires.
The Problem It Solves
Supervised learning needs pairs: an input X and the correct answer y. But a time series or a sentence arrives as one long, unlabeled stream. The sliding window converts that stream into training data by declaring: "the last w values are the input, and the very next value is the target."
How It Works
Given a sequence of length N and a window of size w, slide the window one position at a time:
Sample 1: X = [v₁, ..., vₓ], y = vₓ₊₁
Sample 2: X = [v₂, ..., vₓ₊₁], y = vₓ₊₂
... and so on until the window hits the end, producing N − w samples.
The same trick works for text: given the words "the cat sat on", predict "mat". That formulation — predict the next token from a fixed context — is the seed of the idea that grew into modern language models.
Choosing the Window Size
Too small: the model can't see far enough back — it misses weekly rhythms, long dependencies, sentence-level context.
Too large: fewer training samples (N − w shrinks), more parameters, and irrelevant ancient history dilutes the signal.
Fixed forever: whatever w you pick, the network's view of the past is frozen at that width — a limitation that recurrent networks were invented to remove.
Interactive Exploration Guide
Click "Slide One Step" a few times. Watch the green window and amber target move together along the series, and each step append one row to the training table.
Press "Auto Play" and let the window consume the whole sequence. The sample counter stops at exactly N − w.
Drag the window size to 6 and replay. Bigger context per sample — but count how many fewer samples you end up with.
Key Takeaway
The sliding window is the simplest bridge between sequential data and supervised learning: it manufactures labeled examples from an unlabeled stream. Its fixed width is both its strength (simplicity) and its weakness — the model can never look further back than w steps, which is exactly the limitation that motivates recurrent architectures.
Cheat sheet
Sequential Data Preparation with Sliding Window
Supervised learning needs pairs: an input X and the correct answer y. But a time series or a sentence arrives as one long, unlabeled stream. The sliding window converts that stream into training data by declaring: "the last w values are the input, and the very next value is the target."