the.ai

Graphs / Regimes

verified

Oversmoothing

Stack enough graph layers and every node ends up looking the same. Each round averages a node with its neighbours, and repeated averaging is exactly how you erase differences — so the representations that were supposed to distinguish nodes converge to a single point. It is why most graph networks are two or three layers deep while everything else in this graph got deeper.

Viz primitive · update-spectrumlayers = 2 · bars = 16

16 values. The left group decays steeply; the right group is 23% of the way to flat, and reads flatter than the left.

Node representations across a neighbourhood, as given and after this many rounds of averaging. Drag the depth up to watch them collapse onto each other — the reach you gained is paid for in the differences you lost.

2

Reviewed by opendroid · 2026-08-18

  • arXiv:1801.07606 — Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning