Saliency Thresholds in Neural Code and its Relation to the Power-Law, Gaussian, and Lambert W Function

Alex Alvarez*, Jin Hyun Park*, and Yoonsuck Choe

Inside the visual response

From natural image to neural threshold

Following Lee and Choe's orientation-energy model, this sequence follows the filtering method formalized in Appendix A.1.

01 / Natural stimulus

Begin with the scene

The model reads the wolf photograph as luminance. Nothing is marked salient yet; every pixel is simply part of the incoming visual field.

I(x, y) → grayscale luminance
Natural photograph of a wolf standing in brush
Input stimulus I
Signed Difference-of-Gaussians response of the wolf photograph
Signed local contrast ID
02 / Center-surround

Remove the illumination, keep the transitions

A Difference-of-Gaussians compares each point with a broader neighborhood. Smooth lighting falls away; orange and blue show opposite polarities of local contrast.

ID = I * (Nσ/2 - Nσ)
03 / Six orientation channels

Six filters become one energy map

Each angle combines even and odd Gabor phases. As you scroll, the six phase-invariant responses align and add pixel by pixel.

E = Σk=05 [(Gθk,0 * ID)2 + (Gθk,π/2 * ID)2]
Six separate responses
Scroll to sum the channels
0 degree orientation-energy response
30 degree orientation-energy response
30°
60 degree orientation-energy response
60°
90 degree orientation-energy response
90°
120 degree orientation-energy response
120°
150 degree orientation-energy response
150°
Final summed orientation-energy map of the wolf
04 / From map to distribution

Gather the energies, then count them

Energy is already a scalar. The hot colors are only a display palette; removing that palette exposes one grayscale magnitude per pixel. Binning those magnitudes produces the response histogram h(E).

Hot-color wolf orientation-energy map

Summed response Six Eθ channels

Read magnitude
Grayscale scalar energy magnitudes for the wolf

Scalar energy E One value per pixel

Bin values

Natural-image h(E) Heavy response tail

05 / White-noise control

Now give the same filters no contours

A seeded white-noise image goes through the identical center-surround and six-angle filter bank. Its response has no coherent wolf, grass, or edge structure to preserve.

Seeded grayscale white-noise input

White noise Independent pixel intensities

Same filters
Orientation-energy response to white noise

Noise response No coherent contours

Bin values

Noise response Empirical control

The empirical noise response motivates the matched Gaussian baseline g(E) used in the paper. The red curve below is that smooth matched baseline, not a literal copy of this one finite noise sample.

06 / Put the tails on equal footing

Log both axes, then bring the distributions together

The log-log view makes rare, high-energy responses visible. Scroll through the transformation: the separate natural-image and control distributions become the comparison used to locate L2.

Distribution comparison

From counts to crossover

Natural scenes keep a heavier tail than the matched Gaussian baseline. Their second intersection is the candidate saliency threshold.

Linear axes
Two separate histograms
Scroll to transform and overlay
Natural image h(E)
White-noise control → matched g(E)
Find the saliency threshold

Now decide how much response is enough

The full response has a heavy-tailed energy distribution. Drag the threshold from rare, high-energy contours toward the lower-energy background.

Log-Log Energy Distribution
High Energy Low Energy
h(E) Energy response histogram
g(E) Gaussian baseline
L2 Saliency threshold
Threshold Current position

Drag the slider to reveal pixels by energy level.
*The x-axis is flipped so high-energy pixels (revealed first) appear on the left.

Energy Map

How many pixels are needed to make out what I'm looking at?  I perceive the saliency threshold conceptually as the point where marginal information gain per pixel begins to diminish sharply.

We explore a theoretical juncture where the power law, Gaussian, and Lambert W converge to compute saliency thresholds in neural code. The Lambert W function emerges naturally in instances where exponential processes (like the Gaussian's exponentially decaying tails) and polynomial processes (like the power law's polynomially decaying tails) meet. Our results point to a biologically plausible invariant property in neural thresholding that could greatly simplify downstream processing in visual systems and potentially generalizes across different sensory modalities and processing levels.

Read the full paper