Back to Projects
Under review · Computers & Geosciences · 2026

Probing Lunar Swirls.

Bright, sinuous markings with no topography of their own — and a transformer trained to read twelve maps of the Moon at once, then probed to ask which story about them the data actually supports.

Masked Autoencoder Model Probing Lunar Swirls Multimodal Learning

Tom Sander, Kay Wohlfarth, Mirza Arnaut, Marcel Hess & Christian Wöhler · TU Dortmund

A lunar swirl site seen in WAC optical reflectance, with a lens revealing a second data modality underneath
Optical on top · drag the lens Iron

01

A mystery written in albedo

Lunar swirls — Reiner Gamma is the classic example — are bright, looping markings that have no topographic or stratigraphic expression: they sit flat on the surface, often draped over crater and mare alike. They tend to coincide with crustal magnetic anomalies, though exceptions like the swirls in Mare Moscoviense complicate a purely magnetic story. After decades of observation their origin is still unsettled. Three families of hypotheses compete — and, crucially, each predicts a different fingerprint in how the surface's physical properties couple together.

Solar-wind shielding

A local magnetic field deflects the solar wind, slowing space weathering. The surface stays optically immature — maturation retardation.

Predicts
Composition–reflectance link is preserved inside swirls.

Cometary impact

A comet coma scours and thermally alters the regolith, leaving a swept, compacted surface behind.

Predicts
Thermal emission couples more strongly inside swirls.

Dust transport

Electrostatic sorting moves fine, bright dust across the surface, rearranging the upper regolith structure.

Predicts
Radar roughness couples more strongly inside swirls.

The idea of this work is not to predict swirls, but to turn a trained model into a diagnostic instrument: measure which signals depend on which, inside the swirls versus outside, and see whose fingerprint the Moon is actually wearing. We return to these three cards at the end — with verdicts.


02

Twelve ways of seeing one place

Every swirl site is imaged by many instruments at once, each co-registered to the same 300-pixel-per-degree grid: an optical mosaic, radar backscatter, elemental abundance maps, spectral band-depth indices, thermal brightness temperature, and its own latitude/longitude. Below is a single site seen through nine of these maps — flip between them, and toggle the swirl boundary to see where the bright markings actually fall.

Co-registered lunar swirl site
Optical

WAC reflectance

LRO Wide Angle Camera reflectance — the visible brightness that makes swirls stand out in the first place.

The boundary is the Denevi et al. shapefile catalog, rasterized to the same grid and used as the supervised label.

12
Modalities
56
Swirl sites
8
Complexes
~48 M
Tokens

03

An atlas of every known swirl

The 56 sites cluster into eight complexes spread across the near and far side. Seven complexes are used for training; the Rumfold-T complex is held out entirely for testing, so the model is always judged on geography it has never seen. Hover a site for its coordinates. Switch to cross-modal coupling to overlay the spatially-resolved probe: each dot is one 128-pixel tile, coloured by how much the optical channel leans on titanium there.

Equirectangular map of the Moon with the analysed swirl sites marked

56 sites across 8 complexes. Longitude 0–360° is remapped to ±180° to match the mosaic.

Legend


04

One model, twelve tongues

Every image-like modality gets its own VQ-VAE tokenizer (Cosmos-style): an 8×8 patch becomes one discrete token drawn from that modality's codebook, giving 256 tokens per 128-pixel tile. The odd one out is position — latitude and longitude are handled by a structure-aware regex tokenizer that treats each digit, degree marker and hemisphere letter as its own semantic unit. All the token sequences are concatenated, a random subset is masked, and a shared transformer encoder–decoder reconstructs the hidden tokens.

The coordinate tokenizer

Move a swirl's position and watch the token string rebuild — a 64-symbol vocabulary, no free-form text.

302.7° E
7.9° N

The masking strategy

Twelve modalities, one shared sequence. Filled cells are shown to the encoder; hollow cells are masked and must be predicted.

50%
Tokenizer & model configuration
ModalityCodebook
WAC · sc-pol · op-pol2048 / 1536 / 1536
ibd1 · bt1024 / 1536
titan · iron · aluminum · calcium1024 each
plagioclase · pyroxene1024 each
position (regex)64
HyperparameterValue
Encoder / decoder depth6 + 6
Hidden dim · heads132 · 6
Patch · tokens/tile8×8 · 256
OptimizerAdamW, cosine decay
Losstoken-normalized cross-entropy

05

Can it reconstruct the Moon?

Before the model can be trusted as a probe, it has to actually reconstruct the held-out data. Pick a modality and drag the divider to wipe between the model's prediction and the ground truth. Smooth elemental and radar maps come back almost perfectly; the visually busy optical mosaic and the fine-grained mineral maps are intrinsically harder — high spatial frequency, not a failure of the model.

Ground truth Ground-truth modality map
Predicted Model-predicted modality map
SSIM ↑
0.9981
PSNR ↑
54.0
RMSE ↓
0.0155

Titanium reconstructs almost losslessly (SSIM 0.998) — smooth elemental maps sit comfortably inside the tokenizer's discrete bottleneck.

Full reconstruction tables
Full-model reconstruction, held-out test set (Table 2)
ModalitySSIM ↑PSNR ↑RMSE ↓
aluminum0.986444.110.0065
brightness_temperature0.905518.5620.98
calcium0.944935.650.0014
ibd10.962340.896.856
iron0.997153.540.0182
op-pol0.966341.600.0190
plagioclase0.697322.676.340
pyroxene0.609621.884.242
sc-pol0.977044.000.0123
titan0.998154.010.0155
wac0.596519.540.0148

The position channel is different. Encoded as text, it recovers the structure of a coordinate string (normalized Levenshtein 0.405) but almost never the exact values (parse rate ≈ 0, great-circle error ~1866 km). That is physically expected: local mineralogy and radar roughness carry no global geolocation signature, so position acts as a contextual anchor, not a decodable coordinate — the same conclusion the latent-space analysis reaches independently.


06

Which signals actually matter

Now the probing begins. Two ablations ask complementary questions of a linear classifier trained to trace swirl boundaries. Leave-One-Out removes each modality and measures how far F1 drops — its necessity. Leave-One-In keeps only that modality (plus position) and measures how far it beats the spatial baseline — its sufficiency. A modality matters most where it cannot be substituted by the others.

Necessity (LOO F1 drop, Δ). Baseline F1 with every modality present is 0.492.


07

Inside the latent space

Two more probes read the model's internals. Attention shows which source modality the transformer routes to when predicting each target. Representational similarity compares the geometry of the learned features pairwise. In both, the interesting cells are the outliers — and one stands out everywhere: position sits apart from every physical channel.

Attention routing

Rows are the target being predicted, columns the source being read. The single hottest route is optical reflectance attending to titanium (mass 0.34); pyroxene leans hard on iron (0.28). The position column stays cold everywhere — the model barely consults coordinates to reconstruct physics.


08

The verdict

The decisive experiment extends the ablations into space: for each hypothesis target, withhold a whole group of inputs and measure how much more the model relies on it inside swirls than outside. A positive bar means the coupling strengthens inside the swirl — the fingerprint that hypothesis predicts. Only one target lights up positive.

Δ = ⟨deviation⟩in-swirl − ⟨deviation⟩off-swirl, per withheld modality group. Targets: optical (wac), thermal (bt), radar roughness (sc-pol). The bt × phys-thermal bar is absent by design — brightness temperature is the thermophysical group.

✓ Supported

Maturation retardation

Optical reflectance depends more on composition inside swirls (Δ = +0.10). Where weathering is slowed, the link between mineralogy and brightness survives — exactly this prediction.

✗ Not supported

Cometary / thermophysical

Brightness temperature couples less inside swirls (Δ = −0.40), not more. No sign of a thermally distinct, swept surface.

✗ Not supported

Dust transport

Radar roughness coupling is negative across every group — no evidence of the reorganized upper regolith this scenario needs.

An honest caveat. This is not a refutation of the alternatives — orbital data cannot resolve subsurface magnetic geometry, and absence of evidence at 300 px/deg is not evidence of absence. The claim is narrower and cleaner: within current orbital archives, only the optical–compositional signature carries the asymmetry maturation retardation predicts. The 56 sites also span just 8 complexes, so "population-level" means the catalogued swirls, not a statistically independent sample. Settling the mechanism will need in-situ measurement — the kind the upcoming Lunar Vertex mission is designed for.


09

Paper & code

Under review

Computers & Geosciences

The manuscript “Probing Lunar Swirls with a Multimodal Transformer” is currently under peer review. The full source — model, tokenizers and the probing protocol — is public on GitHub; every figure and number on this page is drawn directly from the submitted manuscript.

Swirl-MAE on GitHub

The predecessor

The any-to-any multimodal transformer this probing framework builds on — reconstructing elevation, normals and albedo of the Moon.

The Moon's Many Faces

Related project

Anomaly detection at the Apollo sites, on the same Shape-from-Shading data pipeline.

Lunar Technosignatures

Architecture lineage: the framework adapts masked multimodal modelling (MultiMAE / 4M, Bachmann & Mizrahi et al.) with Cosmos-style VQ-VAE tokenizers to heterogeneous lunar remote sensing.