Chapter 03

What the Universe Has Told Us Since Einstein

In 1931, Einstein removed the cosmological constant from his equations and called it his greatest blunder. In 1998, two independent teams of astronomers proved he was wrong to remove it. This is what we've learned in the 106 years since general relativity — and why it demands a solution.

The Blunder That Wasn't

Einstein added Λ\Lambda to his field equations in 1917 because a static universe required it — without it, gravity would cause everything to collapse. When Hubble showed the universe was expanding in 1929, Einstein abandoned the constant. A static universe was never needed. The constant was unnecessary.

But he was wrong for the right reasons. The universe isn't static — but something is still pushing it apart, and that something is exactly what Λ\Lambda describes. The constant he introduced to prevent collapse turns out to be the right mathematical object for a completely different physical reality: not a brake, but an accelerator.

Einstein field equations — with the cosmological constant

Gμν+Λgμν=8πGc4TμνG_{\mu\nu} + \Lambda g_{\mu\nu} = \frac{8\pi G}{c^4} T_{\mu\nu}

Λgμν\Lambda g_{\mu\nu} is the term Einstein added and then removed. Observations forced it back in — not as a fudge factor, but as the dominant component of the universe.

1929 — The Universe Is Expanding

Edwin Hubble used Cepheid variable stars as cosmic distance markers — their brightness oscillates with a period that reveals their absolute luminosity, so comparing to apparent brightness gives distance. Measuring the redshift of their host galaxies gave recession velocity.

The result was unmistakable: velocity scales with distance. The universe is expanding. And this expansion is described precisely by the Friedmann equations Friedmann had derived seven years earlier from general relativity.

Hubble's law

v=H0dv = H_0 \, d

Every galaxy recedes at a speed proportional to its distance. H0H_0is the Hubble constant — the expansion rate today. Hubble's original measurement was 500 km/s/Mpc\sim 500 \text{ km/s/Mpc}, off by a factor of 7. Today's value is 67.4±0.5 km/s/Mpc67.4 \pm 0.5 \text{ km/s/Mpc} from the CMB — or 73.04±1.0473.04 \pm 1.04 from local distance measurements. These disagree at 5σ.

1998 — The Universe Is Accelerating

Type Ia supernovae are “standard candles” — they all explode at nearly the same peak luminosity, driven by the same nuclear physics. Compare apparent brightness to known absolute brightness, and you get distance. Measure redshift, and you get recession velocity. Plot both, and you can trace the expansion history of the universe.

Two teams — the Supernova Cosmology Project (Perlmutter) and the High-Z Supernova Search Team (Riess, Schmidt) — independently studied supernovae at high redshift. They found the same unexpected result: the supernovae were fainter than expected. Fainter means farther. Farther means the universe has expanded more than a decelerating model would predict.

The universe isn't decelerating under gravity. It's accelerating. Something is overcoming gravity on the largest scales. That something is dark energy — and it requires Λ>0\Lambda > 0.

≈ 0.72

ΩΛ

Perlmutter et al. 1999

≈ 0.76

ΩΛ

Riess et al. 1998

0.685 ± 0.007

ΩΛ

Planck 2018 (CMB)

Three completely independent methods. All converge on the same conclusion: 68–72% of the universe's energy content is dark energy. The 2011 Nobel Prize in Physics went to Perlmutter, Riess, and Schmidt for this discovery.

2003–2018 — The Cosmic Microwave Background

The CMB is the oldest light in the universe — photons released 380,000 years after the Big Bang when the cosmos cooled enough for hydrogen to form. Its temperature fluctuations encode the composition of the universe at that moment: the relative amounts of matter, radiation, and dark energy.

WMAP (2003) and Planck (2013, 2018) mapped these fluctuations across the full sky. The power spectrum — the distribution of hot and cold spots at different angular scales — is a precise fingerprint. Fitting it against cosmological models gives measurements of ΩΛ\Omega_\Lambda, H0H_0, and the geometry of space.

Planck 2018 cosmological parameters

ParameterValueMeaning
ΩΛ0.685 ± 0.007Dark energy fraction
Ωm0.315 ± 0.007Matter fraction
H₀67.4 ± 0.5 km/s/MpcExpansion rate today
w₀−1.03 ± 0.03Dark energy equation of state
k≈ 0Flat geometry

The six-parameter ΛCDM model fits the Planck power spectrum with extraordinary precision. Dark energy is not a theoretical convenience — it is a measured component of reality.

2024 — Dark Energy May Not Be Constant

DESI DR1 — the sharpest measurement of dark energy's nature yet

The Dark Energy Spectroscopic Instrument measured spectra of 6 million galaxies and quasars spanning 11 billion years of cosmic history. Using Baryon Acoustic Oscillations (BAO) — a standard ruler imprinted in the galaxy distribution by sound waves in the early universe — DESI measured the expansion rate at multiple epochs.

If dark energy is a cosmological constant, its equation of state is exactly w=1w = -1 for all time. DESI tested this using the CPL parametrization, which allows ww to vary with redshift:

CPL parametrization — allows evolving dark energy

w(z)=w0+waz1+zw(z) = w_0 + w_a \frac{z}{1+z}

A pure cosmological constant gives w0=1, wa=0w_0 = -1,\ w_a = 0. DESI DR1 combined with CMB and Type Ia supernovae found: w₀ ≈ −0.73, wₐ ≈ −1.05. This is 2.5–3.9σ away from w=1w = -1, depending on which supernova dataset is combined. If confirmed, dark energy is not a constant — it is a dynamical field that has evolved over cosmic time.

CPL: w(z) = w₀ + wₐ·z/(1+z). DESI DR1: w₀ = -0.727, wₐ = -1.052.5–3.9σ from w = −1.

The visualization above shows the CPL equation of state w(z)w(z) as a function of redshift. The dashed red line is the cosmological constant. The violet curve is the DESI 2024 best fit — notice it rises above w=1w = -1 at low redshift (today) and dips well below at high redshift (the early universe). Use the sliders to explore: what does a universe with w0=1, wa=0w_0 = -1,\ w_a = 0 look like versus the DESI best fit?

The physical implication is profound: if w0>1w_0 > -1, dark energy today is weaker than a pure vacuum energy. If wa<0w_a < 0, it was stronger in the past — behaving more like phantom energy. This is inconsistent with a simple cosmological constant. It suggests dark energy is a dynamical field, possibly quintessence or something more exotic.

The Hubble Tension

The expansion rate of the universe today — H0H_0 — can be measured two ways. Measuring the CMB and fitting ΛCDM to the early universe gives one answer. Measuring Cepheid distances to nearby galaxies and calibrating Type Ia supernovae gives another. They disagree.

Early Universe (CMB)

67.4km/s/Mpc

Planck 2018 — ±0.5

Late Universe (Distance Ladder)

73.04km/s/Mpc

SH0ES / Riess et al. 2022 — ±1.04

The discrepancy is 5σ. In physics, 5σ is the threshold for discovery. This is not a measurement error — both measurements are among the most carefully checked in all of science. Either one or both measurements has an unidentified systematic error, or the standard cosmological model is incomplete.

The Hubble tension may be the first crack in ΛCDM. Any solution to dark energy that modifies the expansion history — particularly in the late universe — could shift the inferred H0H_0 from the CMB toward the local value.

What the Evidence Demands

Taken together, this is what the last century of observation has established beyond any reasonable doubt:

  • The universe is expanding — measured by Hubble 1929
  • The expansion is accelerating — measured by Perlmutter, Riess, Schmidt 1998
  • 68.5% of the universe is dark energy — confirmed by CMB, BAO, and supernovae independently
  • The cosmological constant fits the data, but dark energy may be evolving — DESI 2024
  • Two measurements of H₀ disagree at 5σ — the Hubble tension demands new physics

And yet the theoretical prediction for dark energy — the quantum vacuum energy — overshoots the observed value by 1012110^{121}. This is the cosmological constant problem: not a gap in observation, but a catastrophic failure of our best theories to explain what we observe.

A complete solution must do four things: explain why ΛobsΛQFT\Lambda_{\text{obs}} \ll \Lambda_{\text{QFT}}, explain the coincidence that dark energy became dominant only recently (why now?), predict or accommodate the DESI finding that w1w \neq -1, and resolve or explain the Hubble tension.

106 Years in Sequence

1915

Einstein publishes general relativity

Gμν + Λgμν = 8πG/c⁴ Tμν — the framework for all modern cosmology.

1917

Cosmological constant added

Einstein adds Λ to prevent the universe from collapsing — assumes it must be static.

1922

Friedmann: the universe needn't be static

GR admits expanding and contracting solutions. Λ isn't needed for stability.

1929

Hubble: galaxies are receding

Cepheid distances show v = H₀d. The universe is expanding. Λ removed.

1965

CMB discovered by accident

Penzias & Wilson detect the 2.725 K fossil light from 380,000 years after the Big Bang.

1998

Supernovae: expansion is accelerating

Type Ia SNe are dimmer than expected — farther than a decelerating universe allows. Λ > 0 required.

2003

WMAP maps the CMB

Full-sky CMB power spectrum: flat geometry, ΩΛ ≈ 0.73. Dark energy is 73% of the universe.

2011

Nobel Prize

Perlmutter, Riess, Schmidt awarded for the discovery of accelerating expansion.

2018

Planck: precision cosmology

ΩΛ = 0.685 ± 0.007, H₀ = 67.4 ± 0.5 km/s/Mpc. Six-parameter ΛCDM fits perfectly.

2022

Hubble tension reaches 5σ

CMB H₀ = 67.4 vs local distance ladder H₀ = 73.04. Cannot be statistical noise.

2024

DESI DR1: dark energy may be evolving

6 million galaxy spectra. BAO at 11 redshift bins. w₀ ≈ −0.73, wₐ ≈ −1.05. 2.5–3.9σ from w = −1.

FoundationObservationConfirmationTension / New physics

Chapter 04

The Solution

Continuing where Einstein left us — the Causal Vacuum Correspondence: a theory that resolves the 10121 discrepancy, predicts the DESI equation of state, and makes a specific falsifiable claim for DR2.