Fast Metric Embedding into the Hamming Cube

Sjoerd Dirksen, Shahar Mendelson, Alexander Stollenwerk

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

We consider the problem of embedding a subset of \BbbRn into a low-dimensional Hamming cube in an almost isometric way. We construct a simple, data-oblivious, and computationally efficient map that achieves this task with high probability; we first apply a specific structured random matrix, which we call the double circulant matrix; using that a matrix requires linear storage and matrix-vector multiplication that can be performed in near-linear time. We then binarize each vector by comparing each of its entries to a random threshold, selected uniformly at random from a well-chosen interval. We estimate the number of bits required for this encoding scheme in terms of two natural geometric complexity parameters of the set: its Euclidean covering numbers and its localized Gaussian complexity. The estimate we derive turns out to be the best that one can hope for, up to logarithmic terms. The key to the proof is a phenomenon of independent interest: we show that the double circulant matrix mimics the behavior of the Gaussian matrix in two important ways. First, it maps an arbitrary set in \BbbRn into a set of well-spread vectors. Second, it yields a fast near-isometric embedding of any finite subset of \elln2 into \ellm1 . This embedding achieves the same dimension reduction as the Gaussian matrix in near-linear time, under an optimal condition-up to logarithmic factors-on the number of points to be embedded. This improves a well-known construction due to Ailon and Chazelle.

Original languageEnglish
Pages (from-to)315-345
Number of pages31
JournalSIAM Journal on Computing
Volume53
Issue number2
Early online date14 Mar 2024
DOIs
Publication statusPublished - Apr 2024

Keywords

  • circulant matrices
  • dimension reduction
  • Gaussian width
  • Hamming cube
  • Johnson-Lindenstrauss embeddings

Fingerprint

Dive into the research topics of 'Fast Metric Embedding into the Hamming Cube'. Together they form a unique fingerprint.

Cite this