Patternshop: Editing Point Patterns by Image Manipulation

03.04.2025

IT / Software / Bioinformatik : (andere) Software

Ref.-Nr.: 1200-6672-GÖ-IT

Point patterns are characterized by their density and correlation. While spatial variation of density is well-understood, analysis and synthesis of spatially-varying correlation is an open challenge. We offer a tool for intuitively editing point patterns, based on a compact representation for spatially varying correlation. We can map point patterns to common three-channel raster images, enabling manipulation with off-the-shelf image editing software. To synthesize back point patterns, we propose a novel edge-aware objective that carefully handles sharp variations in density and correlation. The resulting framework allows intuitive and backward-compatible manipulation of point patterns, such as recoloring, relighting to even texture synthesis that have not been available to 2D point pattern design before.

Background

Fig. 1. Our framework facilitate point pattern design by representing both density and correlation as a three-channel raster image (a). These images can be edited (c) in terms of their density or correlation using off-the-shelf image manipulation software. The resulting point patterns are shown before (b) and after the edits (d). Please see the accompanied supplemental material for vector graphic images.

Firstly, we create a perceptual embedding for point correlations using the following pipeline:

The 2D perceptual embedding space can be visualized as spatially-varying point patterns, where each coordinate corresponds to a point correlation. Combining this space with density, we can characterize a point pattern as spatially-varying correlation + density using "3D" coordinates. These "3D" coordinates correspond to a 3-channel raster image (represented by the LAB color format), which can be edited using off-the-shelf image manipulation software such as Adobe Photoshop.

The following shows the overview of our editing framework, utilizing the perceptual point correlation em-bedding. After editing from scratch (ab-initio) or from an existing point pattern (with the help of neural networks), we can get the 3-channel raster image and run our optimizer to synthesize the edited point pattern.