Glossar-English:Space and Geometry
Translation of: Raum und Geometrie
Space as the basic category of picture morphology
The set of the syntactic components for perceptoid signs can generally be divided in two groups: On the one hand there is an abstract relational basic structure. It usually spans several coordinated dimensions, in which the elements of the second group can be arranged. The latter are forming systems of perceptual marker values that firstly allow us to perceive the underlying basic structure, which actually is, as Kant has put it, a category. In the case of pictures, the basic structure is two-dimensional space while the marker values are essentially colors and textures that render purely spatial structures visible. Hence speaking about picture syntax implies talking about space.
The rules organizing our talking about space (at least as far as it is supposed to be rationally controlled) have been in the focus of interest at least since the neolithic revolution with its introduction of architecture, farming, and the cooperative spatial manipulations involved in those activities. Today, it is essentially the calculization of geometry of ancient Greece and its algebraic reformulation in the 16th century that influence the conception of space, which also underlies pictorial syntax.
Geometric calculi as formalization of space
Basically, a geometric calculus is a vocabulary with a set of rules originally setting up the options of talking in the abstract – without reference to any concrete objects with contingent non-geometric properties – about “geometric entities”. Those rules form the conceptual determinations of a set of spatial concepts. The concepts for basic geometric entities are essentially determined by the relations they can enter. Those are usually divided in relations concerning contact and neighorhood (topological relations), relations concerning distances and extensions (metric relations), and relations concerning direction and orientation (directional or projective relations).
Having got geometric concepts has essentially three consequences:
The standard approach to geometric calculi is Euclid's axiomatic system based on the concept of an unextended but uniquely located »point«: This concept is, however, quite abstract and rather distant to (spatial) experience. A formal approach to geometry that was primarily developed in the 20th century tries to do justices to cognitive principles. As a result, a family of non-standard geometric calculi has been developed. It offers interesting properties for picture morphology: ‘mereogeometries’.
Euclidean calculus of geometry
More than 2000 years ago, a first axiomatic system of geometry has been proposed by Euclid. Based on a set of basic postulates (‘axioms’), implications can be drawn in that system in order to formally (i.e., by means of logical deductions) prove theorems about geometric objects and their properties or relations. The discussion of this approach and in particular of the independence of the five basic postulates about geometric objects has indeed led to several variants of such a geometric calculus forming the field of ‘synthetic geometry’.
In the 16th century, Descartes (Essais, 1637) developed an alternative formalism based on algebraic formulae – locations are described by numbers encoding distances to a point of “origin” relative to coordinate axes. This ‘analytic’ geometry, which has basically led to the vector calculi used today in most technical approaches to space, has been formally proven (Hilbert) of being completely equivalent to the Euclidean calculus.
Essentially, all geometric entities are viewed as sets of individual locations, called ‘points’, which, as Euclid has put it, is “what does not have parts”. The points can be organized in one or more dimensions – depending on the number of independent (‘orthogonal’) coordinate axes, which are associated with basic directions. Each axis furthermore organizes the points according to the real numbers. This implies that Euclidean points are essentially arranged in a continuum.
The rules of the geometric calculus establish spatial homogeneity (invariance with respect to translations of the point of origin) and isotropy (invariance with respect to rotations of the coordinate axes), which ultimately are the basis for syntactic density of pictorial space. However, the common Euclidean formalization of geometry leads also to the “unpleasant” consequence that the most basic pixemes must be non-extended points – a concept highly abstracted from experience, that is. Any extended region – i.e., any pixeme – then must consist of an infinite number of basic geometrical entities, quite in contrast to the Gestaltian conceptions of (spatial) perception.
Some non-standard approaches to geometry offer an interesting way out of this dilemma. Mereogeometries are the result of a formal approach to geometry that was primarily developed in the 20th century, and that tries to do justices to fundamental cognitive principles. If a point is, as Euclid thought, “what has no parts”, part-whole relations should be considered as crucial to geometry. At least, geometric entities that do have parts may after all be more natural candidates for grounding pictorial space.
In contrast to Euclidean-style geometries, the family of mereogeometries is based on the concept of an extended region, which may or may not have (distinguishable) proper parts. Such regions are often called “individuals” as they form the ultimate basic elements of the calculus. They do not have immediate attributes of form or position: Only the relations to other individuals, which in particular could be their parts or the wholes they are a part of, determine form, extension, and (relative) location.
While Euclidean geometry first introduces the continuous range of infinitely many points some of which are then chosen to be relevant (still an infinite number in any practical relevant instance), mereogeometric descriptions start with a (usually finite) number of relevant individuals (regions). Such an individual may quite well be thought of as a visual Gestalt – thus following the principles of perception psychology of the Gestalt school: One has to consider the perceived whole first, and introduce the concepts for perceptual atoms as instruments of the explanations of the former, not the other way round. Human beings do not see sets of zero-dimensional points but extended Gestalts – especially in picture perception. The abstract notion of a spatial entity without extension is secondarily constructed in order to explain some aspects of experienced space, but leads on the other side to severe difficulties.Since space has been traditionally captured by point-based geometry, it must be recognized that, overall, the properties of Euclidean space (i.e., the concepts of space as described by a Euclidean calculus) fit our commonsense notion of space. Thus, it should not be surprising that most mereogeometries lead to systems ‘equivalent’ to Euclidean geometry [Borgo & Masolo 2010a]Borgo, Stefano & Masolo, Claudio (2010).
Full Mereogeometries. In The Review of Symvbolic Logic, 3, 4, 521 - 567.
Calculi of geometry and the morphological structures of pictures
Indeed, the research of mereogeometric calculi corroborates a conclusion that has puzzled researchers in pictorial morphology: the lack of constraints on the choice of primitives. In both domains one arrives easily at equivalent formalisms despite starting from quite disparate assumptions. It follows that the choice of primitives cannot rely on purely formal properties. It must be supported by arguments and observations from other perspectives like those embedded into the cognitive, evolutionary, mental, and perceptive views. The development of several geometrical systems up to mereogeometries has led to geometric approaches that, exploiting disparate primitives, naturally result in formal geometries of equivalent expressiveness. On the one hand, the search for grounding pixemes (either as primitives or as prototypical) naturally leads to a discussion that matches the debate on basic geometrical entities. On the other hand, the need of rendering and understanding complex images in a computational setting suggests (at least in theory) the existence of a limited number of basic pixemes that can be combined via a formal calculus of limited complexity (⊳ image processing, digital).
Pixemes as geometric entities
In the context of the morphological structures of pictures, the geometric calculus describes how we talk (rationally) about the basic structure of the picture plane and the pixemes contained there. A basic structure not following the rules determined by the calculus leads to a syntactically invalid picture. With a point-based calculus, pixemes are conceived of as (infinite) sets of points, which are determined by Gestalt-organizing processes operating on the marker values (⊳ color as a category of pictorial syntax). The infinitely many points contained in any pixeme are locations, which merely are potentially interesting: They might become morphologically relevant when comparing the picture vehicle in question with another picture vehicle. Correspondingly, the Euclidean-type calculus of geometry has no need for a concept of resolution: Its virtual value of resolution is always infinit – a God's eye view on space.
With a mereogeometric calculus, pixemes are “indviduals”, i.e., primitive entities of the calculus. Assuming that the Gestalt principles governing visual perception determine exactly those regions that are syntactically relevant, the pixemes can be quite naturally conceived of as being given in perception. There is no need to consider more points than necessary
Points, resolution, zooming, and microscopization
While mereogeometries deal with pure space, pictorial morphology has to take into account other elements like granularity (which may affect very basic properties as connectedness among entities, i.e., the topology itself). In fact, the concept of a minimal region can be introduced in mereogeometry: They are usually called a “point”, but we may well use “pixel” instead. A point in this sense, which is quite obviously rather different from the Euclidean point, is approximately a region that has no proper parts (or rather, a region where no proper parts are considered). When the concept »point« is introduced to the calculus in that manner, there is no need in any concrete instance for using infinitely many point instances: Only the “relevant” points have to be instantiated. This also means that there is always a finite resolution for describing space with such a calculus. However, N. Asher & L. Vieu  have proposed a formal mechanism called “microscopization” covering a kind of zooming operation by means of a modal extension to their mereogeometric calculus: What is a “point” on one level may be a compound of regions with several points on a microscopized level.
The empty picture plane and maximal pixemesIn contrast to space according to standard geometries, pictorial space is usually externally limited: The picture plane consists of one unique maximal pixeme, which is not part of another pixeme of that picture – Saint Martin here uses the espression “basic picture plane” ([Saint-Martin 1987a]Saint-Martin, Fernande (1987).
Sémiologie du langage visuel. Montréal: Presses de l’Université du Quebec, Englisch: Semiotics of Visual Language. Bloomington, Indianapolis: Indiana University Press..
Les fondement de la géometrie des corps. Cracovie: Société polonaise de mathématique, Erweiterte Fassung in Tarksi: Logique, Sémantique, Métamathématique. A. Colin, Paris 1972, Vol. 1, 27-34.
Semantic aspects of geometry
Obviously, the spatial concepts framed in geometric calculi also play a major role in picture semantics: Projecting a three-dimensional scene to a two-dimensional picture plane obeies rules that are in particular (though not only) determined by the calculi of projective geometry. Those considerations are discussed in lemma Perspective and Projection.
Time and Geometry
In physics, temporal extension and order are conceived of as another (i.e. fourth) geometric dimension. Corresponding conceptions may be used in picture philosophy when dealing with film, video, TV or other formats of moving pictures. In the strong sense of physics, the temporal "direction in space" is contrasted to the spatial "directions in space" by taking it as a (mathematically) imaginary axes of a four-dimensional complex vector space, or inversely as the only real axes complementing imaginary spatial components (‘quarternions’). In computer graphics, quarternions are often used to calculate transformations of 3D model. Rotations in particular can then be handled quite easily.
Literatur [Sammlung][Aurnague & Vieu 1993a]: Aurnague, Michel & Vieu, Laure (1993). A Three-Level Approach to the Semantics of Space. In: Zelinsky-Wibbelt, C. (Hg.): The Semantics of Prepositions – From Mental Processing to Natural Language Processing. Berlin: Mouton de Gruyter, S. 393–439.
[Borgo & Masolo 2010a]: Borgo, Stefano & Masolo, Claudio (2010). Full Mereogeometries. The Review of Symvbolic Logic, Band: 3, Nummer: 4, S. 521 - 567. [Goodman 1968a]: Goodman, Nelson (1968). Languages of Art. Indianapolis: Hackett, 2. rev. Aufl. 1976. [Herskovits 1986a]: Herskovits, Annette (1986). Language and Cognition – An Interdisciplinary Study of the Prepositions in English. Cambridge: Cambridge Univ. Press. [Saint-Martin 1987a]: Saint-Martin, Fernande (1987). Sémiologie du langage visuel. Montréal: Presses de l’Université du Quebec, Englisch: Semiotics of Visual Language. Bloomington, Indianapolis: Indiana University Press.. [Schirra 1994a]: Schirra, Jörg R.J. (1994). Bildbeschreibung als Verbindung von visuellem und sprachlichem Raum. St. Augustin: DISKI. [Tarski 1929a]: Tarski, Alfred (1929). Les fondement de la géometrie des corps. Cracovie: Société polonaise de mathématique, Erweiterte Fassung in Tarksi: Logique, Sémantique, Métamathématique. A. Colin, Paris 1972, Vol. 1, 27-34.