"The human face is indeed, like the face of God of some Oriental theogony, a whole cluster of

faces, crowded together but on different planes so that one does not see them all at once"

Marcel Proust. 1919

This document intends to be a very high level description of the concept behind Matrix Mirrors

photographic project, keeping in mind the objective of not to go beyond 2 pages. It describes the process

used and introduces some of the project’s most innovating and eventually most interesting conclusions,

without getting into mathematical details and not describing the methods and the tools used to achieve

the project’s results.

See images in http://www.renatoroque.com/EspelhosMatriciais/index.htm

Matrix Mirrors is a photographic project on human identity and about the way identity is associated with

the image of the human face, namely trough the use of photography. Natural and artificial mirrors were

the first artifacts capable of reproducing the human face. Photography - a mirror with memory, the way

the photography process was described by Daguerre when it was invented - allowed an easy and durable

representation of the human face. Matrix Mirrors has a close relationship with the history of Photography

and the way photography has been used, nearly from its beginning, more than 150 years ago, to identify a

person, using face portraits. In a way Matrix Mirrors makes use of special mirrors (matrix mirrors),

constructed as matrix of numbers, matrixes which reflect the essential information contained in the human

faces. How do we recognize a friend, how does he recognize us? What difference is there between my face

and my neighbors’ face? What difference exists between a man and a woman’s face? Between an

European and an African? What new information can I find in a new face of someone whom I have never

seen before? How can I make use of it? All these are questions which Matrix Mirrors tries to address, trying

to reach the essence of photography and using a set of mathematical and scientific tools to work the image

information.

Since the beginning of Humanity the human face has been the most recognizable mark to identify a person.

Humans believe that we all look very different and therefore we are all easy to recognize. Even in our days,

although other more reliable methods of identification have been developed, such as fingerprints or DNA,

the image of the face remains as the everyday’s way to identify friends or acquainted, and the face portrait

remains as an essential part of every ID. These facts are related with the very complex and sophisticated

mechanisms that humans developed, creating specialized areas in the brain (just for faces), to get a quick

and very efficient identification, based on a human face image. It is easy to understand the importance

that such sophisticated mechanisms must have had for the human specie survival: the efficiency of those

mechanisms might signify in many situations escaping from death.

Because of the importance the face image plays in human culture, it is not surprising that it has been a

main subject for art, in particular painting and sculpture. Painting and sculpture have for centuries played

the role of registering the human face, eventually with the illusion of achieving eternity for the portrayed.

But painting and sculpture were reserved for kings, for popes and nobles. Photography introduced a huge

change. Photography made it not only possible but very easy to register everyone’s face. The simplification

and popularity of the photographic process turned photography into the best and the accepted process to

produce the images of faces, and therefore produce images to be the basis of the identification process.

Therefore photography was quickly accepted as the way to obtain portraits used for identification.

Photography was easy, cheap and appeared to be much more reliable and objective. Documents such as

IDs or passports had a simple way of getting an image which could be used for a quick, simple and efficient

identification.

Because photography quickly replaced painting in human representation, it will be not a surprise that

human portrait is an important part of Photography’s history, since its beginning in the middle of the XIXth

century. But when we refer to Photography’s history we should not only address the well known portraits

from pioneer photographers like Nadar or Julia Margaret Cameron and portraits made by most of the best

known photographers ever, from all over the world, but as well a darker side of Photography’s history,

related with the authority of the state, police files and even essays to use photography as a support for

oppression and even racist theories.

In Matrix Mirrors project 439 portraits were made in Oporto University: students, teachers and staff from

the University, men and women, from 18 up 65 years old. These face portraits were used to construct a

face database with 400 faces – the other 39 were put apart for tests - and a set of mathematical and image

processing tools were used to obtain essential sets of information from all those portraits. These essential

information elements, which could be seen as information which is an important part of all portraits, are

called components. Curiously these components, calculated using those mathematical tools, represented

as photographs, look like abstract faces.

What is more relevant is that adding those components in the right percentage, all portraits can be very

rapidly constructed. Actually only about 20 to 30 components are necessary to get a portrait which is

recognizable by most people. Questionnaires were used and their results were analyzed using scientific

tools to prove it. In reality, the components calculated in Matrix Mirrors, using different techniques,

proved to be able to construct very rapidly not only portraits from inside the database, but as well portraits

from someone else. Curiously the experiments indicate clearly that women faces can be reconstructed

from men and the opposite is also true, and it was discovered that for example an African face can be

reconstructed adding up components which were calculated using a database of what we might call, by

simplification, "white people". All these results indicate that, against perhaps our intuition, all human faces

are in fact very similar, which allows an easy recuperation of essential components from a quite small

database and a rapid reconstruction of any face, man or woman, European, Asian or African. Will it be

possible to construct a virtual portrait Babel Archive1, containing all real and virtual human portraits?

Besides calculating and experimenting components, which were obtained using different image processing

techniques, a set of more trivial statistical calculations were also made, using the portrait database from

the project. Average, standard deviation, skew and kurtosis portraits were calculated and analyzed, and

very interesting results were achieved. It was discovered that statistical portraits, such as average or

standard deviation, for different groups, for example men and women, have different characteristics,

which could be identified as representing those group characteristics, which corresponds to what could be

expected. But at the same time it was observed that a mixed group of only about 50 persons, including

individuals from all groups, drives to an average and other statistical portraits which are nearly not

distinguishable from the total. Let's just concentrate on the average portrait because it the simplest and try

to reason what the results might signify. Apparently having 50, 100, 200, 400, or eventually one million

persons appears to give exactly the same average portrait. This allows us to believe that the statistical

portraits that we calculated, in particular the average portrait could be presented as the image of

Humanity. Although this belief could be better evidenced with an enlarged database, just containing more

Africans and Asians, the results which we obtained with statistical portraits, in pair with the described

results with reconstruction of human portraits using components, give us enough fundaments to state

that the average portrait calculated could be seen as the humanity average. The same arguments could be

applied for other statistical portraits.

Instead of an infinite number of faces could we come into a unique image as a representation of Mankind?

©Renato Roque, 2010

1 Babel Library is a very famous José Luís Borges’s story, where he addresses the infinite concept and describes an imaginary infinite library – Babel

Library - which would contain all books, all texts ever written, in the past, present or future, in all languages, by Humanity.