Section 1 | Thesis Ressentir

VISUAL LANGUAGE

Visuals are powerful and can communicate unimaginably complex information in an effortless way. Man has been relying on visuals to communicate not just ideas but also tell stories for several thousand years. We can assimilate more information through drawings and pictures in no time. Shapes , colors and visual pulses influence design to a great extent.

This thesis project sheds light on an approach where use of articulated visuals layers can literally replace the sensation that audio can produce. Creating a universal visual language is by itself a herculean task , especially ,when there's subjectivity it becomes much harder to stick to a specified approach.

Creating a system

A cohesive visual system containing multiple layers stacked upon one another , driven by audio wave-forms.

Combining elements

There are three elements that make up this system. Color , shape and beat. Each element plays a vital role in summarizing the emotion and context attached to a scene.

Defining behavior

Visualizer changes based on the intensity of scene and audio waves associated with it , which may include dialogs , music and additional background sounds that make up the audio component of a scene.

VISUALIZER

In order to create a comprehensible system ,every language must follow a set of rules. To avoid confusion , I have developed a system involving a layers approach. When we add more visuals , information that needs to conveyed becomes precise giving the viewer a specified direction.

But that being said , it becomes complicated to assimilate that much information in a short span of time. The idea of utilizing a layered and biased approach is to give priority to visuals ( within the filter ) in a very smart manner, so that the filter would provide enough information without making it hard for the audience to follow along.

Prototype

Each level is driven by a formula or a python field integrated in a 3D software called Cinema 4D. The field system , the shape or orientation of particles and color together determine the level . The levels correspond to intensity of the scene ,i.e how overwhelming or subtle a scene is, from the director's point of view.

This thesis project has given me confidence to believe that no matter how much a visual is manipulated and altered ,there is always room for subjectivity.

These are variations of the visualizer that includes shape , structure and rhythm of beat are integrated in the digital content either as an icon or an overlay.

Intensity levels

The language is defined by 3 parameters - Color , shape and pulse or beat of the visualizer. The intensity depends on the speed of pulse , warmth and saturation of colors and sharpness of the shape.

Intensity

Shape

Color Warmth

Pulse

Transition

This piece shows the gradual transformation of intensity levels across all categories - shape , beat and color ( top to bottom).

Grey-scale 2 dimensional representation of just the beats present in the visualizer, and how it changes based on intensity levels.

Colored versions corresponding to different emotions. Film language and terminologies have been

Inter-relationship

When audio is removed ,there's a lot needed to compensate for that loss. Sometimes it is not just sound , even camera movements and facial expressions can influence the emotion in a scene , which was originally made to gel with the audio.

Audio

Video

Script

Breakdown

For the system ( Artificial Intelligence ) to analyze and create a visual filter , the video with audio i.e. original footage ,must be broken down into multiple components

Audio