SHIFTING LENSES - MASTER OF ARTS RESEARCH
In 2016 Elise completed a Master of Arts (Research) at Queensland University of Technology (Part-time).
RESEARCH TITLE:
Shifting lenses: Investigating interdisciplinary approaches to the use of the moving image and digital media in live performance.
Masters by Research by Creative Works, Queensland University of Technology
Her research investigated the intersection between traditional modes of dance performance and other screen-based, interdisciplinary and hybrid approaches to the use of digital media and live performance.
ABSTRACT:
The use of digital technologies is becoming ubiquitous in contemporary dance performance practice, however rigorous questioning of the theatrical cohesion of live bodies, visual projections and digital technologies is still in its infancy. Through the lens of an embodied choreographic practice this research examines interdisciplinary perspectives on the intersecting knowledge fields of choreography, moving image, animation, installation and interactive technology. Utilising practice-led strategies, Shifting Lenses, a solo performance installation tested new and experimental relationships between movement vocabularies, digital projection, interactivity, and performance design; leading towards future development at the nexus points where digital technologies meet the body in live performance.
THESIS
To read Elise’s Thesis in full, please view via QUT E-Prints here
SHIFTING LENSES (EXCERPTS)
Choreography, moving image and performance: Elise May
Master of Arts Research Candidate 2015
Creative Industries
Queensland University of Technology
Animation: Paul Van Opdenbosch
Technical Production: Thomas Ash & Kyle Berry
Since I began creating work in my early career I have been concerned with notions of live performance existing in within a world of projected visual imagery. As a contemporary dance artist I have interacted with digital technology and visual imagery choreographically in order to communicate concepts in my work. In doing so, many curiosities and tensions have arisen within my practice which have raised questions about the relationship between the live body, and moving images.
As I embarked on my practice-led research the opportunity presented itself to experiment collaboratively with animator Paul Van Opdenbosch, using a Xsens MVN motion capture system. In working with this new technology and a new working relationship with Paul, I was able to gain a different perspective on my work and my movement data became the basis for three experimental generative animation outcomes.
In my research of the history of moving images and animation the concept of ‘chronophotography’ became of particular interest. I was really attracted to the way that the body’s movement could be fractured into smaller components in order to give more time for the viewer’s mind to perceive the temporal qualities of an action or movement.
I am concerned also with the sensory experience of object, time, space and context. My practice has suggested that images and bodies both ‘speak’ strongly of ideas and sensory experiences. I want to establish a space where they will co-exist in a dialogue with one another.
SHIFTING LENSES - A MARRIAGE OF DANCE & TECHNOLOGY
Article by Matt Chilton
In April 2016, I was lucky enough to catch a video screening of documentation from Shifting Lenses, a solo digital performance installation by May at QUT’s Parer Place in April. The installation was an immersive, engaging experience that was unlike anything I had ever seen before.
I was unsure what to expect as I approached the screening, which could only be viewed at night, the darkness illuminating the projected images. What was projected saw May as a solo silhouette dancing in front of a shifting backdrop. There was a synchronicity between her fluid movements and the digital background.
Through a Masters by research at QUT, May has been investigating the use of technology and dance.
Collaborating with animator Paul Van Opdenbosch, May developed an experimental and embodied practice-led research inquiry that examined interdisciplinary perspectives on the moving image, animation, installation and interactive technology.
The process of collaboration with Van Opdenbosch allowed May to experiment with motion capture technology where she could see her form and movements from any angle, represented digitally in motion capture software. Opdenbosch then created animations from her movement data.
“We were feeding the data from my body into the animation process [to create] these beautifully abstractive sometimes geometric, fluid and twisted shapes and really abstract concepts started coming from the body’s movement,” she explains.
Shifting Lenses incorporated three experimental animations that used XSENS motion capture technology in order to create generative animation outcomes. Van Opdenbosch explained that the suit uses the “same technology as the iPhone. It knows the rotational plane against the Earth’s magnetic core”.
The performance experimented with the concepts of both analogue and digital, in incorporating content that moved both towards and away from technological input.
Elise May Shifting Lenses – Photography: Fiona Cullen
“For a long time I’ve been interested in film and video making and this kind of marriage of digital technology or video with live body in performance,” says May.
Ultimately, May created an environment where an augmented reality of merged digital and live worlds encouraged an experience of heightened presence and embodiment through an intimate shared space between the performer and audience.
THE CONCEPT
I was curious to learn from May how she developed the concept for Shifting Lenses. She explained that she wanted to explore screen-based and interdisciplinary approaches to the use of the moving image and digital media in live performance.
While developing a digital element, May was also conscious of not going completely into the realm of technology.
“Trying to move it in both directions, both towards the digital but also back away from the digital,” she explains.
This was clear through the use of both analogue and digital methods. For example, May used an analogue approach through constructing a screen-like space without the use of technology.
Using a tower of mirrors, May was able to create a chronophotographic effect (a set of photographs of a moving object, taken for the purpose of recording and exhibiting successive phases of motion), from video motion capture without any digital input. She explains that the mirrors offered a “splintered, broken down compartmentalised view of the body against a very organic, real, fluid moving body”.
She explains that the mirrors offered a “splintered, broken down compartmentalised view of the body against a very organic, real, fluid moving body”.
The splintered, broken down compartmentalised view of the body against a very organic, real, fluid moving body
May using mirrors to create a chronophotography effect without the use of technology - Elise May Shifting Lenses – Photography: Fiona Cullen
One of the other sections of Shifting Lenses that May worked on used a piece of software called E-motion. E-motion is a wire frame grid but uses an Xbox Kinect sensor, which uses infrared technology.
Van Opdenbosch explains that “the Xbox sensor uses a depth sensor, so it registers how far away any part of you is from the camera and kind of renders out this grey scale, white’s closest black’s furthest away. The system would basically take her silhouette and move things around it”.
The program tracks the body in space, which allowed May to physically interact with the digital technology in order to affect the shapes, which appeared on a circular screen during her performance
May was interested in creating a similar sensation utilising existing technology and the human body.
“I experimented with this interaction, I wanted to achieve the effect of the body dancing in a duet with technology,” she says.
May interacting with the digital background – Elise May Shifting Lenses – Photography: Fiona Cullen
May explains that the intersection of dance and technology is moving beyond the early stages of experimentation – a body in front of a screen – towards what she perceives to be more exciting, integrated experimentation where dance, video and technology meet.
A CAREER IN DANCE
May realised at a young age that she wanted to pursue a career in dance. “I was really drawn to live performance because of the energy and the tangibility of performance”.
This led May to study a Bachelor of Fine Arts in Dance at QUT. After which she built on her performance and choreography skills as a freelance or independent artist.
In 2008 May joined Expressions Dance Company, where she is still working as a senior dancer. Through both her work in the industry and her innovative research, May believes that the dance industry should look towards combining performance and technology
“There’s more than meets the eye with this and it shouldn’t be viewed as just an outcome. Motion capture technology could be used as part of the training or part of the performance” explains Van Opdenbosch
May understands that digital innovations are changing the landscape of the dance industry very quickly. “I wouldn’t want dance or theatre to be left behind because it’s entrenched in a traditional setting, I believe we need to evolve as the context in which our performance exists continues to change”
Her exploration into the marriage of technology and the human body may just be the tip of the iceberg and it’ll be interesting to see how these two fields will intersect in the future.
By Matt Chilton - No Walls QUT Publication here
Video (above) Dance. Moving Image. Animation. Technology.
A live interactive digital solo performance installation; Shifting Lenses is the creative outcome of Elise May’s Master of Arts (Research)
Choreography, Moving Image and Performance: Elise May
Animation: Paul Van Opdenbosch
Technical Production: Thomas Ash and Kyle Berry
Music: Ólafur Arnalds – Fra upphafi, Alex Mein Smith – Necessity’s Flame
BACKGROUND - MOTION CAPTURE
Elise teamed up with fellow researcher and animator Paul Van Opdenbosch, to collaborate and experiment across the disciplines of dance and animation. They experimented with the motion capture technology (Xsens inertia-based system) and an optical motion-capture system to capture dance and gestural movement data and bring it into the digital environment where it has been manipulated and become the basis for a series of short experimental , abstract animation works
CONTOURS IN MOTION (With Data Points)
The data points in the following video correspond with the physical form of the human body. In generative animation, the animator uses data to set up ‘rules’ within the virtual environment or 3D space. By taking away the real world physics such as gravity, this cloth-like artifact behaves in a way governed by the data pre-sets and therefore ‘generates’ unexpected animated qualities.
THE ANIMATOR:
“...Building on the observations made in the prototyping section of this creative practice, I decided to retain the captured human dance movement as the sole input affecting the movement and form of the generated artefact by running the system within the void of the virtual 3D space without using any simulated world physics like gravity or a ground for the artefact to interact with. I also created a second version of the animation that visually displayed the captured data points as part of the animation. This animated artwork was presented to the viewer as a means to offer context for the work they were viewing....” PAUL VAN OPDENBOSCH
EXPERIMENT 1 : ABSTRACT ANIMATION USING MOTION CAPTURE
Animation: Paul Van Opdenbosch Choreography: Elise May
After our time logistically working out our collaboration might work, we decided to explore how the data might be interpreted visually. These experiments were our first outcomes in the collaboration process and were a testing ground for what might be possible. This animation is one of the outcome of preliminary experiments through practice aiming to explore the collaboration of a Dancer/choreographer with an Animator, along with enquiry into the intergeneration of motion capture technologies within the work-flow. The animated visuals derived from the motion capture data are not aimed at just re-targeting of movement from one source to another but looks at describing the thought and emotions of the choreographed dance through visual aesthetics.
EXPERIMENT 2 : ABSTRACT ANIMATION USING MOTION CAPTURE
Animation: Paul Van Opdenbosch Choreography: Elise May
SHIFTING LENSES (Full-length)
Music Recordings:
Ólafur Arnalds Fra upphafi
Alex Mein Smith Necessity’s Flame
Murcof: Ulysses (Deathprod Mix)
Trent Reznor & Atticus Ross: A Pause for Reflection
Scanner: Passage de Recherche
Shifting Lenses was performed on Thursday 2 July & Friday 3 July, 2015 at 6.30pm in the Woodward Theatre, Creative Industries, QUT, Kelvin Grove Brisbane, Australia.
Special Thanks to:
Paul Van Opdenbosch, Shaaron Boughen, Chris Carter, Kyle Berry, Thomas Ash, Fiona Cullen, Anthony Brumpton, Liesel Thompson and the Woodward Theatre team, QUT
Photography by Fiona Cullen
Further reading on Elise’s Master of Arts Research here