Ryan RotellaCreative technologist, Brooklyn

Writing

Notes on projects, process and tools. Some are written here, some on rotellatech.com.

APM Week 10: Storyboard v1 for Final

Prompt 60 seconds/1 minute of projection content Projection output resolution is 1280 x 800 Takes the building into consideration (pictured below) Interactive potentiality Building Reference Dumbo Station, under the Manhattan Bridge. Concept: Beverage Cart becomes Beverage Currently, the Dumbo Station is a beer/wine/beverage cart in the Dumbo Archway. I tried researching what its past was, …

APM Week 9: 3D

Initial Dreams of Final For our final, I’m dreaming of something ambitious but that can also be scaled down accordingly. I am envisioning the train cart to transform elementally. First, I want the train to be come an ice sculpture of itself, seeing frost come off the solid clear/bluish and having the chance to have …

APM Week 8: Unreal

Video Recording Update (watched Louise’s fix) Takeaways My greatest success I established the NDI connection from TouchDesigner to Unreal very easily. I thought it was pretty seamless to get TouchDesigner input into Unreal. My worst struggle I have no idea how to get my projection to render in Unreal. I can see that the NDI …

APM Midterm: Rod Serling Tribute

Output Process After iterating more, I designed a more direct and “simplified” version of my projection. I decided to use text to spell out exactly who I’m referencing so nothing gets lost to subtlety. I also included pictures of Rod Serling, including one of his statue with the famous Twilight Zone door behind him. Moreover, …

APM Week 5: Midterm, version 1

Concept Right now, my concept for the LUMA festival projection project midterm is still a little hazy, but I like the direction I’m heading in. In order to find inspiration to make a projection mapping story for this festival, I researched extensively into Binghamton, NY, where this annual projection mapping festival. This research yielded multiple …

APM Week 4: Audio and Mapping

Audio-Reactive I went ahead and made the Memo Atken-inspired lyric TouchDesigner sketch audio-reactive. Thought it was fitting considering it’s built around one of my favorite songs. Walkthrough below. Mapping: Labor History of NYC For the mapping prompt, I chose Challenge 3: Choose a historic building and tell a story relevant to the building. I chose …

Ripping Reality reaction

Reading Reaction I really loved this chapter from Hito Steyerl’s Duty Free Art. My head is still spinning from how many ideas and thinkers she packed into this writing, and I anticipate I’ll uncover more ideas as I sit with the piece longer. However, the main thing I takeaway from this excerpt now is the …

Response to The Work of Art in the Age of Mechanical Reproduction

Walter Benjamin’s classic 1935 essay still has more meaningful things to say about art, politics, and modes of production than most of our discourse today. I felt this incongruity between past and current thought most in his passages on the use of distraction in filmmaking. Benjamin writes, “A man who concentrates before a work of …

Thesis update 1

For this first round of building my thesis, I focused on how game-like my UI should be for my 3D social media site. Modern 2D web interfaces have strict rules around spacing and alignment, but having a 3D site means having to fuse those rules with how people usually navigate 3D worlds: video games. From …

Week 3: World-Building

Tutorial: Spirograph by Okamirufu Vizualizer I followed this tutorial by Okamirufu Vizualizer because I really love this surreal geometry that can also contain recognizable spiritual symbols. I want my world to defamiliarize people from their immediate surroundings and call into question all the invisible forces at play that are affecting our tangible world. My Documentation …

Are All Images now Poor Images?

Response to Poor Image This incredible article written by Hito Steyerl in 2009 analyzed the material conditions of the poor digitized image to a tee. The analysis is so on point that I feel this piece read the trend of corporate media to invest in profiting off of the digital ecosystem. “Digital communication has also …

APM Week 2: Generative Design

In Class Documentation Phone footage from Class OBS Documentation of Network TouchDesigner ZIP File Approaching Generative Design The effect from this book I would choose to model in TouchDesigner is: Typography, P_3_1_3_01 If I were to do it, I might twist it to show different messages as people put their hands in different places/gestures with …

Reaction to Photosculptures

The Reading My Reaction Reading about Francois Willeme’s photosculptures in mid-1800s France sparked a few reactions from me. First, I’m stunned that he and other French sculptors of the time were automating camera networks (activating quarter plate cameras with one trigger) and seeking to automate the sculpture making process. Historically, since the Industrial Revolution had …

My Ode To Cubism with MediaPipe

I think I may have misunderstood the assignment, as I did my own custom projection piece. No matter, here’s how it turned out. My Projection Disclaimer: I had to use two separate takes and put them together due to space being small, so it’s not the most accurate representation. But it is all real time! …

Out On The Field

by Ryan Rotella The hopes of my Saturday rest on the shoulders of 18 to 25 year old men who I’ll never know But who used to be my father, uncles, and grandfather On the field The men clad in armored pads and helmetsAllow me to project onto themManifesting more passion than most anywhere else in lifeMy side …

Thesis Progress Update 4

This week marked a significant pivot in my thesis direction. After exploring theatrical immersive performances over the past few weeks, I’ve decided to shift toward creating a satirical gambling app that reveals the gambling logic embedded throughout modern society. This experience will combine a mobile app built in Swift/SwiftUI with projection mapping via TouchDesigner, using …

YouTube: Entertainment Innovation

YouTube has fundamentally transformed how I consume media every day of my life. What started as a simple video-sharing platform of lip syncing and parodies has evolved into a digital behemoth that adapts to whatever I need at a given moment. For me, Youtube now functions as an oscillator of content between background noise and …

MoCap Final: Out On The Field

Enjoy the rough draft of my Masculine Movements in Football video collage. I re-targeted a lot of motion data in Blender using a process that my colleague, Galt, documented very well on his blog with my Python script that I created and in conjunction with Mwni’s blender-animation-retargeting plugin.

Thesis Progress Update 3

For my Research-by-Making these past 2 weeks, I made 2 storytelling projects in 2 different mediums. First, I made a video collage by using Motion Capture data retargeted to 3D models in Blender as well as archival footage of my grandfather, father, and uncles playing football. This was a final for my class, Mocap for …

An Ode To Bridges

iterated on sand castles: project link here I walked past the Manhattan Bridge the other day. It made me stop and wonder. How many workers did it take to build the whole thing? How many setbacks? How did anybody get people to agree to actually go out into the water and lift each stone to its …

Project Update before the Final Week

Currently, our final project (Capturing Movement in American Football) is underway and making good progress. We had our third motion capture session last Saturday, October 4th. For this session, I invited a friend who is an actor, Nick Yañez-Atkins, to don a suit and play the role of a coach in my football concept. He …

Sandcastles, or The Invisibility of Editing

project demo link Directors get all the credit. Whenever most people (myself included) watch a movie, they think, “Wow, that Martin Scorsese… how did he think of all this?” And while good directors do think of practically every aspect of making a movie, editors are the ones really sewing a movie all together. Thelma Schoonmaker …

Progress Update 2: Research Findings & Reflections

Research Findings: What I Learned Since establishing my initial inquiry space, I’ve pursued a focused research trajectory that has significantly shaped my understanding of participatory performance, therapeutic theater, and the tension between spectacle and genuine emotional engagement. Drama Therapy and Applied Theatre: A Critical Distinction Following my advisor Luisa’s feedback, I explored the drama therapy …

Designing a MoCap Narrative

I’ve been struggling with the exact narrative form I want this piece about football to have. Part of me wants to have an exact script with dialogue, fleshed out characters, and a clear narrative arc. Currently, I do not have time to do that for this project’s scope (finish in the next 2 weeks). However, …

Becoming HyperNormal

What is a cliche? It is a phrase, regardless of its truthfulness or lack of, that we have heard ad nauseam. Many come to mind: the grass isn’t always greener on the other side, you can’t judge a book by its cover, etc. They are, of course, culturally dependent with every group of people having …

Archiving American Football: Building a movement database

In developing my Motion Capture project on masculine movements in American football and how they provoke emotion, I’ve begun a more production-oriented phase. This stage focuses on designing a movement database: a catalog of specific gestures, stances, and sequences to be captured in motion. Characters and Embodied Roles So far, I have three loose character …

Space as Place: Cadman Plaza Park

Documented first project for my Outside The Box class via slideshow.

Trapped in Fragments

project code demo Each of us unfortunately is a product of our time. We all now live in a time of fragmentation. As Pinker notes, language itself is a marvelous intricate discrete combinatory system of words and logic that allows us to connect with one another, the construction of language is not in a vacuum. …

Pre-Thesis: Best Foot Forward

Prompt: Progress update 1: Inquiry space + inspiration repository. Inquiry space. Look at your concept map from class. What are your key areas of interest? These can be fields, themes, media, techniques. Draw a diagram describing your inquiry space. The idea is that it serve as a map, helping guide your research and, later, your …

Becoming a Football Player (again)

For this project of exploring masculine movements in American Football, I will be one of the characters in this project. There will be 3 main characters. One, I will play a football player, stepping back into a role that I played 14-15 years ago in high school. Two, there will be another player who is …