Chef Gormaand

Hello, readers. Hope your Life Days went well. The blog is kicking off 2016 by continuing to take the Star Wars universe down another peg, here, at this heady time of its revival. Yes, yes, I’ll get back to The Avengers soon. But for now, someone’s in the kitchen with Malla.

SWHS-Gormaand-01

After she loses 03:37 of  her life calmly eavesviewing a transaction at a local variety shop, she sets her sights on dinner. She walks to the kitchen and rifles through some translucent cards on the counter. She holds a few up to the light to read something on them, doesn’t like what she sees, and picks up another one. Finding something she likes, she inserts the card into a large flat panel display on the kitchen counter. (Don’t get too excited about this being too prescient. WP tells me models existed back in the 1950s.)

In response, a prerecorded video comes up on the screen from a cooking show, in which the quirky and four-armed Chef Gourmaand shows how to prepare the succulent “Bantha Surprise.”

SWHS-Gormaand-04

And that’s it for the interaction. None of the four dials on the base of the screen are touched throughout the five minutes of the cooking show. It’s quite nice that she didn’t have to press play at all, but that’s a minor note.

The main thing to talk about is how nice the physical tokens are as a means of finding a recipe. We don’t know exactly what’s printed on them, but we can tell it’s enough for her to pick through, consider, and make a decision. This is nice for the very physical environment of the kitchen.

This sort of tangible user interface, card-as-media-command hasn’t seen a lot of play in the scifiinterfaces survey, and the only other example that comes to mind is from Aliens, when Ripley uses Carter Burke’s calling card to instantly call him AND I JUST CONNECTED ALIENS TO THE STAR WARS HOLIDAY SPECIAL.

Of course an augmented reality kitchen might have done even more for her, like…

  • Cross-referencing ingredients on hand (say it with me: slab of tender Bantha loin) with food preferences, family and general ratings, budget, recent meals to avoid repeats, health concerns, and time constraints to populate the tangible cards with choices that fit the needs of the moment, saving her from even having to consider recipes that won’t work;
  • Make the material of the cards opaque so she can read them without holding them up to a light source;
  • Augmenting the surfaces with instructional graphics (or even air around her with volumetric projections) to show her how to do things in situ rather than having to keep an eye on an arbitrary point in her kitchen;
  • Slowed down when it was clear Malla wasn’t keeping up, or automatically translated from a four-armed to a two-armed description;
  • Shown a visual representation of the whole process and the current point within it;

…but then Harvey wouldn’t have had his moment. And for your commitment to the bit, Harvey, we thank you.

bantha-cuts

The Groomer

The groomer is a device for sale at the Wookie Planet Trading Post C by local proprietor Saun Dann. It looks like a dust brush with an OXO designed, black, easy-grip handle, with a handful of small silver pushbuttons on one side (maybe…three?), and a handful of black buttons on the other (again, maybe three). It’s kind of hard to call it exactly, since this is lower-res than a recompressed I Can Haz Cheezburger jpg.

SWHS-groomer-02

Let’s hear Saun describe it to the vaguely menacing Imperial shopper in his store.

Besides shaving and hair trimming, it’s guaranteed to lift stains off clothing, faces, and hands. Cleans teeth, fingers and toenails, washes eyes, pierces ears, calculates, modulates, syncopates life rhythms, and can repeat the Imperial Penal Code—all 17 volumes— in half the time of the old XP-21. Just the thing to keep you squeaky clean.

There are so many, many problems with this thing. On every level it’s wretched. Continue reading

Rebel videoscope

Talking to Luke

SWHS-rebelcomms-02

Hidden behind a bookshelf console is the family’s other comm device. When they first use it in the show, Malla and Itchy have a quick discussion and approach the console and slide two panels aside. The device is small and rectangular, like an oscilloscope, sitting on a shelf about eye level. It has a small, palm sized color cathode ray tube on the left. On the right is an LED display strip and an array of red buttons over an array of yellow buttons. Along the bottom are two dials.

SWHS-rebelcomms-03

Without any other interaction, the screen goes from static to a direct connection to a hangar where Luke Skywalker is working with R2-D2 to repair some mechanical part. He simply looks up to the camera, sees Malla and Itchy, and starts talking. He does nothing to accept the call or end it. Neither do they. Continue reading

Imperial-issue Media Console

SWHS-mediaconsole-01

When she wonders about Chewbacca’s whereabouts, Malla first turns to the Imperial-issue Media Console. The device sits in the living space, and consists of a personal console and a large wall display. The wall display mirrors the CRT on the console. The console has a QWERTY keyboard, four dials, two gauges, a sliding card reader, a few red and green lights on the side, and a row of randomly-blinking white lights along the front.

SWHS-mediaconsole-02

Public Service Requests

As Malla approaches it, it is displaying an 8-bit kaleidoscope pattern and playing a standard-issue “electronics” sound. Malla presses a handful of buttons—here it’s important to note the difficulty of knowing what is being pressed when the hand we’re watching is covered in a mop—and then moves through a confusing workflow, where…

  1. She presses five buttons
  2. She waits a few seconds
  3. As she is pressing four more buttons…
  4. …the screen displays a 22-character string (a password? A channel designation?) ↑***3-   ↓3&39÷   ↑%63&-:::↓
  5. A screen flashes YOU HAVE REACHED TRAFFIC CONTROL in black letters on a yellow background
  6. She presses a few more buttons, and another 23-character string appears on screen ↑***3-   XOXOO   OXOOX   XOOXO-↑ (Note that the first six characters are identical to the first six characters of the prior code. What’s that mean? And what’s with all the Xs and Os? Kisses and hugs? A binary? I checked. It seems meaningless.)
  7. An op-art psychedelic screen of orange waves on black for a few seconds
  8. A screen flashes NO STARSHIPS IN AREA
  9. Malla punches the air in frustration.

Continue reading

The holocircus

To distract Lumpy while she tends to dinner, Malla sits him down at a holotable to watch a circus program. She leans down to one of the four control panels inset around the table’s edge, presses a few buttons, and the program begins.

SWHS-holotable02

In the program small volumetric projections of human (not Wookie) performers appear on the surface of the table and begin a dance and acrobatic performance to a soundtrack that is, frankly, ear-curdling.

Continue reading

The Star Wars Holiday Special (1978)

This week, to celebrate both the holiday and the release of a new film in the Star Wars, universe, we pause the ongoing review to return briefly to the interfaces of an old, wretched entry in this ongoing saga.

Release Date: 17 November 1978 (USA)

massive-spoilers_sign_color

Han and Chewbacca are flying back to the Wookie home world Kazook [sic] for Life Day (read: Christmas) but encounter some imperial trouble which delays them. Worried, Chewie’s wife Malla makes several video calls on an illegal and hidden rebel communication device to try and find his whereabouts, and receives assurances that they are on their way. Then she attempts to cook Bantha Surprise while watching a local-cable cooking show by the eccentric, four-armed Chef Gormaanda.

Family friend Saun Dann arrives with gifts for each of them—including an erotic VR brain implantation chair for Chewbacca’s father Itchy—even as the Empire declares martial law on the planet. Princess Leia and C-3PO contact Malla and ask Saun Dann to look after the family. Stormtroopers arrive at the door to search the place for Solo and Chewbacca. One of the Imperial officers inspects a hologram-box and spends a few minutes to enjoy a music video on it. Saun is coerced to leave.

Alone, the young Wookie named Lumpy proves to be a nuisance to the stormtroopers during their search, so the family distracts him by having him watch a cartoon of Boba Fett and Darth Vader. Finally satisfied that the rebels are not there, the stormtroopers leave and Lumpy finally checks out the video introduction to the electronics kit left him as a gift by Saun. He uses the kit to build a television and watch a live-broadcast local television program. The program is interrupted by the announcement of an Imperial curfew being imposed.

An individual stormtrooper, B4-7-11, returns to the home to threaten Lumpy, but is intercepted by Han and Chewie, who have finally arrived. They defeat him and Han leaves. Saun returns and answers a call from an Imperial officer, lying about the fate of B4-7-11 . Saun leaves, and the Wookies finally undertake their Life Day rituals.

The main ritual involves donning robes, passing into a ball of light that teleports them to the Tree of Life, where they are joined by other Wookies, as well as R2-D2, C-3PO, Han Solo, and Princess Leia, who have teleported here by some unknown means. The English-speaking characters make a speech before Leia sings a traditional song. This causes Chewbacca to go into a reverie, recalling his recent adventures with the Rebellion, always from odd out-of-body ,third-person perspectives, as if from camera droids littered about the galaxy.

After Chewbacca’s reverie, they return home, sit at the table for dinner, and bow their heads in reverent prayer.


 

On most overviews I include links to purchase or view the film. But as this entire film is available on YouTube, it is included, in full, below. Analyses follow.

 

 

 

 

Orange/blue SHIELD Agent Interfaces

The SHIELD helicarrier cockpit has dozens and dozens of agents sitting at desktop screens, working 3D mice and keyboards, speaking to headsets, and doing superspy information work.

Avengers-helicarrier-agent02

The camera mostly sweeps by these interfaces, never lingering too hard on them. It’s hard to see any details because of the motion blur, but given the few pauses we do see:

  • Wireframe of the helicarrier (A map to help locate problems?)
  • Gantt chart (Literally for the nascent Avengers initiative?)
  • Complex, node-network diagram (Datamining as part of the ongoing search for Loki?)
  • View of a flying camera pointing down. (You might think this is a live view from the bottom of the Helicarrier, but it’s above water, and this seems to be showing land, so recorded? part of the search?)
  • Live-video displays of cameras around the Helicarrier

There are others that appear later (see the next entry) but these bear some special note for a couple of reasons.

  • The ones that are instantly recognizable make sense at this glanceable level.
  • I couldn’t spot any repeats, even among the fuidget-filled screens (this represents a lot of work.)
  • The screens are all either orange or blue. Not as in orange and blue highlights. I mean each screen is either strictly values of orange or strictly values of blue. Maybe cyan.

Continue reading

scifiinterfaces presents: STRANGE DAYS in 35mm

ordernow

December 30 only

In San Francisco and looking to see a dark, disturbing New Year’s Eve themed science fiction film just before 2015 ends? Who isn’t? On December 30th, come to the Roxie Theater to join Chris Noessel, Design Fellow at Cooper, keeper of scifiinterfaces.com, and the co-author of Make It So: Interaction Design Lessons from Science Fiction for a viewing of Strange Days: a twisted, recursive, techno-serial-killer brain-interface thriller. The movie was written by TERMINATOR great James Cameron, Scorsese-compadre Jay Cocks, and features an all star cast led by Ralph Fiennes as the anti-hero Lenny Nero and Angela Bassett as “Mace” Mason, whose performance won her a Saturn award for Best Actress. The film also earned director Kathryn Bigelow (POINT BREAK, THE HURT LOCKER) a Saturn for best director.

It’s neither available on Blu-ray nor for streaming in the US, so you won’t want to miss this rare 35mm presentation. If you thought Brainstorm’s anti-corporate take on telexperience tech lacked bite, you will want to see this take on what telexperience tech would mean to psychopaths. Note that it’s rated R, not really a kid’s film, here.

For those familiar with prior scifiinterfaces movie nights, this is a LONG movie, and so there will be only the briefest of introduction presentations.

1995, 146 minutes, 35mm

ordernow

Grabby hologram

After Pepper tosses off the sexy bon mot “Work hard!” and leaves Tony to his Avengers initiative homework, Tony stands before the wall-high translucent displays projected around his room.

Amongst the videos, diagrams, metadata, and charts of the Tesseract panel, one item catches his attention. It’s the 3D depiction of the object, the tesseract itself, one of the Infinity Stones from the MCU. It is a cube rendered in a white wireframe, glowing cyan amidst the flat objects otherwise filling the display. It has an intense, cold-blue glow at its center.  Small facing circles surround the eight corners, from which thin cyan rule lines extend a couple of decimeters and connect to small, facing, inscrutable floating-point numbers and glyphs.

Avengers_PullVP-02.png

Wanting to look closer at it, he reaches up and places fingers along the edge as if it were a material object, and swipes it away from the display. It rests in his hand as if it was a real thing. He studies it for a minute and flicks his thumb forward to quickly switch the orientation 90° around the Y axis.

Then he has an Important Thought and the camera cuts to Agent Coulson and Steve Rogers flying to the helicarrier.

So regular readers of this blog (or you know, fans of blockbuster sci-fi movies in general) may have a Spidey-sense that this feels somehow familiar as an interface. Where else do we see a character grabbing an object from a volumetric projection to study it? That’s right, that seminal insult-to-scientists-and-audiences alike, Prometheus. When David encounters the Alien Astrometrics VP, he grabs the wee earth from that display to nuzzle it for a little bit. Follow the link if you want that full backstory. Or you can just look and imagine it, because the interaction is largely the same: See display, grab glowing component of the VP and manipulate it.

Prometheus-229 Two anecdotes are not yet a pattern, but I’m glad to see this particular interaction again. I’m going to call it grabby holograms (capitulating a bit on adherence to the more academic term volumetric projection.) We grow up having bodies and moving about in a 3D world, so the desire to grab and turn objects to understand them is quite natural. It does require that we stop thinking of displays as untouchable, uninterruptable movies and more like toy boxes, and it seems like more and more writers are catching on to this idea.

More graphics or more information?

Additionally,  the fact that this object is the one 3D object in its display is a nice affordance that it can be grabbed. I’m not sure whether he can pull the frame containing the JOINT DARK ENERGY MISSION video to study it on the couch, but I’m fairly certain I knew that the tesseract was grabbable before Tony reached out.

On the other hand, I do wonder what Tony could have learned by looking at the VP cube so intently. There’s no information there. It’s just a pattern on the sides. The glow doesn’t change. The little glyph sticks attached to the edges are fuigets. He might be remembering something he once saw or read, but he didn’t need to flick it like he did for any new information. Maybe he has flicked a VP tesseract in the past?

Augmented “reality”

Rather, I would have liked to have seen those glyph sticks display some useful information, perhaps acting as leaders that connected the VP to related data in the main display. One corner’s line could lead to the Zero Point Extraction chart. Another to the lovely orange waveform display. This way Tony could hold the cube and glance at its related information. These are all augmented reality additions.

Augmented VP

Or, even better, could he do some things that are possible with VPs that aren’t possible with AR. He should be able to scale it to be quite large or small. Create arbitrary sections, or plan views. Maybe fan out depictions of all objects in the SHIELD database that are similarly glowy, stone-like, or that remind him of infinity. Maybe…there’s…a…connection…there! Or better yet, have a copy of JARVIS study the data to find correlations and likely connections to consider. We’ve seen these genuine VP interactions plenty of places (including Tony’s own workshop), so they’re part of the diegesis.

Avengers_PullVP-05.pngIn any case, this simple setup works nicely, in which interaction with a cool media helps underscore the gravity of the situation, the height of the stakes. Note to selves: The imperturbable Tony Stark is perturbed. Shit is going to get real.

 

Avengers, assembly!

Avengers-lookatthis.png

When Coulson hands Tony a case file, it turns out to be an exciting kind of file. For carrying, it’s a large black slab. After Tony grabs it, he grabs the long edges and pulls in opposite directions. One part is a thin translucent screen that fits into an angled slot in the other part, in a laptop-like configuration, right down to a built-in keyboard.

The grip edge

The grip edge of the screen is thicker than the display, so it has a clear, physical affordance as to what part is meant to be gripped and how to pull it free from its casing, and simultaneously what end goes into the base. It’s simple and obvious. The ribbing on the grip unfortunately runs parallel to the direction of pull. It would make for a better grip and a better affordance if the grip was perpendicular to the direction of pull. Minor quibble.

I’d be worried about the ergonomics of an unadjustable display. I’d be worried about the display being easily unseated or dislodged. I’d also be worried about the strength of the join. Since there’s no give, enough force on the display might snap it clean off. But then again this is a world where “vibrium steel” exists, so material critiques may not be diegetically meaningful.

Login

Once he pulls the display from the base, the screen boops and animated amber arcs spin around the screen, signalling him to login via a rectangular panel on the right hand side of the screen. Tony puts his four fingers in the spot and drags down. A small white graphic confirms his biometrics. As a result, a WIMP display appears in grays and amber colors.

Avengers-asset-browser05

Briefing materials

One window on the left hand side shows a keypad, and he enters 1-8-5-4. The keypad disappears and a series of thumbnail images—portraits of members of the Avengers initiative—appear in its place. Pepper asks Tony, “What is all this?” Tony replies, saying, “This is, uh…” and in a quick gesture, places his ten fingertips on the screen at the portraits, and then throws his hands outward, off the display.

The portraits slide offscreen to become ceiling-height volumetric windows filled with rich media dossiers on Thor, Steve Rogers, and David Banner. There are videos, portraits, schematics, tables of data, cellular graphics, and maps. There’s a smaller display near the desktop where the “file” rests about the tesseract. (More on this bit in the next post.)

Briefing.gif

Insert standard complaint here about the eye strain that a translucent display causes, and the apology that yes, I understand it’s an effective and seemingly high-tech way to show actors and screens simultaneously. But I’d be remiss if I didn’t mention it.

The two-part login shows an understanding of multifactor authentication—a first in the survey, so props for that. Tony must provide something he “is”, i.e. his fingerprints, and something he knows, i.e. the passcode. Only then does the top secret information become available.

I have another standard grouse about the screen providing no affordances that content has an alternate view available, and that a secret gesture summons that view. I’d also ordinarily critique the displays for having nearly no visual hierarchy, i.e. no way for your eyes to begin making sense of it, and a lot of pointless-motion noise that pulls your attention in every which way.

But, this beat is about the wonder of the technology, the breadth of information SHIELD in its arsenal, and the surprise of familiar tech becoming epic, so I’m giving it a narrative pass.

Also, OK, Tony’s a universe-class hacker, so maybe he’s just knowledgeable/cocky enough to not need the affordances and turned them off. All that said, in my due diligence: Affordances still matter, people.