At the end of the process, it should be clear, you have explicitly identified an educational deficit which is also the act of learning we are performing together. That should imply the possibility of further learning for other people. It should also imply the possibility of your being part of the relationships that teach them. So if there were to be a further set of revisions in your thinking, whether or not in this essay form, they might center around how you can—to offer a recent cliche—be the change you want to see in the world.

Technological ignorance

The problem

Piercing the veil

Ideal environment for misuse of power

The basis for ignorance

Way forward

Still vaporware, delayed again, is it not? Insanely great, to be, one day, it is. No doubt?

provoked me to question the impact of DAs on humanity, specifically on behavior, privacy and agency.

Potentially. But children adeptly speak different languages with different persons, which might also "potentially" mean that they will use machine-speak with machines, as my high-school French teacher in his childhood spoke French with his parents, German with his nursemaid, and Russian with the cook. And these "natural language" voicebrowsing products will grow up too, right? Hinging our long-term analysis on the current state of the software is likely to result in the obsolescence of the analysis before the replacement of the product.

Really? Sending the servants out of the room and regulating one's speech "devant les enfants" has been convenient enough for the last several thousand years.

The most interesting avenue for improvement here, in my opinion, begins by rewriting to eliminate the metonymy, the container for the thing contained, that dominates the essay now. The object, the "DA," is just another dense sensor aggregation, a device for collecting behavior, like the phone and (soon) the car. You are talking about the meaning of the tentacle with the eyeballs and the eardrums on the end of it, as though the rest of the organism---and most importantly the intelligence in it created by the software you can't see, read or understand---didn't exist. This isn't "Alexa," or "Echo," it's Amazon, which is to the Machine overall what KGB was to the Soviet Union: an organization for creating and protecting a structure of power. (Not for nothing were and are such entities referred to as "organs" [of state security].)

If you want to work with me next semester, we can discuss the Fourth Amendment aspects of this arrangement more closely. For the moment, however, the State is a bystander to the metabolic relation between humans and this other entity, whose sense organs are being "behaviorally implanted" throughout the human world. Power arrangements are being remade. Concentrating on what has already happened means treating the things with appropriate disrespect: they are mere anatomical details. Understanding the elephant is not necessarily advanced by thinking of the spy satellite at the end of its trunk as "Bob," or "Alexa," or Carol, Ted and Alice altogether. That humanizes, deliberately, what it is crucial to experience fully as not-human.

"Alexa, ..."

-- By LaraNurick - 01 Nov 2017

Introduction

I recently witnessed an apparently endless line of people waiting for free giveaways of the newly launched Google Home Mini ‘Digital Assistant’ (‘DA’). The current proliferation of DAs, from Amazon’s Echo, (which goes by ‘Alexa’), to Apple’s HomePod? , provoked me to question the impact of DAs on humanity, specifically on behavior, privacy and agency.

DAs

DAs are voice controlled, cloud-based speakers which use on-device keyword spotting. DAs are activated by wake words, upon which they act and then resume their sleep. Common uses include setting timers, alarms, appointments, calling or messaging, playing music and games, checking weather and traffic, making shopping lists and purchases as well as controlling the rapidly increasing third-party smart home appliances with compatible software. Since Amazon, the market leader, first released its Echo in 2014, its capabilities and user base have continually expanded. Last week, CEO Jeff Bezos claimed, “customers have purchased tens of millions of Alexa-enabled devices…and active customers are up more than 5 times since the same time last year”. Approximately 35.6 million Americans use a DA, with Gartner projecting a quarter of all household requests will use DAs by 2019.

What's at stake?

Behaviour

Using technology to mediate and action basic human needs is fundamentally altering human interaction. As Sherry Turkle warns, it conditions us to “expect more from technology and less from each other”. Whilst DAs’ hands-free centralized control is highly convenient and may benefit the disabled and the elderly; children’s behavior may be at risk. Although children enjoy the speedy access to information and available games along with the simulated company of DAs, research suggests the impact of increasing mediated interaction and the DAs’ lack of emotional intelligence may promote the use of simplistic language and inquiry, bad manners, compromised adult-child communication along with the need for instant gratification. DAs value simple clear diction over niceties and patience, potentially leading children to adopt similar behavior in all interactions.

Privacy

Amazon’s Echo comprises two speakers, seven microphones and omnidirectional audio. When it detects its wake word ‘Alexa’, it streams what it hears as well as the fraction of a second beforehand to the cloud. This is troublesome because this information likely contains fragmentary intimate conversation which cumulatively may reveal significant information from within the most private of places; the home. While the Fourth Amendment historically provides the idea of an inviolate home, the controversial third-party doctrine suggests that one’s privacy may be overridden when one voluntarily shares information from inside the home with a third-party corporation. This was discussed following James Bates’ murder trial where police requested DAs’ recordings for the first time. While Amazon initially refused, these were eventually given up consensually, precipitating unresolved privacy questions. As DAs prevalence proliferates, moot questions arise regarding the operation of state law and the use of DA recordings where unknowing guests may be recorded, especially in states that require both parties consent for recordings. This issue is exacerbated by companies’ efforts to camouflage DAs within one’s home decor by improving their appearance, possibly making users even less aware of their potential intrusion. Bates’ case therefore highlights DAs’ potential to exploit owners and their invitees. It also confirms that companies like Amazon retain data indefinitely. Although deletion of information is possible on DAs, it is strongly discouraged as it “may degrade your Alexa experience” since DAs “get better over time” by processing speech, timbre and accents. For the majority of purchasers of DAs for convenience, deletion is counter to optimization and seems unviable. Moreover, manually turning a DA off fundamentally undermines its ‘beck-and-call’ utility. This compromise of privacy and agency for convenience may prove too high a tradeoff.

Notably, whilst devices like smartphones and apps like Facebook, FaceTime? and Skype already impinge on the private domain of the home, these differ in that they are not permanent fixtures in the home, are not necessarily always on, require more deliberate engagement and active "interfacing with a screen"; and do not automatically impact their non-immediate users and surroundings. Additionally, whereas the privacy implications of DAs are still largely unknown and spoken conversation is not yet as self-conscious as written communication, there is greater public awareness of the privacy compromises entailed in using these other services.

Surveillance

With the increasing use of DAs and corresponding fast paced product development, their potential capacity for surveillance appears limitless. Whereas first generation Echos had rudimentary voice capabilities, the recent Echo Look is a fashion assistant that is placed in the consumer’s most intimate closet or bathroom. It has inbuilt “hands-free camera, built-in LED, depth-sensing and computer vision-based background”. DAs now have “a brain, an ear and an eye”.

Moreover, DAs are always alert, enabling them to register their wake words. While companies insist this is passive, non-transmitting listening, the recent Google Home Mini incident, whereby the device recorded and transmitted everything it heard persistently due to defective touch-sensitive panels, demonstrates the precariousness of this always-on state and its potential for company/government/hacker exploitation. This evidences DAs’ technical sensitivity and inbuilt recording capability and the ease with which through a software update, physical exploit or glitch, the device transforms beyond consumers’ control.

Agency

If DAs perform human tasks, are privy to and participate in human conversation and punctuate daily behaviors, they may soon predict human thought and action it independently. This is troublesome. The more capable and humanized the machine becomes the more DAs will be embedded in the human psyche. This reliance on the machine by humans, who are traditionally defined by their capacity for independent thought and responsive action, paradoxically increases the chances of a role reversal whereby the consumer becomes consumed by the machine.

Given Aral Balkan’s observation that “data about us is us” as it can reveal everything about us, the potential issues with, and capabilities of DAs are problematic. Profit-motivated companies must ultimately decide how to use such data. This data allows them to make use of and influence the users’ behavior, thereby depriving humans of their agency and giving DAs a life of their own.

• #Set ALLOWTOPICVIEW = TWikiAdminGroup, LaraNurick
• #Set DENYTOPICVIEW = TWikiGuest

Note: TWiki has strict formatting rules for preference declarations. Make sure you preserve the three spaces, asterisk, and extra space at the beginning of these lines. If you wish to give access to any other users simply add them to the comma separated ALLOWTOPICVIEW list.