CHI2018

ACM, design, design research, HCI, hci research, Human-Computer Interaction, knowledge production, knowledge tools, research, science, SIGCHI, theory-practice gap

Looking forward to CHI2018 in Montreal, QC, Canada! This year I am humbled to be first author on one full paper and a contributing author on a second full paper. Two full papers! Huzzah! The first author paper examines the concept of the theory-practice gap as a generative metaphor. Here is the abstract:

The theory-practice gap is a well-known concept in HCI research. It provides a way of describing a space that allegedly exists between the theory and practice of the field, and it has inspired many researchers to propose ways to “bridge the gap.” In this paper, we propose a novel interpretation of the gap as a generative metaphor that frames problems and guides researchers towards possible solutions. We examine how the metaphor has emerged in HCI discourse, and what its limitations might be. We raise concerns about treating the gap as given or obvious, which could reflect researchers’ tendencies to adopt a problem solving perspective. We discuss the value of considering problem setting in relation to the theory-practice gap, and we explore Derrida’s strategy of “reversal” as a possible way to develop new metaphors to capture the relationship between theory and practice. (https://doi.org/10.1145/3173574.3174194)

I’m excited to talk about this ongoing project and discussing its potential with other members in the HCI research community. Onward!

doors-1767563_1920

Organizing for Causes and HCI

community informatics, community organizing, HCI, Human-Computer Interaction, organizing, organizing for causes, politics, research, science, SIGCHI

I’ve been wondering for a few months about how to orient my HCI work towards organizing for causes, and today I am pleased to say I started making some headway. I made a few connections with folks at the AAUP, and I’ve got messages out to folks at Action Network. At this stage, I’m curious to know more about organizers, activists, and community members engaged with different causes and, in particular, the role technology plays in supporting their activities. Seems as good a time as any to start doing this sort of work.

protest-2734408_1920

image: https://pixabay.com/photo-2734408/

Theory Use has not been framed as an HCI Problem

design, design research, HCI, HCI/d, Human-Computer Interaction, knowledge production, knowledge tools, research, science, scientific method, theory, theory building, theory development

Theory in HCI research appears to be of interest to a number of researchers working in the field. Theory use, which refers to the different roles or functions theory may play in scholarly research or publishing, is one way of exploring the topic, but, in my view, neither topic has been framed as an HCI problem.

Each has been framed as a problem of maturity (or, more accurately, one of immaturity) and, perhaps more recently, as a problem of identity. But these framings transcend the field of HCI research. They are (and have been) relevant to many other academic disciplines.

To the extent that HCI is grappling with its maturity (or immaturity) and/or its identity as an intellectual community, theory and theory use are relevant topics of study. But they have not been formulated or engaged with in terms of human-computer interaction. Such a formulation will be a necessary, good step forward in the discourse.

 

Rudders

design, design research, HCI, HCI/d, Human-Computer Interaction, Informatics, research, science, scientific method, Uncategorized

Research has the potential to move in many different directions. There are constraints, sure. But regardless of where one starts, multiple paths reveal themselves at each step. Choosing a path is crucial for making progress. Moreover, revisiting and refining the intentions motivating one’s travels down a particular path is important. There is always value in asking why we’re doing the work we’re doing. Asking and answering this question is like steering the rudder on a boat.

ship-470083_1920

New Citation Analysis Journal Pub

design, design research, HCI, hci research, research, science, Uncategorized

Great news! We sent the final author proof of our article Schön’s Intellectual Legacy: A Citation Analysis of DRS Publications (2010-2016) back to the copyeditors for publication at Design Studies, which is one of the premier journals in the design field.

The article should be online within a week or so of receiving the final proof (yesterday). So, hopefully you’ll soon be able to read the outcome of a project conceived at the 2015 EAD conference, initially published at the DRS2016, and extensively revised and submitted for Design Studies this year.

I’m pleased to add that Refseer, whose origin story begins with Citeseer, was recently rekindled, and we’re going to be exploring ways to apply and expand it within the scope of our citation analysis project.. Onward!

Community Data & Water Quality

design, design research, HCI, hci research, Human-Computer Interaction, research, science, Uncategorized

Most of my blog entries are announcements of publications or generic thought pieces about topics of interest. One thing I’d like to do differently going forward is keeping track of current research projects here at Penn State University’s Center for Human-Computer Interaction (C4HCI) as way of providing some insight and value to folks outside of my network; especially members of community organizations, local government, and industry.

water-2208931_1920

Community Data & Water Quality. A current project underway here at C4HCI has to do with water quality data as a kind of community data around which different stakeholders could organize and act. There are already several groups in State College collecting and analyzing water quality data, and our working assumption is that this data could be made accessible and interpretable to a wider group of residents.

In my view, and in an ideal case, the outcome of such would be a more data literate citizenry confident and capable to engage with local government around water quality (and other) policy and decision-making.

Tonight we held the first meeting of what we hope will be a series of conversations and workshops with folks who work for and with different water quality collection groups in Centre County, including: ClearWater Conservancy, PaSEC, WRMP, and Trout Unlimited. The goal of the meeting was to share our vision for a possible project built around water quality data and to engage in a meaningful conversation about what a collaboration between our groups could look like. The meeting was great. Our group learned a lot about the kinds of data these different organizations collect and about some of the barriers to sharing/using the data that we had not yet considered. We even identified a possible opportunity for supporting (one of) their efforts to build out an online resource for community members to learn more about water quality issues.

Looking forward to more!

the future of hci research

HCI, hci research, knowledge production, knowledge tools, peer review, philosophy of science, quality control, science, scientific method

My PhD advisor, Erik Stolterman, recently penned a blog post called hci research and the problems with the scientific method. It’s a good post and you should read it. It was motivated by a New Yorker article written a few years ago about the ‘decline effect’ in science, which refers to the phenomenon wherein at-first positive results of scientific experimentation decline over time. I’m simplifying here, but you can read more about it in the New Yorker piece itself or the Wikipedia page on the decline effect.

In any event, this article led Erik to speculate about the implications of this ‘problem’ with the scientific method for hci research, a field grappling with a dilemma that he describes as “[stemming] from a shared view that HCI is not really a scientific enterprise while at the same time scientific research is still valued and rewarded.” He then speculates about how hci will develop in relation to science and expresses optimism about where the field will go, and here is where my thinking picks up the thread.

His last paragraph makes me think about the possibility of greater diffusion of the field and what that means for something like ‘quality control,’ in other words, “the criteria to assess the quality of the work and the teams that carry it out,” in hci research. I’m using Gibbens et al.’s definition of quality control from their book ‘the new production of knowledge’.

Anyway, when he writes that hci research could move in the direction of science ‘or’ the humanities ‘or’ design, I wonder whether that means that one of those paths will be dominant. For instance, if hci moves towards a more scientific tradition, that could mean that the humanistic and design traditions become ‘lesser research traditions’ within hci research. And if one of the traditions becomes more dominant, then quality control seems like it might be less of an issue since science and the humanities, at least, have rich histories and rigorous ways of evaluating research contributions. This might not be so true of design research.

But of course there doesn’t have to be a dominant path, and maybe a dominant path is impossible in hci research. Say hci continues to diffuse towards each of the traditions and maybe even, as he mentions, towards some new ones. That there ceases to be a dominant approach probably means that quality control becomes more context-dependent, temporary, and fluid, descriptors I’m borrowing (again) from Gibbens et al.

With respect to the dilemma he describes, denying that hci is a scientific enterprise while simultaneously valuing and rewarding scientific research, i think the possible “diffuse” future encourages a resolution characterized by valuing and rewarding scientific research, humanistic research, design research, and maybe to spend more time thinking about the relationship between these different traditions.

Summer Research Projects

design, design research, design thinking, HCI, HCI/d, Interaction Design, philosophy, philosophy of science, science, theory, writing

The academic year is over, and after having taken a few days off, today is the day I launch into several really exciting and interesting projects.

Following are summaries of each major project. Hopefully, writing about each of them on the blog throughout the summer will provide (1) a modicum of accountability to the anonymous readers who may be checking in with me and (2) an opportunity to play a bit with the ideas in a public forum. This latter provision stems from a perceived need to achieve a greater comfort level with playing with ideas “out in the open” instead of waiting to share them in a more final, polished format.

For each project, I provide the “framing question,” and some amplification.

  1. What form do knowledge claims take in design research? This project is a comparative analysis of three different kinds of research publications: design publications, natural science publications, and social science publications. Random samples of each type (e.g. papers from Design Studies, Nature, and the American Sociological Review) have been preliminarily analyzed in order to gain a deeper understanding of the practice of making knowledge claims in design research by comparing a sample of its claims against other kinds. This is part of a larger project aimed at explicating the practice of design research.
  2. How do design researchers cite Donald Schon? Schon is probably one of the most frequent citations in design research. When researchers cite Schon, how are they citing his work? Are they demonstrating their familiarity with the “canon,” or does the citation have broader implications for their research questions or analysis? This paper is a first step towards a broader project of understanding the practice of design research. This project is being done in collaboration with Laureline Chiapello, from the University of Montréal.
  3. How is theory used in ToCHI publications? A similar study currently in review for publication in Design Studies asks how design researchers use theory in their texts. We distinguish between theory use in a written texts and theory use in a research project. We make no claims about how theory functions in the broader research project–only about how it functions in the text. This paper asks the same question, but focuses on publications in a leading HCI journal: ToCHI. **Another paper follows this same pattern in analyzing papers published as CHI, the leading HCI conference.**
  4. What possible (presents and) futures does the design research community imagine for itself? One way to approach this question is to inquire as to how we characterize it now. When I say “design research,” I mean “research through design,” as opposed to the scientific, humanistic, and historical (among other) kinds of research being conducted in the field. I use discourse analytic techniques to explicate a lengthy discussion on the PHD-Design listserv in order to suss out the generative metaphors that writers use to (1) characterize the current state of design and (2) imply (particular) possible futures.
  5. How have design theories progressively deepened our understanding of designing? Building off of a current project that adopts methodological falsification as an analytical lens, this project departs from Lakatos’s notion of sophisticated falsification and asks how a sub-set of design theories (theories about design) have deepened our understanding of design. In Lakatos’s words, referring to scientific theories, “… a theory is ‘acceptable’ or ‘scientific’ only if it has corroborated excess empirical content over its predecessor (or rival), that is, only if it leads to the discovery of novel facts.” (Lakatos and Musgrave, 1970) Using CK theory, the FBS framework, Figural Complexity, and Bounded Rationality, we ask what “novel facts” each theory provides.
  6. Can there be scientific theories that do not scientize design? This question served as the foundation for a paper recently presented at the European Academy of Design conference in Paris. It uses Karl Popper’s criteria for scientific theories as an analytical framework to argue that there can be scientific theories of designing and, importantly, that these theories do not “scientize” the design process, which is to say that they do not provide us with an understanding of designing as a scientific activity. We are in the midst of overhauling the paper in order to submit it for publication in a leading engineering design journal.

Aside from preparing for my qualifying exams in the fall, this list describes how I’ll be spending my summer days (save for a week off in August before the semester begins). Now the only thing left to do is get started…

Knowledge Contributions | Discourse Analysis

design, design research, design theory, knowledge tools, philosophy of science, science, theory

Borrowing from a personal email exchange, in my final paper I’d like to look at “how publications in a journal like Nature talk about their knowledge contributions and how publications in a journal like Design Studies talk about their knowledge contributions.” The interest stems from a parallel research project I’m doing about theoretical vs schematic knowledge contributions.

One of the things driving this topic is the seemingly perpetual comparison (stacking up?) that seems to happen between science and scientific knowledge and other disciplines and other types of knowledge in the academy. I’m not really taking issue with the comparison. Of course, one way disciplines come to achieve “self” knowledge is by comparing themselves to others. It’s important for design to compare itself with science, art, sociology, psychology, medicine, etc. in order to map the intersections and divergences. Divergences. That’s a key for me right now.

Wooffitt writes, in the section on externalizing devices, “How can we use language to establish that something is ‘out there’, and that it has an independent objective existence?” And in the context of the chapter (and elsewhere) it’s quite apparent why we would want to do that. It enhances our credibility in casual conversations and in publishing academic research. I pulled the following from a document that serves both as part of my final project research for this class and as a part of an outside research project:

After skimming five [design research] articles, there seems to be a balance between the use of the language of “truth” and that of the language of “utility” with regard to the knowledge contribution. I looked both at abstracts and conclusion sections as primary sites in the texts for talking about the knowledge contribution(s)…

There are lots of instances of what could be construed as scientific buzz words [words that lend themselves to the idea of objective existence] like “experiment,” “results,” and “hypothesis.” These words are of course flexible and they are not necessarily connotative of [empirical] science. However, when these words are used primarily by authors in talking about their “observations” or “experiments” it seems fairly obvious that, in context, they are imbued with the values of empirical science. In other words, they are tools for affirming the objectivity of the claims being made.

There’s no 1:1 correlation between the language of truth as I describe it in the above paragraphs and the language of utility. And actually the question I’m grappling with right now is whether it’s possible to warrant a claim to utility without appealing to the language of truth. For instance, one of the texts I read contains the following quote:

“We have repeatedly observed that with descriptions of biological phenomena, designers tend to rely on non-analogous associations over analogical reasoning… Our work suggests that specific mapping instructions and problem-independent scenario mapping could enable designers to better focus on analogical reasoning.”

The “observations” in the first sentence seem to me to be an example of language use that establishes that “something is out there” and not “from the researchers themselves.” This is what I’m calling the language of truth. The second sentence is interesting, too, because it contains elements of the language of truth. The blue text imbues “our work,” which is not the same thing as “us,” with the authority of more objective truth to warrant the utility claim highlighted in green. Note that the scientific language in the first sentence reaffirms the “objective truth value” of the blue text. It creates some space between the scientists (who are biased and flawed) from their work, which, so long as it followed a scientific process, transcends their biases and flaws.

Currently, I’m curious to know how these claims can be made in different ways. And so this is where I think something like Jorgensen’s analytical tools can come in handy. Something like substitution, perhaps? How do the words “repeatedly observed” effect the claim? How does the claim “read” differently with words cut and/or swapped out?

With descriptions of biological phenomena, designers tend to rely on non-analogous associations over analogical reasoning… We suggest that specific mapping instructions and problem-independent scenario mapping could enable designers to better focus on analogical reasoning.”

What’s lost? What’s gained? There is certainly objectivity lost. But could it also be argued that “designerliness” is gained? Maybe. Maybe not. I don’t know yet. It is an agenda-laden question, too. I ask it as someone currently trying to understand what makes a designerly knowledge contribution different from a scientific one and, ultimately, probably, to argue for making more the former in design research publications in order to build design as a discipline.

European Academy of Design

design, design research, design theory, interaction design, karl popper, philosophy of science, science, theory

I’m really excited to have the opportunity to travel to Paris this coming April to present a paper written with Erik Stolterman at the 2015 EAD conference. Our paper is part of the design theory / design philosophy track, which you can read more about here. The paper abstract follows:

This paper asks, Can there be scientific theories of design that do not scientize design? And it answers in the affirmative. Not only can there be scientific theories of design that do not scientize design but also that a scientific lens can potentially reveal important aspects of the design process. We apply Karl Popper’s criteria for the scientific status of a theory to four seminal theories of the design process: Bounded Rationality, FBS Framework, Figural Complexity, and C-K Theory. We demonstrate that (1) some theories about design can be construed as scientific in Popper’s terms, and that (2) these theories do not “scientize” the design process.

I will post a version of the paper to my academia.edu page for those interested in reading it.