Archive for December, 2006

The Effects of Bad Recruiting

Did any of you watch the first season of American Inventor?. On my DVR, it was right up there with Lost. I loved watching everyday people tackle real-world problems. Some of the inventions were amazing. And some of them left me wondering "what the (…) was that person thinking?" As a researcher, I couldn’t help but be irritated by something – their display of Focus Groups.

Take Sharon Clemens as an example. Sharon came up with a very simple, yet clever device – a plastic clip to hold the bathroom stall door closed in a public restroom. Now, I don’t personally use the stall that often (one fortunate advantage of being a man – we get to stand up). However, I have on occasion been in the position of need for a public stall. And I have on the occasion been in a stall where the door didn’t lock properly, or at all. One time is too often for me. Now, imagine being a woman and your only option is a stall. It’s a real problem. And I applaud her for solving a real problem.

Any decent researcher knows the importance of finding research participants who meet your target audience. This was my issue with the focus group participants during the American Inventor show. This woman’s target audience was other women. Or other women who use public restrooms. Any idea who was in the focus group session for her product? Mostly men. Their feedback was not promising.

That wasn’t the only one. Remember Francisco Patino, the inventor of the Double Traction Bike? His target audience was teenage kids in lower income neighborhoods. Guess who was in his focus group? Mostly parents. Where were the kids who would be using the bike? Once again, the feedback wasn’t promising.

As a researcher, this type of blatant misunderstanding and improper use of a research method troubles me. Just as I’m glad that Business Week had a recent article on ethnography, I’m also concerned for the posers this will produce who will devalue this method, just like focus groups and in the long-term cause greater harm than good.

In the mean time, if you’re looking for a funny parody on focus groups, check out this Dodge commercial Bill Bulman forwarded to me.

Ethnography Goes Mainstream

I recently wrapped up a week long training workshop with a large educational financial services firm. Our first day focused on research methods. We studied various methods, both qualitative and quantitative, and even did a few practical exercises on formulating research questions. One of the tricks of doing research is determining the best research methods to use. Notice I said "methods" not "method." I’m a firm believer in using more than one method of research. This helps as a filtering agent for bias and weaknesses. Every method has a particular set of strengths, weaknesses and biases. So, I always advocate using more than one to compensate for that.

One of my favorite research methods is ethnography. Unfortunately, it is arguably the most time consuming and costly, making it more difficult to sell to clients even when it is the best approach for a project. And while I don’t get to do ethnography as often as I’d like to, here is hope. A recent Business Week article has brought Ethnography out of the shadows. Now, the cynic in me is concerned that marketing companies will create an "ethnography bandwagon" and dilute the method the way they’ve diluted focus groups and surveys. The article does touch on that a bit:

"Practitioners caution that all the attention ethnography is getting could lead to a backlash. Many ethnographers already complain about poseurs flooding the field. Others gripe that corporations are hiring anthropologists to rubber-stamp boneheaded business plans."

But I also see this as an opportunity. While we are small in number, those of us who are not posers, who have studied the method, been formally trained and do know how to properly execute the method and extract valuable information from it will have greater opportunities. And that is promising. Some of us who are formally trained in ethnography can be found on the Yahoo! Anthro Design list. You can also find professional anthropologist, sometimes referred to as design researchers, at companies like Steelcase, IDEO and Intel.

Well, what is ethnography anyway? It sounds like such a cool word. When pitching the method to my clients, I describe ethnography as a fancy term for shadowing. In short, I’m going to follow you around for a day or two and observe you to better understand what you do, how you do it and how we can make your life better or easier. Clients seem to understand that description.

On a more academic level, ethnography is a holistic approach to research. Unlike other methods that tend to focus on a particular action, ethnography attempts to understand the action by looking at the entire system and environment that surrounds an action. If you want to truly understand how someone works and what influences their behaviors, ethnography is one of the few methods, if not only method, that can give you this insight. This excerpt from the Business Week article provides a good summary:

The beauty of ethnography, say its proponents, is that it provides a richer understanding of consumers than does traditional research. Yes, companies are still using focus groups, surveys, and demographic data to glean insights into the consumer’s mind. But closely observing people where they live and work, say executives, allows companies to zero in on their customers’ unarticulated desires. "It used be that design features were tacked on to the end of a marketing strategy," says Timothy deWaal Malefyt, an anthropologist who runs "cultural discovery" at ad firm BBDO Worldwide. "Now what differentiates products has to be baked in from the beginning. This makes anthropology far more valuable."

Now I would have said "design was tacked on to the end" instead of "design features," but that is due to my experience with business and marketing drumming up features. Designing a solution and coming up with features is not the same thing.

Probably one of the most interesting things to me about this Business Week article is the timing of it. I just returned from Overlap. One of the overarching questions during this weekend was "How can we get design(ers) in front of more business people and decisions makers?" Or put another way, "How can we get design(ers) in on the business discussions earlier?" Well, an article in Business Week on ethnography sure does help.

Cellphones and Driving

A new study by the University of Utah shows that drivers talking on cell phones are just as dangerous as driving drunk. The study shows that cell phone drivers were slower to brake, more aggressive (e.g. road rage), and more than five times as likely to cause an accident as non-distracted/non-impaired drivers were. Doesn’t really surprise me at all, since I”ve been hit twice by cell phone talking drivers and have lost track of the number of times I’ve been cut off, run off the road, or nearly hit again.