Unpacking the journalist, or Public Investigation

In his post How can we get people to "Geek Out" about journalism?, David Cohn over at PBS' MediaShift Idea Lab reflects on the fact that journalism has an image problem in North America.

I respond in the comments that we need to stop saying "Pay me to be a journalist" and start saying "Pay me to find the answers." But I can't help but wonder if we need to go further, and unpack the tasks of journalists.

The way I see it, a good investigative reporter is a cross between a private dick and a researcher (research librarian, perhaps?), with excellent writing skills, journalistic privilege (both in terms of access and legal protections), and a publishing venue to back her up. That publishing venue may also offer editing, copy editing, fact-checking, and even a strong reputation.

Well, today we all have a publishing venue, given that anyone can start a blog on the internet for free. Editing and copy editing are not essential, fact checking is provided by crowdsourcing in the comments, and reputation can be achieved per journalist, rather than per organization. Lots of people have adequate writing skills. And while some bloggers will undoubtedly sorely miss the legal protections journalists enjoy before society's adjustment to this 'media shift' is through, journalistic access is often overrated (just ask Mayhill Fowler, a citizen journalist with the Huffington Post's OffTheBus campaign who has made waves with the stories she has scooped by not being a member of the press). In short, at its core our business is to seek out truth, or at least, to get as close to the truth as possible, and then release it for public consumption.

[As an aside, this coincides with discussions I've seen about replacing the concept of journalistic objectivity with transparency. If I hire either a PI or researcher to do work for me, what I'm hiring them for is to answer a question, or a set of questions. I'm hiring them to get me some information that I couldn't get on my own, or that I don't have time to get on my own. And when they give me their results I expect complete transparency - surveillance photos, links, reports, data, you name it. For more on this, see Josh Young's post in Networked News, What we talk about when we talk about neutrality.]

So, we have private investigation. Why not public investigation? And, why separate the two? A large Investigation firm could have investigators on staff as well as writers, and customers could hire the firm to investigate privately, or for publication. I'm not saying that this is the journalism of the future, but it's an interesting idea.

Great Expectations of Accuracy

I often get the impression that readers are quite frustrated with the accuracy a newspaper is able to provide. Part of that is the fault of marketing, which says, "You should choose us because we're the trustworthy ones who will get it Right." Part of that is because a lot of readers are naive, and believe that news writers are actually without bias or personal opinions. Somehow, the idea that we are bland, mindless automatons that live only to channel The Truth is plausible to a large segment of the population. And, of course, another factor is a general lack of understanding about the medium. Newspapers arrive at truth through ongoing coverage. Magazines are able to step back and look at more of the picture, though they still probably won't find absolute truth.

Journalism as a search for truth is an ongoing process. In an open source journalism model, where that ongoing process is transparent or even participatory, I wonder if readers will continue to expect too much. Perhaps when they have realistic expectations appropriate to the stage of the article, readers will become less alienated from the press.

It could happen!

On a vaguely related note, I was wondering recently: Do most members of the media and press believe in absolute truth? How about you?

Distributed editing: share ratios and eBay-style feedback combine!

So, back to the distributed publishing question I began to explore in the post Following the Story.

In that post, I explored how crowdsourcing could theoretically provide editorial direction, brainstorming, checks and balances on bias and ethics, an extra eye for catching holes in the story, and even, to some extent, some initial fact checking.

The one thing that I couldn't solve with crowdsourcing was what I described as "flow" editing: rearranging the piece so that it flows better. Editing for writing style and clarity would also fit in here.

Well, crowdsourcing may not solve the problem, but borrowing some concepts from peer-to-peer file sharing sites and the eBay feedback system, I might have a barter-based solution that will address the problem.

In essence, most journalists are trained to edit as well as to write. Some are better at one than the other, but I suspect that most of us enjoy at least a little of both. Imagine a system where users had to maintain a specific edit ratio: for every piece they edit, they earn the right to get a piece edited by someone else. Now add on an eBay feedback system, where writers and editors give feedback on the job they each did. Writers in a rush or with a basic news piece would have to take the first editor who came along, but writers who are working on a feature with which they can take their time could hold out for a really good editor. The rating system would motivate users to do a good job editing (and not be too difficult an editee) because if you don't do a good job, it will be harder and harder to find someone to edit your own work. If that didn't motivate people enough, the edit ratios could be partly weighted by the feedback rating of each user.

What about people who only want to edit, or only want to write? Obviously those people can just hire an editor. But if they want to work within this website, people who only want to edit could sell edit credits to people who only want to write.

And, for those of you who aren't fans of crowdsourcing, a system like this would work for other aspects of the editorial process, such as fact checking and copy editing.

Open Source Medicine and the Doctor-Patient relationship

A recent post by Dan Schultz on PBS' MediaShift Idea Lab blog discusses the pros and cons of comments. Schultz mostly sticks to practical tips on how to beef up the comments on your publication, but a belief in the benefits of crowdsourcing seem to underly his advice.

It seems everyone is talking about crowdsourcing in terms of politics and in terms of going hyperlocal. Power to the people via the vast amounts of information available on the internet and the vast sea of experts we can access in only an instant.

I don't see many media people talking about crowdsourcing and data in terms of health. But the medical profession has noticed, and boy are they talking about it.

Let's stop there for a moment for some disclosure. I'm a pushy, inquisitive patient, the kind older doctors hate and young doctors love. I'm pushy and demanding, but that seems to have been effective. Since I started down this path, researching my own health problems and taking a hand in the decision process, my health has improved a great deal. In each case I eventually found a specialist who I trusted - usually because the information that specialist was giving me made sense in the context of the research studies I was reading online. I still try to do some of my own research, but I'm more likely to go with my doctor's advice now that I feel I'm with someone competent.

So what are the doctors saying?

Health providers must avoid frustration about having their role as the sole source of information challenged, or possibly risk losing patients. In one survey of different specialty and general medicine practices, one third of the patients who felt their relationship with their physicians was low in participatory decision-making changed providers within a year.
The Patient-Physician Relationship in the Internet Age: Future Prospects and the Research Agenda, from the Journal of Medical Internet Research

Earlier in the same paper, after observing that patients who have done their own research may be able to get more out of their appointments by skipping the basics and spending more time on the pros and cons of treatment options, the authors write:

"...physicians must be prepared to address alternative possibilities that the patient has learned about from external sources. Instead of saving time, this scenario may require extra discussion when untested approaches need to be debunked (as in the case of some complementary and holistic medicine practices). ... Still, it is yet uncertain whether efficiency improves or declines when patient-acquired Internet information is brought into the decision-making process. This subject warrants further investigation."

A lot of the discussions I'm reading are about the doctor-patient relationship, or impacts on visit duration or visit frequency. This study's results suggests that these fears are unfounded, while this one concludes that "Hype around Internet use by patients appears to exceed the reality of Internet use."

Sure, these results are preliminary, and as internet adoption grows, the way patients use the internet will almost certainly evolve.

But the thing is that the internet doesn't pick and choose what to democratize. In science and medicine there has always been a great divide between the layperson and the expert. Now, as more and more research journals go open source, average people are feeling increasingly confident in their own ability to make judgments about science and medicine. Thanks to the democratizing force of the internet, the chasm between people and scientists appears to be narrowing.

Appearances can be deceiving.

When it comes to science, the learning curve to equal or even approach the expertise of a biologist or physicist (for example) is far too steep for most of us to achieve. The necessary math skills alone present a formidable barrier. But doctors are not necessarily scientists. What does their education consist of, and to what extent can new media equip your average person to fruitfully discuss their health with a doctor?

My own experiences suggest that the ability and inclination to search the internet, decipher article abstracts, assess the quality of evidence, and then weigh that against other evidence, is enough. In fact, more than enough - I often end up teaching doctors (especially general practitioners) new things about my illnesses, although pride may prevent them from learning from it.

When I tell people about this, I'm often told that I'm "different." Because I have a background in science (physics/astrophysics, which has nothing to do with medicine, I should point out), I understand the scientific process and scientific jargon, and I'm not intimidated by it. My friends will even sometimes argue that I'm smarter than your average patient, and that it isn't reasonable to base my assessments of what people can do with the internet's vast sea of data on what I can do.

Mmm, maybe. I certainly think a lot of people (including some doctors) need a crash course in how science works, and in particular, on evidence-based medicine. (by the way, the entire concept of evidence-based medicine originated in Canada at McMaster University in 1992). I'm not sure how smart you need to be, once you have that basic knowledge, to get involved. And hell, who knows: maybe I'm not smart enough. Maybe with all of the pushing I've done to get better healthcare, I've shot myself in the foot and don't know it. I don't think that's the case, but sometimes I entertain the possibility with some degree of horror.

Lately, I've begun to suspect that the general practitioner is essentially a walking talking database of often-obsolete medical information. If that's true, then a skilled internet researcher who understands how to assess medical evidence could potentially provide better medical advice than the general practitioner. I certainly feel like I've done that on occasion.

To get to the bottom of this all, there need to be more studies on the reading comprehension of patients who are familiar with the scientific process. To what extent does their perceived comprehension match their actual comprehension?

I also need to learn more about how general practitioners are educated, and how they continue to educate themselves throughout their careers. Do they learn how to interpret statistics, or how to avoid being influenced by medical literature or drug advertisements? Are they taught about evidence-based medicine these days, and when did that find its way into the curriculum? For those doctors who graduated before EBM, how many of them have learned about it nonetheless? And, as medical information is updated through research, how are general practitioners updated on that information - or are they?

I have a lot more to say about this, but I think it's time to close this post down. I'd love to hear your thoughts on all this, though. Do you use the internet to research health problems? Do you think you can learn as much as some general practitioners? Talk to me.

Cha-Cha: The human search engine

The Open Source movement is all about harnessing the power of many, or crowdsourcing. A company called ChaCha is crowdsourcing in a way I never would have thought of: a human-powered search engine.

Just call them up from a mobile phone, or text ChaCha (242242) with your question, and they'll get back to you with an answer within three minutes. The answers are found by human "Guides" who must pass a series of tests, attend ChaCha's "Search University," and go through search simulations before they can begin work as guides. Even then, the guides only get between three and eight dollars per hour.

I'm not clear on what their business model is, and it certainly isn't on their website (although one blogger suggests they plan to profit somehow from advertising). I was going to text 242242 and ask them how they make money, but alas - the service is only available in the United States, and I'm in Canada.

I'd be interested to see something like this that can handle longer form queries and more importantly, answers. There are free services out there like Google Answers, but for whatever reason I haven't been impressed by the quality of answers people get on there. And that's interesting, considering the success of Wikipedia. What makes these two efforts at crowdsourcing different? (Obviously ChaCha is a different animal because the guides are trained and paid, albeit a pittance)

(Via Josh at the Knight Center for Digital Media Entrepreneurship)