Thought: One of the most valuable features of Twitter as a publishing platform is that the writer has a much better sense of who they’re communicating with. There’s a “Following” list which puts names and reputations behind a readership. Furthermore, the writer can indirectly assess the likelihood of their content being consumed based on followers’ account activity. “Blogs” and older publishing platforms don’t have this vibrance; they have pageviews, time on site, and other metrics distant from the purpose of publishing.
Fast and great support from the 37signals team. Metrics tracked:
- Percentage “Smiley” (or positive) ratings
- Average time to first response
- Average time to first resolution
- Percentage of cases taking more than four hours to reply
- Percentage of cases getting a response in the first hour
Data makes the world more visible.
At the end of March, I embarked on a personal initiative at the J-School to quantify as many of our processes as possible. My working thesis: if we can generate enough data about a system, and have a framework to understand it, we can be far more effective in what we do. Quite possibly way over 5-6%. Continue reading
Judy Watson, associate dean at the J-School, asked me last week to pull together relevant usage and performance metrics for work we’re doing on the web. They’ll be a part of an annual report back to CUNY central. I thought it’d be fun to share them here too. Continue reading
When you speak at a journalism conference I want to hear about what the top idea in your mind is. I want to hear about what experiments you are trying, how you are measuring them, and how they are affecting your success.
WordCamp and journalism conferences. Ideas, action, measurement, and iteration, all for the win.
Measuring and increasing accuracy in journalism. Jonathan Stray outlines one approach. I think we need to throw more computing power at it.
Employers like me and my peers need evidence that a new hire has what it takes to hit the ground running. And, given the lack of consistency in design school training, we’re forced to put more weight on portfolio reviews or evidence of skills learned through internships than academic credentials.
Robert Cringely, Ich Hasse Hausaufgaben (I Hate Homework):
American education, perhaps because of the No Child Left Behind Act, has become a testing nightmare. Metrics are everything and much of the curriculum is now intended not to educate but rather to pass the damned tests. It is precisely analogous to what I discovered thirty years ago investigating the Three Mile Island nuclear accident, where reactor operators were trained to pass the operator test, not to actually operate the reactor. When things went wrong — when they went beyond the scripted scenarios — the operators had no idea what was happening inside that containment. Channing’s curriculum, too, tends to be 100 miles wide and an inch deep.
What’s wrong is the focus on broken metrics. Change the incentives and you can change the system.
Steven Johnson, with “The Glass Box and The Commonplace Book” (emphasis mine):
But they have underestimated the textual productivity of organizations that are incentivized to connect, not protect, their words. A single piece of information designed to flow through the entire ecosystem of news will create more value than a piece of information sealed up in a glass box. And ProPublica, of course, is just the tip of the iceberg. There are thousands of organizations – some of the focused on journalism, some of the government-based, some of them new creatures indigenous to the web – that create information that can be freely recombined into private commonplace books or Pulitzer-prize winning investigative journalism. A journalist today can get the idea for an investigation from a document on Wikileaks, get background information from Wikipedia, download government statistics or transcripts from open.gov or the Sunlight Foundation. You cannot measure the health of journalism simply by looking at the number of editors and reporters on the payroll of newspapers. There are undoubtedly going to be fewer of them. The question is whether that loss is going to be offset by the tremendous increase in textual productivity we get from a connected web. Presuming, of course, that we don’t replace that web with glass boxes.
Whoa, wait a second… how do we measure the health of journalism then? If we were to develop this system, would we be able to track information density of text content or derive the quality of the information produced? Could we then mash this against topical and location metadata to see how well particular communities are being served?