A note from a lazy Sunday…

My comment on a post by Dennis Howlett, Conversational fluidity: using the FriendFeed river:

I know I’m returning to an old post, but it’s been a subject on my mind for awhile, and with a recent crop of articles on the web about the value of user-generated content and our current processes for filtering and deciphering the noise, I found this to be an interesting discussion.

We constantly hear the refrain that there is too much “stuff” being created on the web, that blogging is dead, that real thought is being pushed behind the noise of daily trivial conversations. So what? How is that different from how we’ve ever interacted? What’s different now is that our localized, trivial, ephemeral conversations are no longer localized or ephemeral, but permanent, stored, logged for everyone to see, index, search. They are still trivial :)

I’ve been having a conversation close to this topic with @bryanlanders about how to present our data to other people; how do we present information and hold conversations in methods and manners preferred by the users and not the creators (site owners)?

There is no monolithic right answer and probably never will be. Some will want to dip into the stream at times, others will want to be constantly engaged in real-time, while others will want to come back to things they may have missed, and those different interaction methods create the need for different filtering tools and processes. We have different levels for “too much”, “too public”, “too private”, “too trivial” et. al.

We each create our own filtering systems for our own lives, and while there is great scope for innovation in the area of conversational tracking and management, the key will be less about creating the “right” method but in making sure that all our filtering methods and conversational tools work together.

While the amount of information we create will inevitably increase as we create more systems to passively monitor and distribute (privately and publicly) information about our lives, the amount of information we can actively process is unlikely to change dramatically.

So how will we get there? Do we need better algorithms or better people to filter through the information? (or most likely, both…)

How do we start? What is the right way to present our information to best address our customers’ perspective?

It’s something Bryan and I have been talking about offline and online, debating how to present old content, our lifestream data and our comments on other websites.

I don’t know the right answer. Frankly, I wonder if I ever will…

… but maybe that’s because I’m not 20 years old: Clay Shirkey (via Scott Heiferman):

“you never hear 20-year-olds talking about information overload because they understand the filters they’re given. You only hear, you know, forty- and fifty-year-olds taking about it, sixty-year-olds talking about because we grew up in the world of card catalogs and TV Guide. And now, all the filters we’re used to are broken and we’d like to blame it on the environment instead of admitting that we’re just, you know, we just don’t understand what’s going on.”

I wonder what 20 year-olds will think in 20 years…

Post to Twitter Post to Delicious Post to Facebook Post to StumbleUpon

  • I appreciate the mentions - after reading this, I realize that I need to better utilize existing tools to just to be aware of my own sprawling identity (I hadn't seen your blog comment!)

    I think you're a great example of someone with valuable, thoughtful content distributed decentrally on the web. We need look no further than imagining an exponentially growing army of others like you to see that the game is over in terms of consuming all content, even of only your closest friends. In my experience building my experimental site, I've come to the conclusion that search is the foundation of the best solutions.

    When someone is consuming content, they look for topics that interest them or randomly (discovery). Topics that interest them seems to first be their own identity and then general and specific topics that relate to their work and personal life. Random in general is easy. Relevant-random is tougher and still full of opportunity for smart solutions. Finding topics of interest is facilitated by the search tools we use. BackType, FriendFeed, Twitter search, and Google search are examples of how we can find content about ourselves and the topics we like. Those tools will continue to become better at what they do and for each new service/method of content creation new search utilities will be created to facilitate aggregation.

    Search also can be communicated to users in clever ways that will make our lives easier. Search can build a list of keywords we use most often in our content and present them to viewers as tag clouds (passive). If users know what they are looking for, they can enter keywords and search on the content (active). This is how we can interact with one or few users' content. When looking to consume multiple users' content, you filter what/who you know you like (rss feeds you subscribe to, people you follow/friend on social media services). Beyond that, is random-relevant search again - tools will employ algorithms to guess other users/content you might like. Recommendations/ratings/reviews from known and unknown people are also pumped into the stream. And in a dance of inputs and outputs, active and passive efforts on the part of users and services, we will learn and adapt to the infinite stream of content and assign value to what gives our lives meaning in exchange for our attention.
  • Bryan: here's a start: an implementation of the Improving the Web plugin to display comments (powered by Backtype) on a page on the Unstructured Thoughts blog.

    I'm half-tempted to make a single-page website with just my comments, using Backtype's widget to power it, and then building in the tag and search capabilities you mentioned.

    Why don't we just make the frontpages of our sites a tag cloud and a search field? Or a "most popular post" list, similar to PostRank? Or a "your friends x, y, z liked these posts best" display? Why do we choose what to display?

    In the end it's not just about search; it's a about a combination of passive and active methods for users to find relevant content and for site authors / curators to display content people are interested in reading.

    Quick question: if search is so important, why isn't your search field on your site bigger and more identifiable?
  • Yes yes! I love the frontpage you're describing.

    From an email I wrote to Jon West (http://friendfeed.com/simplynutty) on Jan 12: "i had a vision of this current frontpage (homepage) and another version that was just tags generated automatically around terms that occurred frequently in my content and a search box. so there'd be the expose everything and skim and pick what's interesting to you OR the just look for what you know you want."

    And: http://friendfeed.com/e/b47caa98-d390-0925-3a7c...

    So, re: why is my search field not more prominent - well, I spent too much time learning Django to create the back-end (had to go back to work!); I need to beef up the search functionality; I still need to add the minimalist frontpage we're describing here (it will be very prominent then).

    On a slightly divergent note, I'm beginning to see your posts and comments as 3-dimensional with your masterful hyperlinking ;)
  • Commenting is blogging.

    It would be interesting to see a multi-versioned homepage with the tag and search functionality you described. And then we could do some A/B testing and clickstream analysis to understand how people use the sites differently.

    Alternate skins to present and access the same content.

    Couldn't Google Custom Search power the search functionality? Can the custom search results be skinned? Or is Yahoo BOSS a better technical solution? How could the Backtype API be used to search the site's comments?

    Would it work better to create a custom search using a local site content search powered by Google (for site content) and Backtype (for site comments)?

    I don't know a lot about generating tag clouds; I've never found them very useful; but perhaps that is because most tag clouds are created and forgotten, busy with too many terms, too subject to how site creators use tags, too odd.
  • And oh, I like linking out :)
  • One last point: essentially, site creators use blogs, sidebars, widgets and various ways to promote all the content we create. But it all adds to the clutter. We understand it as the creator, and users begin to understand as everyone uses the same rough format and layout, perpetuated by templates and hosted website / blog solutions.

    But it's still clutter.

    There has to be a better way of delivering content to users utilizing the peripheral context around everything we create. Context is expensive: hard to create, hard to structure, hard to personalize, but that's the opportunity.

    I should try to hack together a lightweight entry search page on http://taylordavidson.me/ ...
  • Scoble on filters http://bit.ly/IrNH1 :

    "I personally am bored with the whole topic. I don’t need more feeds. I don’t need better readers.
    What do I need?
    Better filters. "
  • Better readers could have better filters built into them.

    Scoble is such an edge case that I don't know if he really applies. "Real-time" for Scoble, Louis Gray et. al. isn't the real-time that 95% of the population needs or cares about.

    More interesting:

    A comment by Jeff Lindsay on a post by Mark Cuban, The Internet is about to change:

    "The real change is going to come from emergent properties of the ubiquity of an event-driven programmable web. These come from subtle qualities of the nature of and evolving ecosystem of HTTP.

    Realtime is just a side effect of event-driven systems.

    Anyway, I agree the Internet is about to change because of webhooks. I just don’t think realtime alone is a game changer.

    From MC> agree 100pct. But realtime is a concept that people understand as a starting point. Its the low hanging fruit that get people thinking about what event driven apps can do"
  • My responsibility is to be that better filter. More than 1,000 people subscribe to my shared items on Google Reader, and 10,000 more subscribe to those I share using FriendFeed. I know there are better filters needed, and so far, humans are beating the machines.
  • Completely agreed. I use feeds to follow people, because right now people are great filters. But because interests don't intersect perfectly, there is still some room for innovation.
  • And of course, very few people can be as prolific and insightful as you :)
  • You don't hear 20 year old talking about broken filters because they over-consume information in the same way they over-consume everything else. Behold youth. ;-)
  • Agreed. But since we can't recapture our youth, and re-training our minds to process information differently is an ineffective / non-scalable proposition, we'll have to figure out better ways to process information to make our lives better.
blog comments powered by Disqus
Posts by RSS: Taylor Davidson / Photography, Travel, Innovation & Entrepreneurship
Posts by Email: Taylor Davidson / Photography, Travel, Innovation & Entrepreneurship
@tdavidson
Facebook: Taylor Davidson
Flickr: taylordavidson
LinkedIn: Taylor Davidson