How many more times do people have to get stiffed by a free web service that just bites the dust and leaves you bubkas?
What follows is a monster post. You will find me ranting ar companies like Storify who offer free services that leverage our efforts building content and then they develop enough value to get sold. After the sale they just yank our content. I also offer an approach for local archiving your storify dying content, via a new home spun tool for extracting all embeddable content links and how to use it to create your own archives in WordPress.
On we go.
Storify Is Nuking, for no credible reason, All Your Content
Like many people, I caught the word via twitter yesterday that Storify was turning off it’s lights in May, and not letting anyone new in. I think they way they told people was putting a notice on their site. Oh, they sent an email 2 days later.
Okay there are two kinds of people or organizations that create things for the web. One is looking to make money or fame and cares not what happens once they get either (or none and go back to flipping burgers). The other has an understanding and care for the history and future of the web, and makes every effort to make archived content live on, to not leave trails of dead links.
Storify is Type 1. After getting enough of a value based on the free labor of grunts like you and me who built content in it, they got bought by Adobe, and swept up into some enterprise product.
Actually, they were acquired by Livefyre which was acquired by Adobe. It's being rolled into Adobe's Experience Cloud as part of its enterprise tools sadly https://t.co/7NYpsWqYZr
— Rafranz Davis (@RafranzDavis) December 13, 2017
I spent time paging through the Adobe Experience Manager Livefyre site without any understanding through all the pretty photos what the heck it was (it does have
marketing-cloud in the URL). Oh here it is:
Adobe Experience Manager Livefyre: User Generated Content (UGC) Platform
Turn your audience into a content machine.
They are going to orphan all the Storify content they once hosted, leaving black web site not found holes in the fabric of the web. They took a cue from Twitter mothballing Posterous. And many more.
The second kind of people? Look no further than IT Conversations:
My shows there are now preserved (https://t.co/IuIUMvMXi3) in a way that none of my magazine writing was.
— Jon Udell (@judell) December 13, 2017
For any ed tech greybeards out there, IT Conversations was one of the most valuable and community facing resources for the early web, one of the early podcast networks. They are very much Type 2. When they closed, did they just unplug all the servers, and yank all the content? No, they took care of the it:
The remaining assets of the Conversations Network (cash and intellectual property) will be acquired by the Internet Archive, another U.S. 501(c)(3) non-profit organization. All existing programs will be moved to the Internet Archive where the world will be able to continue to listen to them for free.
We hope to preserve all existing URLs by running a “redirection server” for many years if not permanently.
Those are people who understand and care about past, present, and future.
Storify? They are just yanking it all.
They do offer you an ability to export your Storify content, which, to me is not an archive at all. And it’s ugly. And all embeds of content, all links, shall forever go on the Great Pile of Dead Links.
The “export” is a static HTML version of your content, not how it looks on their site, which you have to save as a package of HTML and a wacksock of other crap, a lot not even needed. Your export includes a pile of Facebook tracking code and other add server links. I spent a chunk of time this morning cleaning one. That’s another post.
So now there is the usual flurry of suggestions to do things like use Twitter Moments or some other third party curation site. Ian Milligan asked the right questions and suggested taking on a reclaim your stuff mantra:
It’s not as bad as some platform shutdowns – there is notice and at least you can export your own content (one story at a time) – but it’s still a reminder of how vulnerable user-generated content can be online.
The first hot take is that it underscores how when we spoke about “archiving” a hashtag on Storify, we weren’t really doing anything resembling that term. We were temporarily parking it on a free site until it inevitably closed.
The second big point, to me, is to use this as an opportunity around how we could move forward as a field.
The thing is everything Ian uses as examples, and many others writing about Storify, is storifying just tweets. And frankly that seems to be about 90% of the uses I have seen over the last few years. Just a way to package tweets together. If that’s the need, then maybe Twitter Moments are the way to go.
But to me the whole value of storify was not for stringing tweets together, but mixing content from multiple kind of sites- Youtube/vimeo video, Soundcloud Audio, Prezi, Web sites, Slideshare.
Not only that, you could insert headings and text sections to act as ways to augment or explain the content. Storify was way more than a bucket of conference tweets. And as Matt Croslin pointed out elsewhere in a Slack discussion, it’s not about the archive or embedding, the real advantage of Storify was it made it convenient to pull content from many social media services into one drag and drop interface.
What’s really lost is the convenience factor. It’s not impossible to curate mixed social media, and if you happen to be among the people that use a WordPress platform (hosted or self-hosted), you can do it in a place that some 3rd party profiteers will never yank from you.
I’ve Got Your Alternative Right Here
One person worrying about this was Robin Derosa:
Maybe Curated Collections on Tweetdeck would work as an emergency replacement for Storify for my students' assignment this week? https://t.co/JVzzeU5fSS
— Robin DeRosa (@actualham) December 13, 2017
She had designed part of her class around using Storify. He Big Tech (or not so Big Ones), if you are going to radically change your platform, how about asking your users first? How about giving them some advanced notice? Is that too much to ask?
Students were supposed to use it. They had to make accounts literally in the next four days. No new accounts being made as of today!
— Robin DeRosa (@actualham) December 13, 2017
People are chiming in suggestions. I had a thought:
Are your students using WordPress?
— Alan Levine ? (@cogdog) December 13, 2017
Because… well, you can see it right above. WordPress has, and has had for a while, the ability to automatically embed social media content by simply putting the URL for a tweet, or the url of a youtube/vimeo video, the urls of a flickr photo, the url of a SoundCloud track as plain text on a blank line in the WordPress editor.
But it’s better to show, than tell. I took a bunch of tweet URLs in this thread, and a few more, and put them in a text file:
I was working on a page on the blog here, but it was slow ressponding, so I jumped over to a WordPress.com blog I use for just testing, and quickly published a post with this alt Storify approach. I then tweeted it for Robin (and can see that I used the wrong URL in the tweet, that’s the edit link, sigh)
Autoembed is your friend. Plain text URL on blank line, reorder as needed. This took 5 minutes https://t.co/rjCv5OGsFM
doing with this pic.twitter.com/ymE1dK2JYP
— Alan Levine ? (@cogdog) December 13, 2017
Eventually I got the page published here, same embed content, different web site.
The building part is a bit more manual, cutting and pasting URLs (the embeds will appear in the visual editor, if you need to change the order, the HTML editor to me is easier to work with). And in a blog post, you might consider adding more context around what you curate, instead of just stringing together because it’s easy.
But at least it’s on a web site you manage, not some third party shady motel like Storify.
Down the Coding Hole, Emerging with a Storify Link Extractor Tool
Storify’s last offer to you are some instructions on how to archive your existing content. They offer no answers to what you do with it, and they leave off the fact that they will unplug the server and break all external links (remember they are People of The Internet Type 1) (it would take very little effort for them to get their content in the Internet Archive) (Also remember this is Adobe’s decision, the company that bought Storify).
I found a simpler way to get to your archive than their instructions (which sound like it is actually whirring away like an archiver machine, it is not). Just take the url for any existing storify like
http://storifried.cogdogblog.com/netnarr-meme-and-gif-a-palooza and add
.html to the url, load that url
http://storifried.cogdogblog.com/netnarr-meme-and-gif-a-palooza.html. There is your “export”.
To save it, you should use File -> Save Page As and use the option Web Page, Complete (in Chrome or Firefox, not Safari which gives you some unusable file). This will download an html file and a directory full of other “stuff” to enable it to run as stand alone web page. You can even run it off of your desktop machine.
But I suggest that you think like an archivist and how to organize your stuff. I created a directory in my local hard drive and call it whatever you like
storifysucks — mine is called
Then… for the example above, I create a sub-directory with the exact same name as the url or
netnarr-meme-and-gif-a-palooza. Stand by for the reason. Now, while viewing that archive above, I do the Save Page As, and I save it as a file named
index.html inside the directory above. All the “extras” get saved in a sub directory named
If you load index.html in a web browser you will see a copy of the same web page you see hosted on storify (well for the next 5 months it will be there).
Eventually, you will create an archive that mimics the url structure on storify, on directory for each one you archive.
If you have a web site, you can put all of this in a subdirectory in your own domain (no luck if you think a domain is a WordPress.com web site). Or, you can create a subdomain, mine is http://storifried.cogdogblog.com
I spent a lot of time Friday pouring over the “archive”. It’s full of facebook tracking code, charbeat.js ad server stuff. It also is rather plain and ugly, this is the exported version of the storify above:
It contains links at the top that point to Storify (which will be dead soon). And it’s pretty ugly, and looks not quite like what I created.
So I spent even more time inspecting HTML, comparing the source code of the online version to the archive, stripping out un-necessary tracking code, to produce my own flavor of an archive:
I’m leaving it to a followup post for how one might take this on (warning IT INVOLVES INSPECTING SOURCE CODE AND EDITING HTML, if that scares you go run shrieking/liking into the Facebook Hills).
But while looking at that source code I noticed a pattern of each Storify piece of content in the time line, it has a regular pattern (warning HTML code ahead, I trimmed some out because it’s long) where with a vimeo item and a twitter one:
<li data-eid="505f2c88c6f454944c3a9e7c" data-type="link" data-source="vimeo"
class="s-element s-element-link"><div data-lf-block-id="505f2c88c6f454944c3a9e7c"
data-lf-block-type="rich" class="s-element-container"><div class="s-link
/326/192/326192403_200.jpg" alt="Thumbnail for Storytelling with Sound"
rel="nofollow" class="s-link-a emojify">Storytelling with Sound</a><div
class="s-link-desc emojify">Storytelling with Sound Hey Gang, Vimeo and our friends at
stillmotion are teaming up for a very exciting contest that we would love for
...</div><div class="s-attribution"><div class="s-source s-vimeo"><a
href="http://vimeo.com" target="_blank" rel="nofollow"><div class="s-source-icon
href="http://vimeo.com" target="_blank" rel="nofollow"
<li data-eid="505942fac405b38e721f1aa2" data-type="quote" data-source="twitter"
class="s-element s-element-quote embedTweet"><div
class="s-element-container"><blockquote style="margin: 0" data-conversation="none"
class="twitter-tweet"><div class="s-quote s-element-content"><div
class="s-quote-content"><div class="s-quote-avatar-author s-quote-avatar-twitter"><a
href="http://twitter.com/grantpotter" target="_blank" class="s-quote-avatar"><img
class="s-quote-author"><a href="http://twitter.com/grantpotter" target="_blank"
class="s-quote-author-name">Grant Potter</a><a href="http://twitter.com/grantpotter"
class="s-quote-text emojify">"What if it were possible to make arguments about sound
using sound itself?" <a href="https://twitter.com/#!/search?q=%23dhsound"
title="#dhsound" class="tweet-url hashtag" target="_blank" rel="nofollow">#dhsound</a>
<a href="https://twitter.com/#!/search?q=%23ds106" title="#ds106" class="tweet-url
hashtag" target="_blank" rel="nofollow">#ds106</a> .... <div class="s-element-options"><div
Everything is a list item
<li> and each has a data item like <code>data-permalink="http://twitter.com/grantpotter/status/248269509868257281" which is the exact URL that WordPress should be able to autoembed.
The wheels are turning, maybe it’s possible to create a tool that will extract all these links. It took a bit more iterating; I was able to create a tool where you paste in the entire source HTML and it extracted, using regular expressions (FREAK OUT) to grab these URLs.
But then I noticed that there are other kinds of elements in the mix, the ones where I added a heading or text to organize my storify content (I might be among the only people who used this). These look like:
<li data-eid="505f2e1986b5ccbb4e34f2b2" data-type="text" data-source="storify"
0ab66b8a10f0cfddfd7e4fea43706858" class="s-element s-element-text"><div
class="s-element-container"><div class="s-element-content s-text emojify">A great
interview with experienced reporter- his specs on what makes a story worthy are
I was first able to skip these in my loop that looks at all matches; if it has something like data-
permalink="http://storify.com/.... Those URLs are useless. But I kept thinking there must be some way to get the value of what is in there. This took a lot of banging on the pipes (due to my weak regex skills), but I finally got it. A key was pre-preprocessing the raw html by adding line break characters after all
</div></div></li> which makes searching easier.
So… here it is my first pre-alpha Storify Link Extractor Tool.
My suggestion is to first save your local copy of the web archive as described above. I’ll walk through with a new example, this is one I created as some storytelling for a night I experiences stranded at Chicago O’Hare airport, so first I go to the Storify archive url https://storify.com/cogdog/nightatord.html
I then create in my local desktop archive a directory named
nightatord. From the archive link above, I do the Save Page As and use the name
index.html inside that new directory (this is just preventative stuff, not critical to using my tool).
Now I go back to the Storify “export” https://storify.com/cogdog/nightatord.html. I am going to use my browser’s feature to view source (this varies in different browsers, use this guide for your set up, as a Type 2 Web Creator, this is a critical skill). I am going to do a command A (select all) and command C (copy). Grab all that HTML.
Now, go to the Storify Embeddable Link Extractor tool https://cogdog.github.io/storify-extractor/, and paste that big whack pile of HTML into the first form field. Click the Extract Links button
This one found 68 embeddable links, and no text blocks.
You can put these in a WordPress post, maybe organize them by a category or tag. My approach is to use the Page structure. I have a Parent Page at http://cogdogblog.com/storifry/ I will use eventually as an index, and each storify I archive is a child of this page, so I create a new page, title it and make the url the same as the original, then paste in all those extracted links.
Since I like making it pretty, I will add a featured image, the title intro text, and maybe a note that this is an archive. And here it is
I plan to do this for any of my storify content worth saving – make a local copy for future consideration, extract my URLs, and publish in WordPress.
A few caveats:
- You might not want to do a monster storify. Mine work okay as I run a cache plugin.
- So it might make sense to prune down the links needed to the most critical.
- The one thing WordPress does not embed are link to sites, so you may want to edit those out. Or turn them into links
Not everyone sees their storify content as worth saving. Many of mine are not. But quite a few are used as references or embedded into other sites beyond my own.
Beyond all this gory code, HTML stuff, is a consideration of what kind of Web Creator you are, Type 1, meaning make and destroy, or Type 2, consider for the past, present and future.
I am for sure, a Type 2.
Update: Dec 20, 2017
Via a tweet thread I was looped in by Bruno Winck, you can always jump to Yet Another Third Party Hotel
It's great Simon but you are still on rented land. One day or another it will be sold or full of ads. Best is to bring it to your blog
Check this post https://t.co/pj00vU0rWl
— Bruno Winck (@brunowinck) December 20, 2017
Look at all the pretty pictures and storytelling in their about page
At university, while researching for his degree, our founder Jamil struggled to keep track of everything he found. He ended up grouping together useful links, images and notes into sections of a Word document, scrolling through page after page to find a single URL and wasting valuable time.
After a year travelling in New Zealand, Jamil’s friends kept asking him where he’d been and what he’d done, and each time he had to paste lists of links into emails. He’d label them, but without any context or visual cues, all they ended up with was a wall of URLs and no clear structure. Despite his efforts, Jamil’s emails weren’t useful, and as he exchanged more and more emails, they became very difficult to find and consume.
I’m glad Jamil got to spend a year in New Zealand. It’s been one of my favorite places in the world. Maybe he has heard of these things called “blogs” that provide the exact need described here? Why is he multiple emailing links to people? If he blogged, he could write once, and share links often.
Heck I did in 2000 when I visited New Zealand. I created a blog before there was software, handcrafted out of HTML.
Sure, go move your storify content to wakelet and call me when they go south.