I don't think it's a user agent thing. Some sites use an advanced fingerprinting setup, (via Cloudflare, I think) that essentially blocks all script/command line access to the site. It's to avoid scrapers, and they're pretty tough to trick.
Thanks so much Brett this is a really incredible tool that I am really grateful for. I was searching for hours for a reliable webpage to markdown tool just a couple of weeks ago. There are a few out there, but your web version is by far the slickest and smartest. My problem with bookmarks or Instapaper or rss feeds is the lack of easy naming, filing and retrieval, but pasting into nvALT as Markdown is a great way to store things like articles or recipes.
Comments
I've been trying to use your script but certain sites give me this error:
Does the script allow to pass an argument which changes the user agent?
export
I don't think it's a user agent thing. Some sites use an advanced fingerprinting setup, (via Cloudflare, I think) that essentially blocks all script/command line access to the site. It's to avoid scrapers, and they're pretty tough to trick.
export
I have just very sexistly assumed ErgoOrgo is a man...
export
Wow! I wasn't expecting you to actually write something for me. Thanks and thanks to ErgoOrgo for his suggestion too.
export
@BG -- you could also try saving your word docs as html files and then running them through Grabber or some other html to markdown converter.
export
Thanks from me too - I've also been looking for something like this. Now if I could just find a .doc -> MMD converter, I'd be really happy.
export
Well, here's a start: https://gist.github.com/1746898
export
Thanks so much Brett this is a really incredible tool that I am really grateful for. I was searching for hours for a reliable webpage to markdown tool just a couple of weeks ago. There are a few out there, but your web version is by far the slickest and smartest. My problem with bookmarks or Instapaper or rss feeds is the lack of easy naming, filing and retrieval, but pasting into nvALT as Markdown is a great way to store things like articles or recipes.
Thanks again!
export