====== WEB command line ======

===== See where a shortened url takes you before click =====

<code bash>
check(){ curl -sI $1 | sed -n 's/Location: *//p';}
</code>

===== Resolve short urls =====

<code bash>
resolve(){ curl -Is $1 | egrep "Location" | sed "s/Location: \(.*\)/\1/g"; }
</code>

===== Google URL shortener =====

<code bash>
python -c 'import googl; print googl.Googl("<your_google_api_key>").shorten("'$someurl'")[u"id"]'
</code>

===== Short URLs with ur1.ca =====

<code bash>
ur1() { curl -s --url http://ur1.ca/ -d longurl="$1" | sed -n -e '/Your ur1/!d;s/.*<a href="\(.*\)">.*$/\1/;p' ; }
</code>

===== Down for everyone or just me? =====

<code bash>
down4me() { wget -qO - "http://www.downforeveryoneorjustme.com/$1" | sed '/just you/!d;s/<[^>]*>//g' ; }
</code>

===== Trace http requests with tshark =====

<code bash>
tshark -i en1 -z proto,colinfo,http.request.uri,http.request.uri -R http.request.uri
</code>

===== Decode uri =====

<code bash>
csi -R uri-common -p '(uri-decode-string (read-line))'
</code>

===== Extract domain from URl =====

<code bash>
ruby -ruri -e 'u=URI(ARGV[0]).host.split("."); puts u[(u[-2] =~ /^com?$/ ? -3 : -2)..-1].join(".")' http://test.example.com
</code>

===== Get URL’s from a webpage =====

<code bash>
curl url | egrep -o '(http|https)://[a-z0-9]*\.[a-z0-9]*\.[a-z0-9]*'|sort |uniq
</code>

===== Encode file path to URL =====

<code bash>
convert_path2uri () { echo -n 'file://'; echo -n "$1"  | perl -pe 's/([^a-zA-Z0-9_\/.])/sprintf("%%%.2x", ord($1))/eg'  ;}   #convert2uri '/tmp/a b'   ### convert file path to URI
</code>

===== Python Cgi server for tests.  =====

<code bash>
python -m CGIHTTPServer
</code>

[[http://localhost:8000|CGI HTTP Server]]

===== Start a HTTP server which serves Python docs =====

<code bash>
pydoc -p 8888 & gnome-open http://localhost:8888
</code>

===== Web server in Ruby =====

<code bash>
ruby -rwebrick -e'WEBrick::HTTPServer.new(:Port => 3000, :DocumentRoot => Dir.pwd).start'
</code>

===== perl6 Download a webpage =====

<code bash>
perl6 -M HTTP::UserAgent -e 'say HTTP::UserAgent.new.get("google.com").content'
</code>

===== perl6 Download a webpage and strip out the HTML =====

<code bash>
wget -O - "http://perl6.org" | perl6 -ne 's:g/\<.+?\>//.say'
</code>

===== perl6 Download a webpage, strip out and decode the HTML =====

<code bash>
wget -O - "http://perl6.org" | perl6 -MHTML::Strip -ne 'strip_html($_).say'
</code>

===== Perl6 Launch a simple web server =====

<code bash>
perl6 -M HTTP::Server::Simple -e 'HTTP::Server::Simple.new.run'
</code>