by Mark Stockley
The Dark Web is reflecting a little more light these days.
On Monday I wrote about Memex, DARPA's Deep Web search engine. Memex is a sophisticated tool set that has been in the hands of a few select law enforcement agencies for a year now, but it isn't available to regular users like you and me.
There is another search engine that is though.
Just a few days before I wrote that article, on 11 February, user Virgil Griffith went onto the Tor-talk mailing list and announced Onion City, a Dark Web search engine for the rest of us.
The search engine delves into the anonymous Tor network, finds .onion sites and makes them available to regular users on the ordinary World Wide Web.
Up to now the best way to search for .onion sites has been to get on the Tor network using something like the Tor browser, but Onion City effectively does that bit for you so you can search from the comfort of your favourite, insecure web browser.
The site can do this because it's a Tor2web proxy - a bit of software that acts as a go-between for the regular web and the Tor network.
It acts as a Tor client inside the Tor network and presents the sites it finds as regular web pages using subdomains of .onion.city.
One of the consequences of working this way is that Onion City search results are just regular web pages like any other, which makes them visible to you, me, the Onion City search engine and also, for the first time, Google.
In fact, Onion City's search functionality is a Google Custom Search, so if you can find something on Onion City you should be able to find it on Google too.
At the time of writing, there are about 650,000 Dark Web pages that have found their way into the regular Google index via Onion City.
Of course - as any small business owner can tell you - just because Google knows a website exists doesn't mean the site's pages will rank well. But those pages are at least in the mix now, enjoying their first rays of sunshine.
I took a quick look around and, because this is the Dark Web, I searched for amphetamines, 9mm ammunition and hackers for hire, and yes, it's all in there.
On Monday I wrote about Memex, DARPA's Deep Web search engine. Memex is a sophisticated tool set that has been in the hands of a few select law enforcement agencies for a year now, but it isn't available to regular users like you and me.
There is another search engine that is though.
Just a few days before I wrote that article, on 11 February, user Virgil Griffith went onto the Tor-talk mailing list and announced Onion City, a Dark Web search engine for the rest of us.
The search engine delves into the anonymous Tor network, finds .onion sites and makes them available to regular users on the ordinary World Wide Web.
Up to now the best way to search for .onion sites has been to get on the Tor network using something like the Tor browser, but Onion City effectively does that bit for you so you can search from the comfort of your favourite, insecure web browser.
The site can do this because it's a Tor2web proxy - a bit of software that acts as a go-between for the regular web and the Tor network.
It acts as a Tor client inside the Tor network and presents the sites it finds as regular web pages using subdomains of .onion.city.
One of the consequences of working this way is that Onion City search results are just regular web pages like any other, which makes them visible to you, me, the Onion City search engine and also, for the first time, Google.
In fact, Onion City's search functionality is a Google Custom Search, so if you can find something on Onion City you should be able to find it on Google too.
At the time of writing, there are about 650,000 Dark Web pages that have found their way into the regular Google index via Onion City.
Of course - as any small business owner can tell you - just because Google knows a website exists doesn't mean the site's pages will rank well. But those pages are at least in the mix now, enjoying their first rays of sunshine.
I took a quick look around and, because this is the Dark Web, I searched for amphetamines, 9mm ammunition and hackers for hire, and yes, it's all in there.
Comments
Post a Comment