cover

How does a search engine find answers so fast?

Robot Librarians
How does a search engine find answers so fast?
You type a question, you press Enter, and **~~bam~~** — in less than a second, the answer appears. _It feels like magic_

You type a question, you press Enter, and bam — in less than a second, the answer appears. It feels like magic, like the internet was just sitting there waiting for you. But here's the twist: the search engine didn't go searching the whole web when you asked. It had already done its homework, weeks ago, before you ever showed up.

Long before your question, the search engine sent out little robot programs called "crawlers." Think of them as tireless librarians who wander the entire internet, clicking link after link after link. They visit a page, read it, follow every link to new pages, and just keep going — forever, day and night.

How was this book?