I mean seriously, how does it loop through billions of pages this fast? Or are they categorized or something? I’m not asking how to build a google engine, I just want to know the basic concept behind it. I googled (how ironic) some results and all they say is that they index stuff… which doesn’t explain the speed.
