Monthly Archives: March 2007

Multi-threaded programming

I’ve been head-down here working on the Web crawler and haven’t had much occasion to sit down and write blog entries. It’s been a very busy but interesting and rewarding time. A high performance distributed Web crawler is a rather … Continue reading

Posted in Programming, Web Crawling | 1 Comment

New Computers

David and I went to Fry’s on Monday to pick up parts for three new computers. We’ve been plugging away on this project for the last two months using our personal machines and some castoffs, and started bumping into hardware … Continue reading

Posted in Computers | 1 Comment

Is there a question here somewhere?

I uninstalled the Nero InCD program today while I was cleaning up my Windows machine. The uninstall program told me, before I confirmed that I wanted to remove the program, that I would have to reboot in order to complete … Continue reading

Posted in User Interface | Comments Off

What housing bubble?

Almost two years ago in The Housing Bubble, I warned that the then-current home building boom was unsustainable and that soon we would begin to see record numbers of defaults and foreclosures. I said then that I hoped I was … Continue reading

Posted in Finance | 1 Comment

Tasha, 1991 – 2007

Tasha the poodle came to us in May of 1997 along with her mom, Tiffany. Tasha was tiny when we got her. I think she weighed all of five pounds. I was always afraid that I’d somehow hurt her. Timid … Continue reading

Posted in Pets | 1 Comment

Crawling Along

After you get your basic web crawler downloading pages and extracting links, you find yourself having to make a decision: how do you feed the harvested URLs back into the crawler? For instance, if I visit www.mischel.com and extract a … Continue reading

Posted in Web Crawling | 3 Comments

A New Look

That’s a surprise, huh? You came here expecting to see the same old Random Notes page and you got something entirely different. It’s still me. But I’m in the process of changing things around a bit. I’ve installed WordPress on … Continue reading

Posted in Administration | Comments Off

Crawling the Web

I’m writing a Web crawler. Yeah, I know. It’s already been done. It seems like everybody’s done some Web crawling. But there’s a huge difference between dabbling at it and writing a scalable, high-performance Web crawler that can pull down … Continue reading

Posted in Web Crawling | 1 Comment