Requested: Turn Your Back On Bush

Requested by AxsDeny:

I’d like to hear your take on the turnyourbackonbush.com people. Specifically the incidents at OSU that led to the removal of a few of the students from the graduation ceremony.

First off, as far as the protest technique itself, I think it’s brilliant, especially in the current political climate we’ve got. When there are designated “protest zones” being set up at every event — generally so far removed from what’s actually going on that they’re nearly pointless — that anyone carrying an anti-Bush sign, wearing an anti-Bush shirt, or possibly even cracking an anti-Bush joke is going to get herded into, I think having a more or less “undercover” method of being able to publicly protest is very important.

By eschewing the normal protest trappings of signs and banners and dressing normally, people would be able to get in to more conspicuous spots closer to where Bush is and still be able to publicly show their opinion. It’s also wonderfully non-disruptive, if handled correctly: the protesters are doing nothing more than turning around. They’re not shouting, chanting slogans, or causing a public disturbance in any way. Ironically, of course, protesting in any way is seen as so reprehensible an activity these days that it’s quite likely that the people around the protesters will raise a fuss, security will be called in to pull them away, and far more attention will be paid to them than if they’d simply been allowed to stand in silence.

I love that.

As far as the removal of the TYBOB protesters at the OSU graduation, I think it’s despicable. Even before the graduation ceremony they were being threatened with arrest and denial of their diplomas, and at the ceremony, one man was escorted out and charged with disturbing the peace (a ridiculous charge, as he was being silent, as requested by the protest organizers — thankfully, the charges were dropped when he left peacefully).

As pointed out above, though, by reacting (and denouncing the protests proactively) as strongly as the OSU administration did, they called far more attention to the events than if they’d simply allowed everything to progress normally.

People — especially people in power — can be so stupid sometimes.

iTunesCyberspider” by Tear Garden, The from the album To Be an Angel Blind, the Crippled Soul Divide (1996, 3:53).

Requested: Women and Science

Requested by Royce:

I’m interested in hearing what you think about the Harvard “women may be congenitally less apt for the sciences” comment.

I’ve got to admit, I’m having a little difficulty with this one.

First off, this was the first I’d heard of it — somehow, this little fracas had managed to pass entirely under my radar until Royce mentioned it.

Secondly, and perhaps more importantly, virtually all there is on the ‘net is _re_action to the statements, which were made at a function that was neither taped or transcribed, so there’s not even complete agreement on what exactly was said. Just a lot of people up in arms about it.

From the first article that Royce linked to, I was at first inclined to write Harvard president Lawrence Summers off as a misogynistic shmuck. Trying to track down information about all this didn’t seem to support that, though.

The best account of what happened that I’ve found so far comes from the Washington Post and even here, it doesn’t really account for much of the story:

…[Summers] has provoked a new storm of controversy by suggesting that the shortage of elite female scientists may stem in part from “innate” differences between men and women.

…Summers laid out a series of possible explanations for the underrepresentation of women in the upper echelons of professional life, including upbringing, genetics and time spent on child-rearing. No transcript was made of Summers’s remarks, which were extemporaneous but delivered from notes. There was disagreement about precisely what he said.

…Summers pointed to research showing that girls are less likely to score top marks than boys in standardized math and science tests, even though the median scores of both sexes are comparable. He said yesterday that he did not offer any conclusion for why this should be so but merely suggested a number of possible hypotheses.

From that and other similar accounts I’ve found, it seems to me that Summers is being rather unnecessarily roasted over the flames. He didn’t say that women were any more or less intelligent or capable than men, only that there may be differences in the way men and women process and deal with information that may account for some of the disparity in the numbers of men and women in the higher sciences, and that these possibilities should be investigated. He was putting forth a hypothesis, not a conclusion — unfortunately, it’s a politically incorrect hypothesis, and because of that, he’s being lambasted for his remarks. It’s very possible that he might have badly chosen his words, and that’s much of what’s adding fuel to the fire here, but without a transcript that’s going to be difficult to determine.

One of the best overviews of the situation I’ve found comes from William Saletan at Slate:

Everyone agrees Summers’ remarks were impolitic. But were they wrong? Is it wrong to suggest that biological differences might cause more men than women to reach the academic elite in math and science?

[…]

What’s the evidence on Summers’ side? Start with the symptom: the gender gap in test scores. Next, consider biology. Sex is easily the biggest physical difference within a species. Men and women, unlike blacks and whites, have different organs and body designs. The inferable difference in genomes between two people of visibly different races is one-hundredth of 1 percent. The gap between the sexes vastly exceeds that. A year and a half ago, after completing a study of the Y chromosome, MIT biologist David Page calculated that male and female human genomes differed by 1 percent to 2 percent — “the same as the difference between a man and a male chimpanzee or between a woman and a female chimpanzee,” according to a paraphrase in the New York Times. “We all recite the mantra that we are 99 percent identical and take political comfort in it,” Page said. “But the reality is that the genetic difference between males and females absolutely dwarfs all other differences in the human genome.” Another geneticist pointed out that in some species 15 percent of genes were more active in one sex than in the other.

You’d expect some of these differences to show up in the brain, and they do. A study of mice published a year ago in Molecular Brain Research found that just 10 days after conception, at least 50 genes were more active in the developing brain of one sex than in the other. Comparing the findings to research on humans, the Los Angeles Times observed that “the corpus callosum, which carries communications between the two brain hemispheres, is generally larger in women’s brains [than in men’s]. Female brains also tend to be more symmetrical. … Men and women, on average, also possess documented differences in certain thinking tasks and in behaviors such as aggression.”

Let’s be clear about what this isn’t. It isn’t a claim about overall intelligence. Nor is it a justification for tolerating discrimination between two people of equal ability or accomplishment. Nor is it a concession that genetic handicaps can’t be overcome. Nor is it a statement that girls are inferior at math and science: It doesn’t dictate the limits of any individual, and it doesn’t entail that men are on average better than women at math or science. It’s a claim that the distribution of male scores is more spread out than the distribution of female scores — a greater percentage at both the bottom and the top. Nobody bats an eye at the overrepresentation of men in prison. But suggest that the excess might go both ways, and you’re a pig.

Also interestingly, yesterday I came across an article from the University of California, Irvine, where a study is showing that men and women of similar IQs process the information in very different ways — very much what it sounds to me like Summers was talking about and proposing that more work be done in studying these differences.

While there are essentially no disparities in general intelligence between the sexes, a UC Irvine study has found significant differences in brain areas where males and females manifest their intelligence.

The study shows women having more white matter and men more gray matter related to intellectual skill, revealing that no single neuroanatomical structure determines general intelligence and that different types of brain designs are capable of producing equivalent intellectual performance.

[…]

In general, men have approximately 6.5 times the amount of gray matter related to general intelligence than women, and women have nearly 10 times the amount of white matter related to intelligence than men. Gray matter represents information processing centers in the brain, and white matter represents the networking of — or connections between — these processing centers….

This, according to Rex Jung, a UNM neuropsychologist and co-author of the study, may help to explain why men tend to excel in tasks requiring more local processing (like mathematics), while women tend to excel at integrating and assimilating information from distributed gray-matter regions in the brain, such as required for language facility. These two very different neurological pathways and activity centers, however, result in equivalent overall performance on broad measures of cognitive ability, such as those found on intelligence tests.

At this point, I’m inclined to think that Summers is the victim of political correctness run amok. While it’s all very nice and fuzzy to say that no matter what, we’re all identical across the board, it’s not a very realistic idea. Of course, that doesn’t mean that different people, different sexes, different races, or different cultures are inherently better or worse than others, only that they’re different.

Trying to gloss over these differences under the veneer of political correctness is foolish, but when suggesting that we should look at these areas for more study results in a controversy like this, is it really that likely that we’re going to learn anything about ourselves? Sadly, I’m afraid not.

Requested: Penguins and Monkeys

Requested by Candace:

Penguins…..definately penguins….Oh! And monkeys too! :P

Penguin slap

Penguins, huh? And monkeys? Well, there’s two critters that don’t generally appear together as a topic. Hm…

I picked up my love for penguins (platonic, I assure you, you sickos) from dad, for the most part. When dad was working for the Alaska Court System, his office was practically wallpapered with pictures of penguins. He had little penguin figurines on his desk. Stuffed penguins on his shelves. Even a three-foot tall stuffed Emperor penguin in one corner. Penguins everywhere!

And — if I remember correctly — it all started through dad’s love of kids.

Dad’s been working as a custody investigator for years (first through DFYS, then the Alaska Court System, and now freelancing after his retirement). It can be something of a rough job, as he spends his days interviewing families that are splitting up for one reason or another and determining which parent should wind up with custody of the children. It can lead to some tough situations and hard days, but it can also be very rewarding for him, through working with the kids and doing what he can to make sure they’re placed in the best situation possible.

(Now, what follows comes from memory, so I may not have it quite exactly right. The gist should be pretty accurate, though.)

Because he spent a lot of time talking with young children, he always made sure to keep various toys and stuffed animals in his office for them to play with. Being a fan of Bloom County, one of the toys he had in his office was an Opus the penguin doll. After one of his sessions with a child, the kid came back later for another session and brought along a picture they had drawn for dad of his penguin, which he then put up on his wall.

Later, another kid came in, saw the Opus doll and the penguin picture, and drew another one. Co-workers started to notice that there were a few penguins in dad’s office, figured that “hey, this guy must like penguins,” and got him a penguin calendar. Or another stuffed penguin. Or a little penguin figurine. And on, and on, and on…

After a while, it was difficult to look anywhere in dad’s office without seeing a penguin. And — perhaps as evidence that immersion therapy really does work — a perceived thing for penguins eventually became a real thing for penguins.

Me being my dad’s son, and sharing much of his sense of humor and love of the absurd, it’s not all that surprising that I’d pick up on all this. It certainly helped that I grew up reading Bloom County, of course, but penguins are such silly, fun little birds that it’d be tough not to like them anyway. I don’t have the penguin wallpaper effect going on that dad did for years, but I do have a little stuffed penguin that sits atop my computer monitor that Prairie got me a while ago, and I always make sure to stop by the penguin exhibits when we go to a zoo. Definitely my favorite animal out there.

Monkeys, now. That’s a little tougher for me. Candice had a purple monkey in her truck, and Prairie has a pink monkey in her car, but that’s about my only association with monkeys at the moment. I do have a couple of monkeys in my past, though (whether or not you want to include some of my friends on that list is entirely up to you).

Me, Kermit, and Charles Wallace in 1991

For a long time, I had an arm-puppet monkey with a little squeaker air bulb in his mouth that I liked playing with. More importantly, though, was the one stuffed animal I had as a kid — Charles Wallace (named after the little boy in Madeline L’Engle’s A Wrinkle in Time).

Charles actually looked more like a dog, with his big floppy ears, but for some reason I always considered him a monkey. I had him for the longest time (and still do, I’m sure, I believe he’s in a box up in Anchorage at the moment), and even had mom perform surgery on him at one point after a fight between my brother and I when we each had ahold of one of Charles’ legs, tugging back and forth…and Charles got suddenly neutered.

iTunesHeat” by Kronos Quartet from the album Heat (1995, 7:41).

Gallimaufry 5

The weekly music meme: ten songs at random from my music collection, plus assorted rambling.

  • The Shamen, ‘Phorever People (Shamen Dub)’, off of Phorever People: The Shamen were one of the early-90’s techno groups that I liked a lot. Not quite as good as Utah Saints, but definitely further towards the top of the heap than many other acts, able to produce entire albums that were listenable, rather than just the odd single here or there. This is a fairly trancy ‘dub’ mix (no vocals) of one of their singles that didn’t quite break as big on the scene. Sounds like something that’d make a good background piece for the soundtrack of a tech-heavy film.

  • The Prodigy, ‘Diesel Power (Snake Break)’, off of The Fat Mixes: I’m pretty sure that The Fat Mixes isn’t an official album — at least, I’ve never found any official word about it. I downloaded it a long time ago, when I was first exploring the world of Napster (back when the world of Napster was worth exploring). It’s a collection of various remixes of tracks off of The Fat of the Land, some mediocre and some that are very impressive. The one downside is that as I’ve never found a real copy of it, all I have are mid-bitrate .mp3s that don’t sound nearly as good as I wish they did.

  • Sunscreem, ‘Love U More (A Version)’, off of Love U More: One of my favorite songs of all time. Bright, bouncy, and happy (tempered with some occasionally somewhat disturbing lyrics), saying that no matter what happens, “you know you could never make me love you more.” This one never fails to put a smile on my face when I hear it. While this version’s off of the single, it’s nearly (if not entirely) identical to the version on their album O3 — the various remixes on the single were rather boring.

  • Tag Team, ‘Whoomp! (There It Is)‘, off of DJ Bass Mix: Aaah, the joys of having been a DJ…and a DJ who every so often had to cater to popular tastes, even when they weren’t exactly up my alley. Still, as far as 90’s one-hit-wonder hip-hop songs go, this one really isn’t that bad. Best, though, was ending up with an acapella version, which allowed me to run the vocals on top of My Life With the Thrill Kill Kult‘s’A Girl Doesn’t Get Killed By A Make-Believe Lover (‘Cuz It’s Hot)‘ — and that worked a lot better than it really should have.

  • The Art of Noise, ‘Dragnet ’88’, off of Best of the Art of Noise: Experimental art-techno group The Art of Noise’s take on the Dragnet theme, done for the 1988 movie starring Tom Hanks and Dan Aykroyd. I have no memory of whether or not the movie is any good, but I really like Art of Noise, and the samples they’ve sprinkled throughout the song are fun (“You’ve got a lot of repressed feelings, don’t you Friday? Must be what keeps your hair up.”)

  • Mickey Hart and Planet Drum, ‘Indoscrub’, off of Supralingua: Planet Drum is ex-Grateful Dead drummer Mickey Hart‘s world music project, focusing primarily on various forms of ~~sitar~~ drumming and percussion. Good percussion has a tendency to catch my ear, so I picked this one up on a whim one day when I ran across it browsing at random. Good stuff, though it all sounds similar enough that I’d be hard pressed to tell one track from another by ear.

  • Bedhead, ‘Crushing‘, off of WhatFunLifeWas: A long time ago, I came across a review of this album on the ‘net that was so well-written and so complimentary of the album that I went out and picked it up based solely on the strength of that review. Lucklily, I wasn’t disappointed in the least — while it’s not my normal style of music (strictly guitar, bass, and drums, rather than the electronic-heavy music I tend to gravitate towards), it actually often reminds me of a lot of ambient music: lots of flowing themes, vocals that don’t overpower and often blend right in with the instruments, and very relaxing. A little hard to describe, but highly recommended.

  • VNV Nation, ‘Arclight’, off of Empires: Due to my DJing in Anchorage taking me away from the goth/industrial music that got me started and into more standard dance/techno/pop stuff, I ended up losing track of what was going on in the goth/industrial world for a good few years. Because of this, I’ve only recently been coming across artists that I’m finding I like a lot: Beborn Beton, Covenant, Wumpscut, Velvet Acid Christ…and VNV Nation. Time after time, I’d hear a song at The Vogue, ask the DJ what it was, and it would be VNV Nation. Eventually, I picked up two of their albums (Empires and Futureperfect), and they’re both excellent. This is very much where my tastes lie these days (and as I’m still working on discovering much of this stuff, recommendations are always appreciated!).

  • Pigface, ‘Lost Track’, off of Preaching to the Perverted: The Best of Pigface: I’ve mentioned before that Pigface is one of my favorite groups. This is a short, but very fun little track, one of the many “B-sides” on their recent “Best of” compilation two-disc album. Not much more than percussion here, just a couple minutes of heavy drumming with some odd little electronic bleeps and bloops to spice it up a bit. Sounds like the beginning of a work in progress that never made it much further than what it is.

  • Liam Howlett, ‘Section 7‘, off of Prodigy Presents the Dirtchamber Sessions, Vol. 1: Technically, the stores list this as a Prodigy album — which, since The Prodigy basically is Liam Howlett, isn’t strictly wrong — but as this album is all mixwork and no strictly original compositions, I keep it filed under Liam’s name. It’s an incredible disc, too, letting Liam show off both his DJ skills and his insanely comprehensive record collection, both of which he does handily. This track alone samples LL Cool J, Digital Underground, Uptown, and Cold Cut, and most of the other tracks on the album sample two to three times as many individual cuts over the course of each mix. Good stuff.

And this week’s bonus track…

iTunesSir Psycho Sexy” by Red Hot Chili Peppers from the album Blood Sugar Sex Magik (1991, 8:16).

Death of a Spammer, in a Place Called Hope

THIS STORY IS FICTION

Death of a Spammer, in a Place Called Hope

By Todd F. Bryant
Staff Writer

HOPE, CA — In this dusty Mojave town, pop. 5000, which averages roughly one murder per decade, Sheriff James Wilcox recently encountered the first serious crime he was unable to solve in his 25-year law enforcement career.

“Incidents like this don’t happen here,” said the 50-year-old Wilcox, who has one deputy, his daughter, and operates out of a converted construction trailer with a single makeshift cell, which is rarely occupied. “We’re not exactly Crime City, U.S.A.”

The crime was murder. The victim was a local resident, a white male, 42, shot six times in the chest and arms. The time was roughly 4 p.m. The location was the post office. There were no witnesses. The Hope post office is staffed only 4 hours a day, but the lobby doors are unlocked around the clock so that residents can access their post-office boxes. The victim, Keith James Lawrence, unmarried, was gunned down in the post-office-box area.

“Heidi [his daughter] and I knew this was going to be a tough one,” said Wilcox. “Nobody around to see it. Nobody even heard any shots. Not even a suspicious vehicle seen in the area. Just bad luck for us. It happens.”

It was during the autopsy that things took a turn for the weird. The medical examiner noticed an obstruction lodged deep in the victim’s throat. He reached in and pulled out the objectÐa can of Spam. “I knew then that we had something that was maybe out of our league,” said the examiner, Dr. Anu Ram, a surgeon at Mojave County Hospital. “I mean, we don’t know anything about serial killers here, and I told Jim [Wilcox], ‘This is really scary. It’s probably some guy traveling around killing random people, and this is his signature.'”

It is perhaps only in small rural towns like Hope that a can of Spam and murder wouldn’t immediately conjure up an obvious hypothesis. Wilcox, while not oblivious to the existence of the World Wide Web and email, did not have an Internet connection and hadn’t heard the word “spam” used in the context of junk mail. It was only when Wilcox talked to his daughter on the phone two days after the crime (she had gone out of town for a scheduled visit with her husband’s relatives), that the pieces began to fit together. “I told her the victim had a post-office box there, that it had letters in it, with money in the form of money orders and cash, generally five dollars each, and it appeared he was running some kind of a business selling information for a few bucks a pop. It looked legitimate to me, so I wasn’t focusing on that. And then I told her about the can of Spam.”

“I knew right then, or at least I thought I did, what the motive was,” says Heidi Jensen, 29, who has worked with her father since she was 17. “I said, ‘Daddy, this guy is a spammer.’ And he goes, ‘A what?’ And I’m like, ‘A spammer, he sends out those messages, you know, “make money fast” and “get a new mortgage” and stuff.’ He had no idea what I was talking about. He refused to believe that spam could be a motive for murder. I’m like, ‘Daddy, you’re not on AOL, you don’t understand.'”

But Wilcox was not one to ignore what he calls his daughter’s “intuition.” He acquired an expert in computers–by calling the local computer store, and securing the services of a clerk for $10 an hour–and examined Lawrence’s Dell computer hard drive and dozens of CD-ROMs. “It was true, this guy was a spammer,” said Wilcox, who is now well-versed in Internet lingo. “He had literally millions of e-mail addresses, and lots of bills from different ISPs, and we determined he’d been doing this for about two years. He grossed about $5,000 a year from it.”

At that point, Wilcox called the FBI, who sent an agent to help him scan Lawrence’s email and snail-mail records for any particularly hostile messages. Not surprisingly, they found quite a few. In fact, they found so many that they stopped cataloguing them when they reached 200.

“This case is impossible,” said Wilcox, shaking his head. “I mean, if you add up all the spam recipients who threatened his life directly, that’s probably ten thousand right there, probably more. And really, it’s the ones that don’t make overt threats who are usually the perpetrators in grudge cases like this, because the folks who write the poison-pen letters get it out of their system. So now you’ve got to add all of the other people on those CD-ROMs to the list. There’s roughly 20 or 30 million suspects in this case, all over the world.”

Wilcox tracked down a few more manageable leads. “I thought maybe one of Lawrence’s acquaintances might have killed him, knowing he was a spammer, and made it look like a grudge crime. But, no, that didn’t really pan out. I couldn’t find anything substantial there.”

Both the Mojave Sheriff’s department and the FBI classify the case as open. At this writing, ten weeks after the murder, no suspects have been interviewed.

“Will [the killer] do it again?” Wilcox asks. “I don’t know. But I don’t think he was mad at Stanley Lawrence the person. I think he was mad at spammers. And there are a lot of spammers out there.

“And I’ll tell you this much: I wouldn’t want to be one.”

For more information on just what this is all about, check in with Brian Flemming.

(via John)

iTunesBizarre Love Triangle (Hot Tracks)“ by New Order from the album Hot Tracks 15th Anniversary Collectors Edition (1997, 8:05).

Judy Bachrach on FOX News

How wonderful. Judy Bachrach, from Vanity Fair, was on FOX News earlier today and completely ambushed FOX anchor Brigitte Quinn. Rather than a cute fluff piece on the inauguration, Bachrach launched into an indictment of the forty million dollars being spent on Bush’s parties rather than on anything useful.

Oliver Willis is hosting the video, which is so worth watching. Ryland was kind enough to type up a transcript, which you’ll find below the cut…

Read more

Engine Ice

Engine Ice

This picture wasn’t taken by me, I just thought it was incredibly cool! A friend forwarded it to me along with the accompanying text explanation.

“We had a mixed-precip event last night as the temperatures started rising above freezing and the snow changed over. The ramp was a sheet of slick wet ice, and even with crushed stone (urea) spread, it was glazing over as quickly as we could deploy it. As flight 1830 was coming into the stand, I motioned to the deck for them to proceed very cautiously, which apparently they’d been doing for the whole taxi (it took a long time between calling on-deck and getting to the gate).

When it finally pulled in, we noticed what is in the attached picture. None of us had ever seen it before. Very cool. I ran and grabbed my camera. I apologize for the quality, since it was melting off quickly as the fan had stopped spinning I just pulled out the camera and took two quick snaps. I guess I didn’t have a steady hand in the rain!”

(via The Usual Suspects)

All Request Saturday

Here’s an interesting idea, stolen from Terrance, who stole it from Stay of Execution: an all-request day.

Something about me you’d like to know? Something you’d like me to ramble on about? Pick a topic, any topic, and drop it in the comments. Come Saturday, I’ll go through what (if anything) is there and start babbling.

Of course, if nothing appears, I still reserve the right to go on about whatever I damn well please, so don’t think that by not suggesting anything you’re any more likely to get me to shut up. :)

iTunesSituation (The English Breakfast)” by Yaz from the album Don’t Go/Situation (1999, 9:04).

Prior art for ‘nofollow’ blocking

With the addition of rel=“nofollow” to our arsenal of anti-spam tools, there’s a certain level of chatter about the ability to add a block element to a webpage to delineate certain areas of the page that should not be indexed by Google or other search engines.

Most of the time I see this mentioned, credit has gone to Brad Choate’s post from Feb. 2002 for first advancing the idea. However, the idea itself dates as far back as Jan. 2001 in Zoltan Milosevic’s Fluid Dynamics Search Engine, a shareware site-specific search engine.

I used the FDSE on my site for a while (starting Feb. 6, 2002), and found its support for blocking sections of pages from the search engine to be incredibly useful.

For instance, the sidebar on my site changes frequently: on the front page, the linklog updates often, somtimes multiple times a day; and on the individual pages, the ‘related entries’ list can change over time as new entries are added and the pages are rebuilt. Because of this, it’s not uncommon for me to see people arrive through Google searches for terms that were in the sidebar of a particular page when Google’s spider crawled my site, but have since disappeared.

In another situation, try using Google to search my site for an instance of when I’m actually talking about TrackBack: as the term “TrackBack” is on every single individual entry page, the noise to content ratio is weighted in entirely the wrong direction. If I had the ability to block off the sidebar and the TrackBack section header, these problems could be avoided.

FDSE allowed me to do just that — and part of what I liked about it was that it used the same syntax as the standard robot commands used in robots.txt files or meta tags. From the FDSE Help Pages:

FDSE supports the proprietary “robots” comment tag. This tag allows a web author to apply robots exclusion rules to arbitrary sections of a document. The tag has one attribute, content, with the following possible values:

  • noindex – the text enclosed in the tag is not saved in the index
  • nofollow – links are not extracted from the text enclosed
  • none – enclosed text is not indexed nor searched for links

Values “index”, “follow”, and “all” are also valid. In practice they are ignored since they are the unspoken defaults.

This feature is expected to fit the customer need of preventing certain parts of a document – such as a navigational sidebar – from being included in the search.

Example:

<HTML>
<BODY>

    This text will be indexed.
    <a href="foo.html"> this link will be followed </A>

    <!-- robots content="none" -->

        This text will NOT be indexed.
        <a href="bar.html"> this link will NOT be followed </A>

    <!-- /robots -->

    <!-- robots content="noindex" -->

        This text will NOT be indexed.
        <a href="bar1.html"> this link WILL be followed </A>

    <!-- /robots -->

    <!-- robots content="nofollow" -->

        This text WILL be indexed.
        <a href="bar1.html"> this link will NOT be followed </A>

    <!-- /robots -->

    la la la

</BODY>
</HTML>

For the example of a navigational sidebar, the “noindex” vale would be the best choice.

This syntax was designed to match the robots META tag.

For documents which have both the “robots” META tag and the “robots” comment tag, the most restrictive interpretation will be made, always erring on the side on not indexing or not following.

According to the above cited help documentation, Milosevic introduced this functionality in v2.0.0.0031 of the FDSE, and a quick check of FDSE’s version history dates that release to Jan. 26th, 2001 — four years before even a hint of its functionality was added to the major search engines, and just over a year before Brad’s post went up (no disrespect at all is meant to Brad here — different people have the same ideas fairly often, after all, and it’s an equally good idea no matter who came up with it — I’m just trying to give credit where credit is due, since this is a technique I’m actually familiar with).

Obviously, I’m fairly happy about seeing rel=“nofollow” gain support with Google and the other search engines. Equally obviously by this point, I’m sure, I’d love to see a block-level implementation made available, and I think Milosevic had a good approach. It’s easy to implement, follows already established conventions (robots.txt and meta tags), validates (as it’s simply an HTML comment), and allows for a little more control than a simple on/off ignore switch would.

Battling the spammers

Over the past few days, I’ve noticed off and on that my webserver has been extremely slow to respond — less obviously when just browsing pages, but attempting to connect to the Movable Type interface was increasingly difficult, often resulting in nothing but timeouts and connection failures.

I had a hunch that I knew what was going on, but I wasn’t entirely sure at first. I logged in to the server locally — something I haven’t had to do in a while — and realized just how badly the machine was bogged down when the OS X user interface was almost as unresponsive as Movable Type. Not a good sign. Once I made it in and got a terminal window up, I ran top -u 15 to see what was going on.

Not surprisingly, every entry that top displayed was a perl process, with mysqld occasionally clawing its way to the top for a moment or two. Now I was almost entirely sure that one or more of the sites I host was under a major automated comment spam attack, as even with MT-Blacklist installed and refusing the majority of the submitted comments, it would require a certain amount of processing for each request, and while I’m not sure just how many a minute were being submitted, it was obviously enough to bring my server to its knees.

So, seeing if I could kill two birds with one stone, I renamed all the comment and trackback scripts on the webserver, figuring that this would kill any in-progress attack and in doing so, confirm that it was a spam attack. Sure enough, as the multitudes of perl processes slowly worked their way through to completion, top started running faster (it had been updating once every 6-10 seconds, rather than once a second) and other processes started to show up on the display. After about two minutes, there wasn’t a single perl process on top‘s list, top was updating at its standard once-per-second frequency, and the computer’s UI was responding as it should.

The downside to this technique is that it breaks comment and trackback ability. Easy enough to fix, though, with a quick change to MT’s config file and a rebuild of the sites. So, the comment scripts have been renamed, and I’m in the process of rebuilding the sites to reflect the new script locations.

And you know what?

Even in mid-rebuild, I’m already starting to watch the number of perl process climb. One or two I’d expect while rebuilding the site, but I’m currently seeing anywhere from two to ten at a time. I’ve got a really bad feeling that whatever spammer has me targeted has a script smart enough to scrape the pages to find the script locations, no matter what they are named.

This — in a word — sucks. Outside of turning comments off entirely for the targeted sites, which really doesn’t thrill me, I’m not sure where to go next.

Guess for now I’ll just have to keep an eye on things and see how they go.