Skip to content

2010

Links for 2010-12-31

Links for 2010-12-16

Links for 2010-12-13

  • Accentuate.us : 'We are proud to announce the free and open-source Accentuate.us, a new method of input for over 100 languages that uses statistical reasoning so that users can type effortlessly in plain ASCII while ultimately producing accurate text. This allows Vietnamese users, for example, to simply type "Moi nguoi deu co quyen tu do ngon luan va bay to quan diem," which will be automatically corrected to "M?i ng??i ??u có quy?n t? do ngôn lu?n và b?y t? quan ?i?m" after Accentuation. To date, we support four clients: Mozilla Firefox, Perl, Python, and Vim, with more to be added shortly.' cool

    accents language web-services typing text-entry ascii unicode characters

  • The Day MAME Saved My Ass : 'Publishers would have people believe that MAME and the emulation scene is the root of all evil, that it promotes piracy and ultimately hurts the poor, starving developers slaving away on the game. Not only is this claim patently false, it ignores the fact that many developers use things like MAME, mod chips, and homebrew development utilities to help us overcome the day-to-day frustrations caused by the people behind the real problems in our industry.'

    mame games coding legal spy-hunter emulation rips takedowns

  • Digital Socket Awards : 'We'd like you to nominate the longlist of best music of 2010 on www.digitalsocketawards.com. From this, 26 blogger judges from towns and cities all over Ireland will each score their top choices to reach a shortlist of three finalists in each category. The winners will be announced on 3 February 2011 at a live event in Dublin's Grand Social.'

    blogs blogging irishblogs music mp3 mp3blogs ireland awards

Links for 2010-12-03

Links for 2010-12-02

Links for 2010-12-01

  • Barry Eichengreen on the Irish bailout : 'The Irish "program" solves exactly nothing – it simply kicks the can down the road. A public debt that will now top out at around 130 per cent of GDP has not been reduced by a single cent. The interest payments that the Irish sovereign will have to make have not been reduced by a single cent, given the rate of 5.8% on the international loan. After a couple of years, not just interest but also principal is supposed to begin to be repaid. Ireland will be transferring nearly 10 per cent of its national income as reparations to the bondholders, year after painful year. This is not politically sustainable, as anyone who remembers Germany's own experience with World War I reparations should know. A populist backlash is inevitable.'

    ireland economy bailout eu euro

  • Video: Robots Explain The Irish Economic Crisis : Pretty good explanation, actually

    news ireland robots youtube debt eu politics economy

Links for 2010-11-26

Links for 2010-11-19

Links for 2010-11-16

Links for 2010-11-09

  • Tony Finch - Some notes on Bloom filters : more good Bloom Filter tips. he says: 'I take a slightly different tack, starting with a target population in mind which determines the size of the filter. Also there's a minor error regarding performance in the corte.si post. You only need to calculate two hash functions, and use a linear combination of them to index the Bloom filter. This simplifies the coding a lot, and if hash calculation dominates filter indexing, it's also a lot faster.'

    bloom-filters tips coding via:fanf false-positives

Links for 2010-11-01

Name-checked in the Seanad

So, after I posted this post about Aslan's imaginary illegal downloads, someone on Twitter linked to this comment by Senator Paschal Mooney (Fianna Fail), in the Seanad the next day, repeating the incorrect Aslan factoid:

Sen. Paschal Mooney (Fianna Fail): There is a perception that the big five record companies, all international companies, have been ripping off the consumer for many years. I do not want to be seen as an apologist for the music industry, but at the lower level I can give a specific example to highlight the impact of illegal downloading on Aslan, an Irish band. It has sold 6,000 copies of its current album, but there have been 22,000 illegal downloads. [...] Why must we wait for a High Court judgment to be made before we introduce relevant legislation?

It appears a few people, Adam Beecher for one, got in touch with the Senator by email. To my surprise, a couple of days later, I got some Twitter messages telling me that I'd been mentioned in the Seanad! Indeed, here it is:

Sen. Paschal Mooney (Fianna Fail): Last week on the Order of Business I raised an issue relating to illegal downloading of music on the Internet which followed on a court case which the major international record companies had lost that had been taken the previous day. I asked the Leader what possible legislation could be introduced to address this gap, and I am repeating the request. I have had quite a significant amount of response to the comments I made last week, specifically from persons who state that the figures quoted in my report, and also the figures quoted in the court case to defend the record companies' position, are inaccurate, and I was asked by a number of those who emailed me to correct the record. Having investigated this further - I recommend to the House that those who are interested log on to taint.org - there is no doubt that the figures that have been quoted to support the court case, which was subsequently lost, are not accurate. It related to the group Aslan. I do not want to delay the House on this other than to correct the record in that I put the figures as I had received them in good faith and such has been the response to the comments I made in the House last week that I feel obliged to correct the record and state that there is no doubt but that the figures that have been used are, at best, suspect.

It would be important if the Leader could have the Minister for Enterprise, Trade and Innovation, Deputy Batt O'Keeffe, come to the House to give some indication of his proposals because the music industry is currently lobbying in this House and in the other House to have legislation changed to benefit it. However, there is a wider view that illegal downloading will continue irrespective of what happens, the record companies are now on the defensive and there are other alternatives that could be brought forward such as licensing those who wish to download. In that context, I would be interested in the Leader's response.

A few comments in response:

  • Credit is due to Senator Mooney in that he admitted that he'd been misled, and corrected the record in that regard.

  • it's amazing to see that the democratic process has opened up to this degree. I would have never expected to have this degree of input to our elected representatives without having to go through more traditional channels (face-to-face meetings etc.)

  • Finally: 'The music industry is currently lobbying in this House and in the other House to have legislation changed to benefit it'. That is very, very worrying. Indeed, suzybie noted on Twitter:

@jmason not sure if you caught it but I saw Willie K and his mates entering Dáíl last Wednesday evening. FF backbenchers were being met

McGarr solicitors have been in touch with the relevant Ministers requesting that Digital Rights Ireland be included in any discussions regarding legislative change. This will be one to keep an eye on.

aslan copyright filesharing ireland paschal-mooney politics seanad

Links for 2010-10-18

Irish Times Letter re EMI v UPC

Submitted via email to their letters page. This may be a bit too long for the format, but hey. Enjoy.

Madam, -- Commentary in this paper and elsewhere has given the impression that Mr. Justice Charleton's judgement on the EMI v. UPC case was a poor result for EMI and the other record companies represented. This is not necessarily the case. While UPC may not yet have to implement "three strikes", there are many things to worry the Irish internet user in the judgement.

Mr. Justice Charleton states that he is satisfied that the business of the recording companies is being devastated by piracy, entirely based on evidence submitted by the record companies and IRMA. One of these assertions was that over 20,000 illegal downloads of an "Aslan" album had been "traced" -- but no details of the methodology of this "tracing" has been produced.

Third-party attempts to reproduce this figure indicate that it is probable that an extremely naive approach was taken in this testing -- the putative copies of the album available to download, and their large download figures, are in reality a lure used by criminals to persuade unwitting victims to provide their credit card details to fraudulent websites.

Worryingly, this flawed evidence has already been represented as fact in the Seanad by FF senator Paschal Mooney.

Other studies cited in the judgement have been criticised widely elsewhere, including by the US Government Accountability Office in its April 2010 report to the US Congress.

Mr. Justice Charleton goes on to suggest that all internet access from UPC (and presumably other ISPs) be filtered through a piracy-detection system. One wonders what the many companies who currently run internet-based services from Ireland would make of this proposal.

The government now seems keen to rush in and implement the filtering and blocking systems requested by IRMA and the music companies, as Mr. Justice Charleton recommends, or possibly even to give hand-outs to the music industry to compensate them, as IRMA demands. One hopes that more technical expertise will be brought to bear on the supposed "evidence" before this happens.

Yours, etc., Justin Mason

irish-times letters emi upc filesharing copyright paschal-mooney

Links for 2010-10-14

Links for 2010-10-13

Aslan's hard times, from the UPC judgement

Oh dear. Quoting Mr Justice Charleton's judgement in favour of UPC vs. EMI, Sony, et al:

'This scourge of internet piracy strongly affects Irish musicians, most of whom pay tax in Ireland. 'Aslan' is a distinguished Irish group which has a loyal fan base; but not all of them believe in paying for music.Previous sales of their albums were excellent, about 35,000 per album, and in respect of one called "Platinum Collection", a three CD box set, 50,000 copies were sold. More recently, an album called "Uncased" was released and only 6,000 copies were sold.Perhaps, it might be thought, the album was not popular and did not sell well? In contrast, a search was made to see how many illegal downloads had been made on the internet from that album, and 22,000 were traced.'

Aslan, eh?

So, that would be about the same figure as EMI quoted in a press statement in July 2009, which 'Gambra' on the thumped.com boards thoroughly debunked at the time:

'I've just been listening to the first minute or two of this and have done a mere 10 minutes of googling to try verify the claim of 25,000 downloads. The EMI press statement mentioned that they've tracked that amount of downloads "through Torrents Nova and Pirate Bay alone." The first problem with that is that there's no such site as Torrents Nova (I presumed they meant mininova but Aslan gets zero hits over there) but never mind, we'll carry on.

Next I search for ever possible permutation for downloads of the new Aslan album and I kept getting the same result which is "Aslan - Uncase'd (2009) KompletlyWyred Dhz.inc" which was uploaded to thepiratebay. However this file only has a grand total of 9 seeders and 6 leechers and has been alive since the 26th of June. There's no way of telling how many times it's been leeched exactly but even if it was 6 new leechers every day it'd be a total of 108 downloads. It is fair to assume that only 9 of these bothered to seed back so I'd say the total is right.

Wondering still where the hell they got their mystical 25,000 total from I just searched for "Aslan Uncased" and was surprised to see 5 links to torrents of the album in the first two pages of results. However 4 of the 5 just link back to the one on TPB with 9 seeders. The 5th is where I think they got their mystical 25,000 total from:

http://www.nowtorrents.com/torrents/aslan-uncased.html

This is the 7th result you get on google for the album title and when you click it you actually get "No Matches were found" but up at the top are FAKE results that are actually just ad links. You could search for anything and you'll get those exact same four ad results.

http://www.nowtorrents.com/torrents/gambra-thumped.html

If you refresh the totals change each time so it's safe to say they found this link by googling the name, added up the total of listed downloads they got (which is totally random) and are using that to moan about their loss of sales. Incredible.'

Indeed, according to the site, an album called 'Justin Mason on the nose flute' has been downloaded 24,752 times -- I never knew! Where's my cheque?

Some quality facts and figures from EMI there, I suspect.

upc ireland aslan funny law emi

Links for 2010-10-11

Links for 2010-10-08

  • NAMAland : 'At NAMAland we like to look on the bright side. OK, the downside of NAMA is that it's costing you €54 billion -- the upside is that you now own some of the best (and worst) properties in Dublin. So grab your phone, put on your tophat and enjoy your new role as a property tycoon with our augmented reality tour of NAMAland. Remember, we-are-where-we-are, there's no point playing the blame game, we were all living beyond our means and it was like that when we got here...' Excellent! a Layar Augmented Reality layer for Layar which lets you see properties in Dublin owned by NAMA, the National Asset Management Agency

    nama funny ouch augmented-reality layar dublin ireland

Links for 2010-10-07

  • Web service - current time zone for a city? - Stack Overflow : 'a web service of some sort (or any other way) to pull a current time zone settings for a (US) city. For the parts of the country that don't follow the Daylight Saving Time and basically jump timezones when everyone else is switching summer/winter time... I don't fancy creating own database of the places that don't follow DST. Is there a way to pull this data on demand?' earthtools.org seems the closest thing

    dst daylight-savings local timezones iso8601 dates times web-services http

  • Facebook now does export : 'we've built an easy way to quickly download to your computer everything you've ever posted on Facebook and all your correspondences with friends: your messages, Wall posts, photos, status updates and profile information. If you want a copy of the information you've put on Facebook for any reason, you can click a link and easily get a copy of all of it in a single download.' excellent

    facebook export data control privacy personal-data

Links for 2010-10-04

Links for 2010-09-28

Links for 2010-09-23

  • why James Gosling left Oracle : 1. made him take an effective pay cut; 2. removed decision authority on Java; 3. he felt Oracle was "ethically challenged". also: 'he felt the hand of Larry Ellison in nearly all the decisions affecting Java'; "He's the kind of person that just gives me the creeps," he said. "All of the senior people at Sun got screwed compensation-wise. Their job titles may have been the same, but their ability to decide anything was just gone." he doesn't pull any punches. oh dear, this is all adding up...

    java oracle opensource sun james-gosling larry-ellison gossip

Links for 2010-09-19

  • Bunnie Huang on the simulated 6502 : 'It makes my head spin to think that the CPU from the first real computer I used, the Apple II, is now simulateable at the mask level as a browser plug-in. Nothing to install, and it's Open-licensed. How far we have come…a little more than a decade ago, completing a project like this would have resulted in a couple PhDs being awarded, or regarded as trade secret by some big EDA vendor. This is just unreal…but very cool!'

    simulation bunnie-huang 6502 cpu chips emulation hardware

  • www.Visual6502.org : 'working from a single 6502, we exposed the silicon die, photographed its surface at high resolution and also photographed its substrate. Using these two highly detailed aligned photographs, we created vector polygon models of each of the chip's physical components - about 20,000 of them in total for the 6502. These components form circuits in a few simple ways according to how they contact each other, so by intersecting our polygons, we were able to create a complete digital model and transistor-level simulation of the chip. This model is very accurate and can run classic 6502 programs, including Atari games. By rendering our polygons with colors corresponding to their 'high' or 'low' logic state, we can show, visually, exactly how the chip operates: how it reads data and instructions from memory, how its registers and internal busses operate, and how toggling a single input pin (the 'clock') on and off drives the entire chip to step through a program and get things done.' Awesome

    6502 emulation physics simulation mos atari-2600 pet commodore c-64 cpu silicon

Links for 2010-09-13

Links for 2010-09-07

  • Game On : exhibition billing itself as "the world's biggest celebration of games", arrives in Dublin on Sep 20 at the Ambassador, on tour from its home in The Barbican Art Gallery in London. 'Enjoy a totally interactive experience with rare memorabilia and play your way through over 100 playable games from the arcade classics to the latest releases.' tix are EUR10

    games gaming exhibitions dublin

  • Your Country, Your Call, You're Doomed : Bock on the predictably-crap biz-waffle results from the YCYC "get Ireland back on track" competition. 'If we don't take this seriously, we're doomed to repeat the current economic disaster over and over again, each generation with its own Bertie Ahern, its own Seanie Fitzpatrick, its own Fingers Fingleton, and all the other assorted, integrity-free panhandlers and parasites who have soiled the reputation of this country and sold us down the Swanee for their own, ignorant, self-serving enrichment. Forget about Eamon Ryan's smart economy. Let's put all our effort into creating the Honest Economy.'

    ycyc waffle business ireland vision-lock integrity bock-the-robber economy

Links for 2010-09-06

Links for 2010-09-02

Links for 2010-09-01

Links for 2010-08-30

Links for 2010-08-27

Links for 2010-08-26

Links for 2010-08-24

Links for 2010-08-23

Links for 2010-08-17

Links for 2010-08-12

Links for 2010-08-11

Links for 2010-08-10

Links for 2010-08-05

Links for 2010-08-02

  • Kaprekar's constant : '6174 .. is notable for the following property: Take any four-digit number, using at least two different digits. (Leading zeros are allowed.); Arrange the digits in ascending and then in descending order to get two four-digit numbers, adding leading zeros if necessary; Subtract the smaller number from the bigger number; Go back to step 2. The process will reach 6174 in at most 7 iterations'

    6174 constants cool maths mathematics numbers kaprekar wow

Links for 2010-07-30

Links for 2010-07-26

Links for 2010-07-23

Links for 2010-07-15

Links for 2010-07-14

Links for 2010-07-05

Links for 2010-07-01

Links for 2010-06-29

Links for 2010-06-23

Links for 2010-06-21

Links for 2010-06-17

Links for 2010-06-14

Links for 2010-06-11

Links for 2010-06-10

Links for 2010-06-03

E-mail Address Validating Regular Expressions - a Warning

This page has been floating around in links over the past couple of weeks, as a collection of test cases to compare e-mail address validating regular expressions. However, watch out: it's wrong.

RFC822/2822 defines an email address with a bare IP address domain part as using:

  domain-literal  =       [CFWS] "[" *([FWS] dcontent) [FWS] "]" [CFWS]

In other words, this test case is not valid at all:

  IPInsteadOfDomain@127.0.0.1

Instead, it should be:

  IPInsteadOfDomain@[127.0.0.1]

ditto for the other addrs using IP addresses in the domain part. They're rare, but the non-bracketed form is definitely not legal and should not be considered so in the test cases.

I sent a mail to the author a few days ago without response, hence this post.

code email mail regexps regular-expressions validation

Links for 2010-05-31

Links for 2010-05-28

Links for 2010-05-13

Links for 2010-05-11

  • The Totalitarian Buddhist Who Beat Sim City « Viceland Games : interview with the guy behind the "Magnasanti" video. [Godfrey Reggio's Koyaanisqatsi] 'presented the world in a way I never really looked at before and that captivated me. Moments like these compel me to physically express progressions in my thought, I have just happened to do that through the form of creating these cities in SimCity 3000. I could probably have done something similar - depicting the awesome regimentation and brutality of our society - with a series of paintings on a canvas, or through hideous architectural models. But it wouldn't be the same as doing it in the game, for the reason that I wanted to magnify the unbelievably sick ambitions of egotistical political dictators, ruling elites and downright insane architects, urban planners and social engineers.' WHOA

    whoa mental architecture culture gaming society video simcity urban vice

Links for 2010-05-10

Links for 2010-05-07

Links for 2010-05-06

Links for 2010-05-05

Travel Insurance that works, even with ash clouds about?

Lazyweb request. In a few weeks I'll be taking a flight, along with the wife and kids, for some holidays.

The trip was booked before the whole ash-cloud thing and I used Ace Travel Insurance, a typical low-cost travel insurance agency, winding up with an 'ACE Travel Single Trip Travel HealthCover+ Insurance Policy'.

Looking at the policy doc now, it expressly excludes cover for 'a Public Conveyance being cancelled or curtailed because of adverse weather, industrial action, or mechanical breakdown or derangement' if 'an aircraft, sea vessel or train is withdrawn from service on the orders of the recognised regulatory authority in any country' -- which is exactly what's been happening in Ireland in the face of the Eyjafjallajoekull ash cloud.

That's pretty useless, isn't it? I'm considering booking another additional policy to cover the 'ash case'. Anyone got any tips on single-trip policies that don't use a similar exclusion?

ash ash-cloud consumer flying insurance law travel

Links for 2010-05-02

Links for 2010-04-30

Links for 2010-04-29

Links for 2010-04-27

  • "Child pornography is great", according to one EU music-business lobbyist : it's the perfect 'gateway' to allow anti-filesharing filtering of the internet. 'Start with child porn, which everybody agrees is revolting, and find some politicians who want to appear like they are doing something. Never mind that the blocking as such is ridiculously easy to circumvent in less than 10 seconds. The purpose at this stage is only to get the politicians and the general public to accept the principle that censorship in the form of "filters" is okay. Once that principle has been established, it is easy to extend it to other areas, such as illegal file sharing. And once censorship of the Internet has been accepted in principle, they can start looking at ways to make it more technically difficult to circumvent.' Via TJ McIntyre

    via:tjmcintyre ifpi filesharing child-porn filtering internet johan-schluter anti-piracy-group sweden denmark eu

Links for 2010-04-26

Links for 2010-04-22

Links for 2010-04-21

Links for 2010-04-20

what Colmcille really said

Mr. Justice Peter Charleton, in the course of his judgement on EMI Records & Ors -v- Eircom Ltd is quoted as having said the following:

' There is fundamental right to copyright in Irish Law. This has existed as part of Irish legal tradition since the time of Saint Colmcille. He is often quoted for his aphorism: le gach bó a buinín agus le gach leabhar a chóip (to each cow its calf and to every book its copy).'

As many have already noted, Colmcille didn't say that at all; his opponent did. If anything, Colmcille invented copyleft.

Manus O'Donnell's account:

Do inneis Finden a sceila art us don righ, ass ed adubhairt ris: "Do scrib C.C. mo leabhur gan fhis damh fen,"ar se, "aderim corub lim fen mac mo leabhur."

"Aderim-se," ar C.C., "nach mesde lebhur Findein ar scrib me ass, nach coir na neiche diadha do bi sa lebhur ud do muchadh no a bacudh dim fein no do duine eli a scribhadh no a leghadh no a siludh fan a cinedachaib; fos aderim ma do bi tarba dam-sa ina scribhadh, corb ail lium a chur a tarba do no poiplechaibh, gan dighbail Fhindein no a lebhair do techt ass, cor cedaigthe dam a scribudh."

Is ansin ruc Diarmaid an breth oirrdearc .i. "le gach boin a boinin" .i. laugh "le gach lebhur a leabrán."

Or, translated to English by A. O' Kelleher and G. Schoepperle:

Finnen first told [High King Diarmaid] his story and he said "Colmcille hath copied my book without my knowing," saith he "and I contend that the son of the book belongs to me."

"I contend," saith Colmcille, "that the book of Finnen is none the worse for my copying it, and it is not right that the divine words in that book should perish, or that I or any other should be hindered from writing them or reading them or spreading them among the tribes. And further I declare that it was right for me to copy it, seeing there was profit to me from doing in this wise, and seeing it was my desire to give the profit thereof to all peoples, with no harm therefore to Finnen or his book."

Then it was that Diarmaid gave the famous judgement: "To every cow her young cow, that is, her calf, and to every book its transcript. And therefore to Finnen belongeth the book thou hast written, O Colmcille."

Soon thereafter, of course, 3000 died in the Battle of the Book at Cooldrumman, bringing a rather literal meaning to the modern term "copyfight". 'Colmcille and the Battle of the Book: Technology, Law and Access to Knowledge in 6th Century Ireland' is recommended for more background.

colmcille copyfight copyright eircom emi ireland law legal

Links for 2010-04-16

Links for 2010-04-14

Links for 2010-04-05

Links for 2010-03-31

Links for 2010-03-30

Links for 2010-03-26

Guinness vs independent breweries

Guinness' latest product, Guinness Black Lager, gets a panning in the Irish Times today.

I'm not a fan of Guinness. It's a good beer, but monotonous when it's the only thing available. This, from the old Dublin Brewing Company website, makes some interesting allegations as to why that may be the case:

In 1996 the Dublin Brewing Company was set up in Smithfield, in the old James Crean soap factory. As the only other brewery in Dublin to Guiness, Dublin Brewing Company represented a small but real challenge to the Guinness monopoly. Initially [Guinness'] reaction was "it won't work because, Irish people were brand loyal" and wouldn't change to anything new." However by November 1997 Guinness could see an increasing threat from a number of new microbreweries which were opening up around Ireland; it built its own microbrewery called St. James's Gate Beers. In the words of their Weekly News No: 44 "the four unique and distinctive draught beers are designed to meet perceived demand amongst ale and lager drinkers over the age of 28 for a wider choice of tastier draught beers."

The project team had spent 18 months conducting exhaustive R & D into the Irish drinking palette before the launch. This research included taking samples of Beckett's and D'Arcy's from public houses in Temple Bar and returning it to their citadel of brewing science for further analysis. Just exactly how do those "Fun Lovin Brewers" in Smithfield make beer? The code word for this return to basic brewing was affectionately known among company staff as "Operation Wolf".

The Dublin Brewing Company, amongst other small breweries was going to be lambs for slaughter. Of course, when you have a virtual monopoly on tap space in most bars, it's no problem launching no less than four beers in twenty pubs in Dublin overnight. Luckily drinkers in this country know what they want, and if they want a real beer they support the increasing number of microbreweries in Ireland, not a monopoly brewer masquerading as a small producer. The attempt at what was called "full taste" beers turned out to be a disaster. By October 1998 the operation was quietly closed down. However, now that St. James Gate is no more (£3-5m expenditure), we have its latest treat, Breo, being launched with the usual bravado Guinness display on these occasions - 10/15 kegs of beer free for every publican that takes it in. The pub gets the higher number of kegs if they take something else out. As the only other brewery in town, the Dublin Brewing Company is back on the firing line. The Dublin Brewing Company would like to dedicate D'Arcy's Dublin Stout to the memory of those old Dublin breweries.

Sadly, whether due to Guinness' tactics or not, the DBC appears to be no more. There are a few microbreweries around Ireland, but generally, the pub taps in this country are dominated by low-quality lagers, and Guinness. At least Paulaner is becoming widely available on tap, imported by Heineken...

beer booze competition dublin-brewing-company guinness

Links for 2010-03-25

Links for 2010-03-18

spamass-milter != SpamAssassin

Just heading this one off before it gets too much further...

A couple of weeks ago, a researcher found a bug in the spamass-milter project, an open-source milter to integrate SpamAssassin filtering into an MTA. Here's the exploit details.

This H-Online story covered it:

Security vulnerability in SpamAssassin filter module

The SpamAssassin Milter plug-in which plugs in to Milter and calls SpamAssassin, contains a security vulnerability which can be exploited by attackers using a crafted email to inject and execute code on a mail server. The SpamAssassin Milter plug-in is frequently used to run SpamAssassin on Postfix servers.

(I think this is the source article on Heise.de.)

That was more-or-less accurate -- but the problem is the "chinese whispers" effect, where a news story on another site builds on misreadings of another news article. eSecurityPlanet:

Security Flaw Found in SpamAssassin Plug-in

The SpamAssassin Milter plug-in has been found to contain a security vulnerability. [...]

sigh.

To clarify: spamass-milter is not a part of SpamAssassin. it's a third-party product which allows sendmail/postfix users to integrate spamassassin into their message flows as a milter.

spamassassin security spamass-milter milter news heise bugs

Links for 2010-03-16

Links for 2010-03-08

Links for 2010-03-01

Links for 2010-02-24

  • Phishing in Irish : someone has gone to the trouble of translating the 'Hang Seng Bank' phish to Gaeilge. I would surmise that some phisher has a table of CCTLD-to-language mappings and is pasting their text into Google Translate before spamming their .ie address list. If only they knew how few people can read it!

    irish gaeilge funny languages translation

Links for 2010-02-19

Links for 2010-02-12

Links for 2010-02-05

Links for 2010-02-03

Links for 2010-02-02

Links for 2010-01-28

Links for 2010-01-26

Links for 2010-01-21

Links for 2010-01-20

Links for 2010-01-14

Links for 2010-01-12

Links for 2010-01-11

Links for 2010-01-06

  • Una "UnaRocks" Mullally on the state of Irish blogs : 'I think that 'first wave' of Irish blogging was over a long time ago, probably around the time Blogorrah hit the dirt, but in spite of time and an increase of participants and bigger audience there seems to be no real drive to improve content. People will always read something good – online or offline – and until that something good (hopefully in plural) starts to emerge and while good bloggers log off indefinitely, Irish blogging, for what it's worth, is in a state of disarray.'

    irish irishblogs ireland writing blogosphere blogging unarocks

SAY2K10 Doh

Happy new year! Or maybe not. Doh.

Over a year ago, Lee Maguire noticed that a contributed SpamAssassin rule, FH_DATE_PAST_20XX, was naively written -- simply to match any date in the year 2010 or later -- and would start to false-positive on all mail in 14 months. We made the trivial fix to avoid this (for at least 10 years, by which point the rule would have obsoleted itself through normal means), and I committed it to SVN.

Problem solved, right? Nope. I'd committed to trunk, but in a moment of inattention had forgotten to backport the fix to the stable release branch, 3.2.x, as well. Nobody else noticed the mistake, and several months later, boom:

Bugger.

Annoyingly, the GA had assigned this rule 3.5 points in the 3.2.0 rescoring run. This meant that the effective default threshold had been lowered from 5.0 points to 1.5, which produced a 2% false positive rate during the first 13 hours of the new year.

After that point, the fix was pushed to the sa-update channel, and anyone who runs sa-update regularly (as they should!) was brought back to normal filtering behaviour.

The rule is superfluous anyway, since it overlaps with a better-written "eval" rule, DATE_IN_FUTURE_96_XX. Accordingly, most likely scenario is that it'll be removed.

Personally, I see a few lessons from this:

  • Obviously, I need to pay more attention. This is easier said than done though, since SpamAssassin has nothing to do with my day job anymore; it's a spare-time thing nowadays, and that's a rare resource, unfortunately. :( But still, a chastening result, and I'm very sorry for my part in this screwup.

  • We need more active committers on Apache SpamAssassin. If we'd had more eyes, the fact that I'd forgotten to backport the fix might have been spotted. we're definitely in a better situation now in this regard than we were 6 months ago, so that's good.

  • IMO, this is a good demonstration of how too many simple rules are risky; without careful vetting and moderation, it's easy for a bad one to slip past. Perhaps we need to move more towards a DNSBL/network-rule driven approach, although this has its downsides too. Still thinking about this.

  • It'd be good to fix the GA so that it wouldn't assign such high points to simple rules like this, without some indication that a human has vetted them and believes them trustworthy.

Daryl posted a good comment on /.:

Clearly we dropped the ball on this one. As far as I know it's our first big rule screw up in the project's 10 years. If you're going to screw up you might as well do it well.

+1 to that!

And to everyone who had to clean up the fallout and spend a holiday recovering lost mails from spam folders... sorry :(

spamassassin anti-spam bugs