A Window of Opportunity

This editorial piece was published in today’s Vanuatu Daily Post newspaper.

Members of the Vanuatu Mobile Force deliver ballot boxes from Vanuatu’s outer islands to the electoral office. Credit: Matt Temar

On Friday last week, RVS Tukoro arrived in Port Vila harbor and delivered its cargo of ballot boxes from the outer islands at Port Vila’s electoral office. Numerous (and sometimes contradictory) anecdotal voting results have already reached the public, but it’s clear that the official numbers could be released before the week is out. Assuming, that is, that there aren’t any signs of systematic malfeasance.

Be that as it may, one thing seems perfectly clear: None of the old guard political parties has a distinct advantage over the others. Neither have the insurgent parties managed to establish more than a foothold.

Speculation is rife about what this means for Vanuatu’s political future. Some have worried publicly about another hodge-podge government, ruled by maverick MPs jumping from side to side of the government fence, chasing the sweetest deals.

It doesn’t have to be this way.

It’s a lot to ask, but let’s ignore for the moment the personalities involved and just look at the numbers. Assuming the unofficial results are at least ballpark-accurate, the combination of numbers from the first post-independence parties gets very close to the notional 26 needed to form a working government. If the VP, NUP and UMP parties were able, even for a while, to suspend their mistrust of one another and limit their individual ambitions, they could put themselves in a position where they could cobble together a working government.

(Note that I’m excluding Sato Kilman’s PPP from this equation for the moment, first because spokesman John Shing has been publicly stating that Sato’s intention is to reform his old cabinet, and because it’s inconceivable that, having betrayed him so recently, Kilman could reconcile with Natapei without significant loss of status. I know I said we should try to forget the personalities involved, but this one’s just too big to ignore.)

Doling out roles and responsibilities wouldn’t be an easy task. Serge Vohor’s now-famous portrayal of the Council of Ministers as one big PM and a dozen small PMs likely remains accurate. But the alternative – a crazy quilt of individuals and smaller parties – is much, much worse.

There are a few good reasons why the major parties might actually be able to achieve an understanding. The biggest is that the ‘cowboys’ are mostly gone. Both VP and UMP have seen their most rebellious members leave their respective parties, leaving a smaller but potentially more cohesive group behind. Secondly, their diminished numbers are a clear statement that they need to look to the future if they’re going to survive.

Achieving a working compromise would involve some pretty high-stakes horse-trading, and it’s likely that some involved would find it hard to resist the urge to derive maximum profit from such negotiations. But if somehow Natapei, Vohor and Lini were able to forge an understanding, they could create the one thing Vanuatu needs more than anything else: A buyer’s market for positions on the government side.

During the political spasms that led to Edward Natapei’s ouster as Prime Minister and the eventual elevation of Sato Kilman, one frustrated minister was reported to have complained that the price of a single MP’s support in a confidence vote had reached unprecedented heights (5 million vatu, according to the report). But with a cohesive core of MPs, and the ability to play the smaller blocks and individual MPs against each other, a NUP/UMP/VP government would be better positioned to resist such extortionist tactics.

The question then, becomes one of whether the leaders can hold their own parties together, whether they can moderate their own desire for primacy and, uncharacteristically, whether they can play a longer game in order to buy time to engage properly in party-building.

It’s a tragic/comic circumstance that we find ourselves working so hard just to conceive of a government capable of lasting more than a few months. This necessary fixation with numbers completely ignores questions that are fundamental to good governance: How capable are the ministerial candidates? What policies (if any) do they propose? What common policy ground can be found among such a motley collection of perspectives and personalities?

But we can’t afford to let cynicism rule our thoughts. Not now. An increasing number of Ni Vanuatu have expressed the fear that we are rapidly approaching a divide. Either we descend, perhaps irreversibly, into a chaotic system in which each MP looks no further than his own stable of supporters and funders, or we begin the painful, patient process of party-building, of charting a course towards a more national vision.

USP professor Howard Van Trease has written extensively about Vanuatu’s political history. In one paper, he detailed the Vanua’aku Pati’s significant grassroots network in the early days of the Republic. Though they are but a remnant of what they once were, they do still possess a more or less national structure (albeit heavily weighted toward the South). They’ve also made it party policy that party President Natapei will step down after this term.

NUP still needs to develop a succession plan. One option available to them is to consider a reunion with VP. NUP president Ham Lini was reportedly a reluctant candidate this time around, and a return to his family’s political roots might be one way not only to smooth his transition to elder statesman status; it would go a long way to providing him with an enduring legacy as a force for unity and stability in Vanuatu.

Serge Vohor’s UMP have historically been on the other side of the political fence, but on examination, there’s not much in their party policies to distinguish them from the other two. And in fairness, they have proved themselves useful (if somewhat mercurial) coalition partners in the past.

Couple these factors with the rise of newer, more vision-based parties such as populist Ralph Regenvanu’s Graon mo Jastis pati – who have already publicly stated their willingness to work with VP – and we find ourselves with the broad-strokes picture of a government that could actually present a common vision for development for Vanuatu.

Realistically, there’s only a small chance that all this will come about, and perhaps even less that individual ‘small PMs’ will be able to restrain their short-term impulses, but simply put, it’s the best chance we’ve got.

Pinch Me…

Steve Wildstrom over at tech.pinions argues that the furore over the Apple v Samsung case has been driven in part by reductivist and simply incorrect reporting. He singles out the Washington Post, which published an article asserting that one of the patents at stake was Apple’s so-called Pinch to Zoom behaviour:

There’s one serious problem with the first sentence, which was repeated dozens of times in stories in print and on the Web. Apple only has a limited patent (US 7,812,826) on the pinch to shrink, stretch to zoom gesture that is a core element of touch interfaces. And the ’826 patent wasn’t in dispute in the Samsung case because Apple never asserted it.

That’s true enough. I too have grown a little tired of people pointing to 19th Century school slates as prior art. The whole ‘rectangle with rounded corners’ thing is a gross oversimplification of a much more subtle and complex claim. Apple isn’t contending that nobody else gets to make phones and tablets with rounded corners; they’re saying that the overall shape and dimensions of the devices in question is one of many factors that distinguishes their products from others – or should, anyway.

You can’t take a single claim from a patent filing and argue that its lack of originality negates the entire patent. That’s not how these things work. Quite the opposite, in fact. You have to take all of the claims together, and then decide whether they look like a unique creation. Patent claims use painfully obtuse language – often deliberately so. They attempt to perform the almost impossible task of using words to so clearly describing a physical object (or process, but more on that in a bit) that there’s no ambiguity when the questions of copying or originality come up in court.

The kind of patent that Apple’s been most intransigent about are what are called ‘trade dress’ patents. These describe the distinctive features of the device that Apple considers uniquely theirs; they’re used to protect the company from knock-offs and copycats. And copycatting is what Samsung is being accused of.

But when comparing a Samsung device to, say, an iPhone, they’re not just looking at the rectangular shape with rounded corners. They’re looking at that, plus the dimensions, the black front, the ratio of the screen to the border, the placement and colour of the icons on the screen… all of it at once.

Thanks to Steve Jobs, Apple as a company is notoriously painstaking and obsessive about the design and detail of every single thing they make. This hugely intensive creative process is one of the reasons there’s so little variety in Apple’s offerings. They are far more concerned with making one thing perfectly than making a bunch of things well. Apple’s corporate culture is more artisanal in philosophy than any other manufacturer I’ve ever seen. Taste doesn’t just matter; it’s the essence of what they do.

Contrast that with Google. They’re engineers all the way down. The thing that genuinely leaves me breathless when I think about them is their ability to simplify the stupefyingly massive scale of the World Wide Web and filter the entire thing through a single text box. Ask anyone who wrangles data for a living: this really is an astounding accomplishment, and Google are (so far) at the head of their class.

They do have taste, though, and occasionally they’re capable of creating things that are genuinely pleasing. The latest versions of the Android operating system are good examples. But they’re not particularly original. There’s not really anything in that operating system that provides any particular sense of novelty. It’s telling that their biggest effort in recent iterations of the system is something they call ‘Project Butter‘. It’s a system-wide effort to make everything smooth as… well, you know, butter.

If the rumour mill is to be believed – and I think it’s credible in this case – it was precisely this lack of inventiveness that sent Steve Jobs around the bend. He felt robbed because, after showing the world how to make an operating system, Google used it as inspiration for their own. To add insult to injury, Samsung used the OS to bootstrap their own efforts to make tablets and phones that so closely aped Apple’s iconic creations that customers were failing to distinguish between the two offerings. And this is what caused him to launch an all-out war to stop Samsung and to sully Android in the process.

It used to be that companies used their patent portfolios for profit rather than prohibition. IBM is famous for having a small army of lawyers who would appear in tech boardrooms armed with sheaves of patents and make corporate officers an offer they couldn’t refuse: Accept a cross-licensing agreement that allowed the company to continue its work, but also left IBM clear to take advantage of any truly interesting patents the company had in hand. Those companies whose portfolios were lacking in depth were typically required to pay a tithe to continue doing business. It added cost to the products, but it didn’t stop the companies from selling them.

Apple chose to think differently. As they made abundantly clear in their numerous suits brought against against Samsung across the globe, Apple had no interest whatsoever in licensing their ‘trade dress’ patents. They simply wanted Samsung to stop. They were deploying their patents as weapons, not as levers.

The resulting acrimony has so far had decidedly mixed results. The US suit, whose price tag has left most observers goggling, has largely been decided in their favour. In the UK, a judge acerbically observed that whether Samsung had ‘slavishly copied’ Apple was immaterial, because Samsung’s products were easily distinguishable from Apples. They simply weren’t as cool.

If you ask me, he was right. And the reason he was right is what prompted me to write this column.

Wildstrom is right in stating that most tech writers have lost the plot where this story is concerned. But in dithering over the details he too has missed something essential: Patents are designed to give inventors a time-limited monopoly over a particular creation as an incentive for them to share their inner workings. These in turn would inspire others to riff on these inventions, but the law would stop others from claiming the invention as their own.

In the physical world, this works pretty well. When an auto maker invents a new internal combustion engine, other manufacturers can lift the hood and use their understanding of these innovations to drive their own engineering efforts. But they can’t just throw together an identical assembly and call it their own. Take Mazda’s famous ‘wankel’ engine, for example. Patent law doesn’t prohibit me from making a rotary engine of my own; it just stops me from making the same one that Mazda makes.

But this principle doesn’t translate well into the world of software. One of the patents at issue was the behaviour of the user interface when the user scrolls to the end of a long list. Apple made the list ‘bounce’ a bit at the end. It’s a behaviour known as over-scrolling, and it’s a very pleasing, intuitive way, to let someone know they can’t scroll any further. It’s an elegant, more innately human, interaction that lets users know that the system knows what they’re trying to do, rather than simply becoming unresponsive (which is how Microsoft, for example, behaved).

But to assert, as Apple has, that nobody else is allowed to use this behaviour without their permission… well, that’s not what patents were designed for. If we consider how they were originally envisioned, almost the opposite is true. The patent system exists to encourage others to create their own, potentially better way to do it.

There’s a lot of validity to Apple’s desire to discourage copycats. But in their suits against Samsung and others they’ve lost sight of the fact that imitation is an integral part of invention. Edison didn’t invent the first filament lightbulb, he just invented the one with the best materials. Bell riffed on telegraphy and existing voice transmission technology to make voice over the wire possible. Then Marconi came along and effectively developed telegraphs – and later, telephones – without cables. The progression was so clear that for decades radio was known simply as The Wireless.

Yes, Samsung did do point-by-point comparisons between Apple’s interface and their own. But then they went ahead and, taking iOS as their inspiration, created their own. Apple’s objection to this ‘slavish’ copying is arguably an indictment of Samsung’s creativity, but their courtroom tactics are analogous to Alexander Bell taking Marconi to court for using diaphragms in his speakers and microphones.

Samsung’s devices may behave similarly to Apple’s. After all, a smart phone is a smart phone is a smart phone. But just because Apple made the first commercially successful one, or even because others have indulged in the sincerest form of flattery, that doesn’t give Apple any moral right over the idea. If Samsung were trying to pass off their products as iPhones, or if they had stolen trade secrets, source code or materials that were uniquely Apple’s, then the Company That Steve Build might have had a case.

But that’s not the issue here. Samsung’s products are indisputably their own. And yes, yer honour, they’re not nearly as cool.

Little Boxes

[Originally published in the Vanuatu Daily Post]

Every morning I walk the 150 metres from my house to Freswota road beside the cemetery and wait for a bus. I always avoid looking at the nearest corner. For the first few weeks, I didn’t understand why that part of the graveyard unsettled and distressed me so. Then I realised what it was: The plots were half the size of normal ones. This is where they bury the children.

I’m going back there today to stand by two close friends as they lay a little box into the ground.

The parents are part of a young and promising generation of professionals. They each lifted themselves up by their bootstraps, worked hard and, little by little, rose from menial positions to shoulder real responsibilities. They met one another, built a solid foundation of love, respect and stability, and then began their family.

The baby died in childbirth. Her death was entirely preventable. Her life could have been saved a dozen times over in the days before the crisis.

There are excuses enough for everybody, if we want them. For the undertrained and overburdened staff of the maternity ward, who handle literally dozens of deliveries every day, and who do so in an overcrowded, dilapidated building using a hodge-podge of outdated and insufficient equipment. For the doctors who, despite their deep commitment, are left with no choice but to ignore the cries of some in order to sleep enough that they’re not useless to everyone else.

But I don’t care about excuses right now. I don’t care what the reasons are. I want to carry that little box with its heart-crushing cargo into Parliament and lay it on the floor. I want to tell the politicians: These are your numbers. This is your no-confidence vote. This is the product of your waffling, your picayune intrigues and faithless manoeuvrings.

I want to carry it into the offices of the civil service and tell them: This is the price of your complacence, your early knock-off and late arrival, your angling for the car and the subsidised house, your commitment to doing the minimum or less, your willingness to be seduced by the intrigues and venality of those in power.

I want to show it to the donors, and say: This –right here– is your bloody Millennium Development Goal. This is what you get for slipping into to that back-of-the-mind conviction that being wealthier and better educated makes you somehow superior, more valuable than those you claim to serve. You so-called experts who can’t string two full sentences of Bislama together, who have never spent even half a day in the muddy lanes of Ohlen or Manples Mango.

You wealthy expatriates who have the money to extricate yourselves entirely from the health and education systems, content to make it someone else’s problem.

You so-called investors, who would rather pay for a boatload of indentured workers than support the local people. Who call Ni Vanuatu ‘lazy’ because they won’t work 6 or 7 days a week for a pittance. Who cheat on wages and VNPF and VAT contributions, who take every shortcut available up to and including bags of money for the Minister, then cry in your beer about the weakness of the State.

And all you high-minded activists hell-bent on saving the nation from the chimera of the WTO because it’s easier to slay dragons than to take on something as mundane as planning, staffing, training and equipping a health system. Who can’t even conceive of a health system at all. Who bemoan the influx of advisors and donor money but who can’t begin to express how to actually, practically, fix things.

All you wittering elite who somehow think that passing inane platitudes and slogans back and forth on Facebook is how we fight for justice.

You holy rollers preaching intolerance, trying to remain impervious to change, casting aside your own children rather than accepting that the world is not what it was, that it was never what you claim it was.

You voters who think of your MP as nothing but a candy jar, a well to dip into whenever you need school fees, wedding or funeral expenses. Who will bicker and squabble endlessly over the MP allocation but never once ask him, ‘What have you done for your country?’

You people who can’t see beyond your own yard, who in your petty jealousy would rather drag down a successful neighbour than cooperate for the common good. Who would rather spite yourselves than allow another to profit. Your family alone won’t repair the road. Your family won’t build the new hospital wing.

And yes, you well-intentioned few who really try to care, who live life with your head up and your eyes forward, who try to get things done in a culture fraught with complacence and disaffection. Even you.

Even you. Because every time the future is torn away, banished to a little box, we have to know we’ve failed. We have to see how we’ve failed. We have to see it.

The couple at the centre of this tragedy represents the very best of Vanuatu: Young, intelligent, ambitious; mindful of tradition while they help define the nation’s future. They weren’t short-changed or tricked or cheated. They got the best treatment the country had to offer, vastly better than what they might have received in Lenakel or Lolowei or Sola.

But it wasn’t enough. Vanuatu gave the best it had to this couple, and it failed them. It wasn’t enough.

I don’t have any answers, because there are no simple solutions. There’s no lynchpin to unlock this mess of distractions and details and make everything right. All I know is that none of us have done enough. We need to see past the policies and principles and simply act.

Maybe all we can do is find one thing and fix it and move on to the next. I don’t know. But I do know this: We need to stop obstructing others with our jealousies and petty, small-town politics. We need to stop obsessing over who is Right and who is Wrong and get to bloody work.

I don’t care who you think you are or what role you play; you have to do more.

The cuckoo’s egg

[Originally published with a slightly longer title in the Vanuatu Daily Post]

It’s fairly natural in business to want a return on one’s investment. That’s pretty much the point of capitalism, after all. But investment implies risk, too; if you put your money into play, you are accepting at least a small likelihood that it will be lost. Normally, the riskier the venture, the higher the expected return if things go right.

In some endeavours, however, the risk is unavoidable and the reward is slow in coming – if it comes at all. Telecommunications infrastructure is one such area. Especially here in the Pacific, capitalisation can require investment levels that –rightly– make the average investor blanch. It’s no accident, therefore, that private sector players often seek institutional backing before embarking on large-scale projects.

The plain fact is that in this global marketplace, some sort of inducement is needed in order to make investment in the comparatively tiny Pacific market attractive. Pretend for a moment you’re an investor. Given the choice between backing a fibre-optic cable landing in Port Vila or one that lands in Jakarta, which would you choose? All other things being equal, you’d be a fool to choose the former.

Competitors have cried foul in the past when concessionary financing was used to induce increased private sector participation in various Pacific telecoms markets, but experience shows that healthy competition has raised revenue levels across the board. Competition, even with its attendant risks, is better for all concerned.

The challenge, then, is how to make the capitalisation phase, with its necessary reduction in risk, lead seamlessly into a competition phase, with a level of risk characteristic of a healthy marketplace?

Continue reading →

A Learning Moment?

[This editorial appeared in today’s Vanuatu Daily Post newspaper.]

The arrest of Vanuatu PM Sato Kilman’s personal secretary at Sydney airport and the subsequent expulsion of all AFP staff from Vanuatu should offer players on both sides of the diplomatic fence the opportunity to reflect and, with luck, learn a little from each other. But that’s probably going to take a while.

Tempers in Vanuatu remain quite heated, and it appears that Australia has yet to figure out how to climb down from the limb it’s on. Indeed, some suggest that Australia has yet to realise it’s on a limb at all.

Obviously, no one involved thought that the diversion of PM Kilman’s party into Australian territory in order to arrest Clarence Marae would have significant repercussions. They wouldn’t have done it if they had. But judging from Foreign Affairs Minister Bob Carr’s statements so far, his government has yet to realise just how important deference and respect are in Melanesia.

It’s tempting to conflate the PM’s employment of a convicted criminal with this remarkable breach of diplomatic protocol. Some online commenters were quick to say that if the PM kept better company he wouldn’t have found himself in this situation in the first place. That may provide a handy little sound bite, but it does nothing to add to our understanding of the issue.

Clarence Marae’s alleged involvement in criminal tax evasion is a legal matter. The public shaming of a head of government is entirely political. Not to put too fine a point on it, one would hope that those in charge of international relations would be able to draw a distinction between the two.

Australia protests constantly that it treats its Pacific neighbours as peers, but its actions don’t seem to bear this out. It has misread events and conditions on the ground in Fiji, PNG and now Vanuatu, and in each case made itself look a great deal clumsier than it should be.

Nearly all of these mistakes can be explained by an implicit assumption that its role as benefactor somehow makes it smarter or better than its island peers. Neither of these is always true, but more importantly, neither of these matters. Equality and respect don’t stem from equal capability or even equal intelligence or skill. In sports, I don’t respect only those teammates who are stronger or better than me.

The same should be true in diplomacy. Would Australian police have used the same tactics to arrest a member of an American, Chinese or Russian delegation, or for that matter, even a Burmese or Albanian diplomatic group? So what, then, could inspire Foreign Affairs to remain silent while just such a plan was hatched for the Vanuatu delegation? It’s unfortunate to have to say this, but it’s hard to imagine any other reason than a misplaced and parochial sense of superiority.

Worse still, Bob Carr’s first reaction was effectively to say, ‘Nice aid programme you have there. Be a shame if something were to happen to it.’ This statement can only lead us to wonder whether AUSAid’s constant protestations that its programme is non-political are entirely true. There should be more to this relationship than aid.

There was a time when this kind of chastisement might have worked, but it’s behind us now. There are any number of countries who would quite happily step into any gap left by a withdrawal of Australian project and budget support. In strategic terms, Australia has as much to lose as Vanuatu if their relationship breaks down.

Still, Bob Carr did leave himself an opening. He admitted that he had not been briefed on the tactics used by the AFP to draw Clarence Marae into Australian jurisdiction. In an interview, he seemed to spontaneously suggest that a distinction could be made between the legality of Marae’s arrest and the treatment of the Prime Minister. He should pursue this further; it might just be the way out.

Kilman has made no effort whatsoever to defend Marae. So if Australia can find its way to see past the arrest, it can perhaps find a way to reconcile with Vanuatu by expressing regret over the PM’s treatment.

Nobody on the Vanuatu side is in a hurry to mend fences. We’re only months away from a general election, and while people here are not at all comfortable with seeing their head of government associating with convicted criminals, there is still a significant portion of society whose sense of national pride has been pricked by these events. Respect and deference are not abstract notions in Melanesia. It may be hard to grasp this if all you know is the law, but Melanesian kastom is predicated on peace first, justice second. In a nutshell, living on an island sometimes requires that we tolerate behaviour that we consider beyond the pale. Surrounded as we are by ocean, we don’t have a pale to go beyond.

It all comes down to this: Australia should take this opportunity to learn a little humility and respect and to try its hand at peace-making, Melanesian-style. If it does find a way to re-engage, it’s just possible that its law enforcement personnel might get the chance to help us – not punish, help – to be a little wiser in choosing the company we keep.

Dr Strangepost, or How I Learned to Accept the Facebook API and Love Social Media

I’ve been spending a good part of the last week or so building social media tools for my employer. We’ve come to the conclusion that services like Facebook provide some of the most immediate and detailed sources of information on important events in the Pacific. I’ll go into this in more detail in an upcoming discussion paper, but for the moment, suffice it to say that Facebook’s ubiquity and its accessibility via mobile devices makes it one of the most compelling means of transmitting information quickly and easily to large numbers of people.

We track a number of public groups, and they’ve provided us with invaluable information. Probably the most vivid example of this is PNG’s Sharp Talk group, which has more closely tracked a number of events in PNG politics than even the most resourceful of the traditional media.

Our work is predicated on the idea that dialogue leads to better understanding. So, naturally, we want to understand how people think and feel about events in the world around them. We also want to be able to record these voices for posterity, and to use the most compelling amongst them to educate others.

So with that in mind, I set out to use Facebook’s programming interfaces to allow staff to flag posts and comments, and to track and store important threads in a local database. This way, we could have a record of commentary as it happened, and we’d be able to perform key word searches, statistical analysis and a few other kinds of research that would (we hope) lead to a better understanding of current issues and how they were perceived.

I struggled. I struggled a lot. It’s kind of an unfamiliar feeling, after 20 or so years in the data-mangling game. There were a number of all-too-familiar issues: Documented approaches that were no longer supported, new approaches that required undocumented steps. These are, for better or for worse, the stock in trade of a lot of web services. Things move quickly, so stability is more of an aspirational goal than anything else.

But there were a few things that, taken together, brought me to a complete stop.

First, it’s nearly impossible to obtain access to the site without an interactive login. I get why Facebook do this – they want to make it hard for spyware and other malicious programs to fake the approval process. And that’s okay, as far as it goes, but it assumes that apps using their programming interfaces are interactive – that is, that someone is sitting in front of the thing, driving it. But that’s precisely the opposite of what I’m trying to do. I want our staff to be able to flag something as interesting and NOT have to sit around reading the bloody page all day long.

Second, the thing just doesn’t work half the time. About 50% of the queries I post to Facebook’s graph service either time out or return an empty data set. Still, with a bit of persistence, I suppose I could manage. Just program the software to retry the query until it gets useful results. This has a few nasty implications – for example: how will I know when I’m supposed to get an empty result set? But I’ve dealt with worse in my time.

The third problem is much bigger. Facebook’s results work the same way Facebook own interface works. In other words, rather than getting the complete set of comments on a given post, they give you the most recent few, and a ‘next’ link to get a few more. Again, they’re assuming that you’re using the data interactively.

I spent a while pondering how to make my proposed service work, puzzling out scenarios and trying to find computer logic that would cope with the shortcomings. And then I had my eureka moment. Facebook doesn’t want people to write apps like mine.

The more I dug into other people’s coding projects and programming interfaces to Facebook’s service, the more I came to realise that it’s actually possible to reliably push things onto Facebook, but it’s quite hard to get them back out. Posting photos, links, likes and comments is pretty straightforward, but trying to make sense of them once they’re on the site is another task entirely. If Facebook were to make it easy to perform automated analysis on their content, they’d be undermining the stickiness of their own service. By allowing it to become commoditised, they’d face losing their identity. In short, they’d become a platform, not a brand.

For Facebook, the idea of someone seeing Facebook data wrapped in someone else’s interface is worst thing in the world.

This made me very sad.

Easily interchangeable data is the very essence of wealth in the knowledge economy. It’s taken me a while to realise it, but some people don’t understand that sharing that wealth creates more for everyone. As far as information is concerned, apparently, most of us have yet to see the merits of free trade. We’re still back in a world of monopolies, hoarding and guilds.

But that’s okay. This will change. The Internet is a porous medium. Generally speaking, information will leak out, and the commodification of social data will eventually happen.

In the mean time, I’ll get to work on building a different set of tools to make sure that, in our little patch of the world at least, the leaking happens sooner than later.

Selling Democracy (Slight Return)

Writing about the influence of the Internet on pro-democracy movements earlier this year, I observed:

As individual control over the flow of information rises, central control wanes. And this, obviously, is the crux of the dilemma facing businesses and governments across North Africa and throughout the world. They are belatedly coming to realise that they are fighting a many-headed hydra. As they cut off one avenue of communication, another rears its head.

But that hydra has a body, and the body is the network itself.

The US Congress’ latest attack on the integrity of the Internet demonstrates that at least some American businesses have heard this message loud and clear.

Their intent now is simply to cordon off what they consider to be the American part of the Internet, and to beat into submission any site that refuses to play by American rules. The rules, needless to say, are expressly designed to impose an economy of hoarding and scarcity on a technological landscape premised on bounty and sharing.

To what end? What do so-called content-producers stand to gain from all of this? Not much, really. Except that they can continue using the same business model that has stood them in such good stead for the last few decades.

Essentially, the SOPA legislative package doesn’t create a Great Firewall of America; it encases the giants of the media industry in amber.

The starkest evidence of the fossilising effect of this legislation was provided by a recent House Judiciary Committee hearing, which consisted of little more than a gaudy carousel of facile pronouncements:

How low was the level of debate? The hearing actually descended to statements like “the First Amendment does not protect stealing goods off trucks” (courtesy of the AFL-CIO’s Paul Almeida).

Criticisms were brushed aside with the blithe assertion that if these rules don’t fit the Internet as it is today, then it’s the Internet that should change, not the rules.

The one detractor allowed a place on the stage was Google, which objected strenuously to to the vague, often blatantly prejudicial language of the Bill.

It was up to Google alone to make the argument that SOPA’s definition of “rogue sites” is poor, that its remedies are extreme, and that plenty of legitimate sites could be targeted. One has only to think of YouTube, which even without SOPA is being sued by Viacom for $1 billion and would certainly have been hammered years ago under SOPA’s crazy language (sites can be dismantled under SOPA if they take “deliberate actions to avoid confirming a high probability of the use of the US-directed site to carry out acts” of infringement. What does that even mean? And how does it fit with existing robust safe harbors for user-uploaded content sites?)

Perhaps the most shocking aspect of this hearing was that Google, the sole opponent to the legislation allowed to present at the hearing, was castigated by most of the people present, impugned for purportedly profiting from piracy and cast as the villain in this whole affair.

Seeing one of the few growing and dynamic drivers of the information economy not only cast out of the fold but actively opposed, one can only conclude that the captains of the US media industry are perfectly content to cut their nose off to spite their face. They will burn the bridge represented by Google rather than cross it.

I see two immediate dangers if this regime is actually allowed to take the shape proposed for it:

Innovation in content re-use and sharing will move outside of the US. Some will move into the shadows (kind of like offshore pirate radio in days of yore, except the ships and radios are available for the cost of a laptop). Some will move into the less governed – or governable – areas.
US influence on innovation and invention will decline significantly. This legislative package will serve as a clear signal that Silicon Valley is no longer the influence it used to be. (Indeed, the Valley’s lack of standing in DC was evidenced by committee members’ contempt for Google throughout the hearing.)

The latter outcome is the more dangerous of the two. Losing influence in the direction the Internet’s development takes also means losing the uniquely American ethos of freedom and individualism.

There are numerous new media and technological players poised in the wings right now. But few of them (with the possible exception of Al Jazeera) have any moral stake in human rights or even individual expression.

Warnings that SOPA’s passage will mark the death knell of the Internet as we know it are, therefore, not exaggerations.

Like a bug in amber, the US media and content industries may be preserved for a while, but the life that they breathed into world culture – the American ethos of individual freedom – that will diminish and die.

UPDATE:
When I talk about the ‘American ethos of individual freedom’, I’m using ‘American’ to modify ‘ethos’ not ‘individual freedom’. Tons of cultures have extremely strong traditions of freedom and individual rights. Few have that particularly American flavour of it. And it’s that particular flavour which, not coincidentally, fits so well with the Internet today.

Mystery & Wonder

According to Andrew Sullivan, Alexis Madrigal claims that flocking behaviour is “… a beautiful phenomenon to behold. And neither biologists nor anyone else can yet explain how starlings seem to process information and act on it so quickly.”

That second sentence is just false, as even a quick visit to wikipedia is sufficient to discover: Current research shows that this vastly complex behaviour requires no interaction between all points, and no orchestration by some unseen hand.

Flocking behaviour can be simulated in computers by creating groups of simple bots, each of which responds independently to three simple rules:

1) Separation – avoid crowding neighbors (short range repulsion)

2) Alignment – steer towards average heading of neighbors

3) Cohesion – steer towards average position of neighbors (long range attraction)

Some researchers have even gone so far as to create real, flying drones that exhibit this behaviour.

The miracle is not that this grand ballet is so complex, but that it’s so damn simple in its essence.

Look, I marvel just as much as the next person when watching vast flocks of starlings. And there are few things more graceful and poignant than an entire school of sardines arcing over the waves in consecutive leaps as they flee from predators. There is little in life so exhilarating as being engulfed in a pocket of azure space as a school of reef fish flow soundlessly around you.

These are all examples of of simple creatures following simple rules, collectively iterating and permuting in patterns whose complexity the human mind finds attractive, even enthralling. Because it cannot follow the linear progression of individual acts in such a vastly parallel pattern, the brain hits the overload switch, which results in our sense of wonder.

It is, almost literally, mind candy. But that does NOT make it a mystery.

I’m not asking that we put aside our wonder, but can we please accept that many of these so-called mysteries are NOT mysterious. (Well, not any longer, anyway.) I’m as big a fan of exaltation as the next person, but I cringe when we allow it to curb our perceptions and our ability to learn.

Find Duplicate File Names in CouchDB

I was stumped for a bit, trying to figure out how to help my editorial staff avoid uploading the same file twice. In a repository spanning tens of thousands of titles in over a hundred different collections, our staff can’t easily tell whether a document is already in a collection or not.

Turns out that finding duplicate attachments is fairly easy. First create the view:

function(doc) {
  if (doc._attachments){
    for (var i in doc._attachments){
      emit([doc.collection, i], doc._id);
    }
  }
}

Which returns JSON output that looks like this:

[“collection name”, “filename.rtf”]

So all I have to do to find the duplicates is query that view using the composite key and see if it returns any rows:

http://my.couchdb.server:5984/database-name/_design/my-listings/_view/attachment-exists?key=[“collection name”,”filename.rtf”]

I could do the same with MD5 checksums, too, but I won’t. The problem is that even a single character change is enough to make two documents different. So if someone opens their copy of a file and Word changes the metadata in it, it’s no longer byte-for-byte identical, even though the text has not changed. This means that the number of false negatives (i.e. duplicate files that are NOT found) would be too high for people to rely on.

What I’d really like to find is an algorithm that determines whether the textual content of two documents is significantly similar….

THE SCRIPTORVM

Collected essays, columns, etc. by Dan McGarry

Menu