SCROLL – OFF ON A ROLL!

SCROLL. Did I ever mention it? Maybe, maybe not. Assuming not, well that’s probably because we’ve been so busy building it. And now it’s here. But first things first: what is SCROLL?

It’s this:scroll-blog

SCROLL is SDA’s latest data collection, processing and analysis tool. It embodies 20 years’ focus on turning data into decision grade information. Used by some of the largest social and market research organisations – and most recently by Cabinet Office – our system has already delivered thousands of data collections. Indeed, it’s taking off all over the place, including France, Germany and… Iran. Using SCROLL’s multi-lingual capabilities our new associate research consultant has adapted the system to accommodate Farsi and, right now, it’s being put to work on the ground in Tehran and other major Iranian cities. A unique feature of the project is that we’ve modified the system for offline operations to allow for specific elements of the local business environment.

Indeed – STOP PRESS (like, this morning) – we have just been confirmed as the principal supplier of computer assisted mobile interviewing (CAPMI) by RahbarBazaar (www.RahbarBazaar.com), the leading market research agency in the region, and exclusive regional affiliate of Kantar Insight.

The weird thing is that we sort of slid into operational mode. SCROLL has been in development – a sometimes vexed process – for a while. There were several components that worked perfectly as independent modules but their integration was… problematic. So we stepped up the effort, polishing them up, streamlining their throughput and then, almost unexpectedly, they clicked. A good job they did because – how shall I put this – we’d taken a few liberties with our marketing endeavours. I’ll put my hands up; we had to. You pour resource into development but there comes a point when you’ve got to get your product out of the door.

So, lessons learned? We all know the impulse to make something perfect; to improve, to refine, to embellish. To fiddle.

The simple fact is that this is all displacement activity. Version 1.0 is staring you in the face. Get it out. Put it to work.

The world will direct where it goes next.

Twitter: @SCROLLcontrol

Advertisements

What goes around, comes around: Interoperability, Data Exchange and A4L

Open letter to the A4L Systems Interoperability Framework community campaigning for a seat on their UK Management Board:

Dear Colleague,

My name is Mark Phillips from Software for Data Analysis Limited. Among other things we have published the DfE’s School Performance tables since 1993.

 
After a long period of absence, I’m back in the SIF saddle. Unexpectedly I’ve been urged to apply for a position on the UK Management Board. So I’m going to.
 
 
I do have some form in this respect. Rather than rehash what I’ve already said I’ll simply quote it here:
 
I was the first National Chair of the SIFA UK Management Board, presiding from 2006 to 2009. During that time, along with our committed and vibrant Board, I took SIF on the road – introducing the concept and the detail to Central and Local Government, schools and vendors around the country.

It was the first inflationary period as it were, where we moved from zero to max in a short but exciting burst of incredible energy, re-tooling the predominantly US standard to fit the requirements of the UK education system. The rationale, both economic and technical, was forged then and has remained compelling since: improved information available more quickly, more efficiently and more effectively – for less cost.

With that manifesto I got the movement onto the map.

Since those times I have moved from Government to the private sector, developing SDA as a force in Open Data, building on the tenets of interoperability across a wider stage and working alongside the Open Data Institute, TechUK and Government Digital Service to develop systems and processes fit for the 21st Century.

Now I’m delighted to see that my original intentions are on the cusp of realisation with the new movement towards Data Exchange at the DfE.

If I was to be elected to the A4L UK Management Board I would bring the longevity and consistency of my vision, now enhanced and improved by new perspectives and wider experience, to bear on the ultimate realisation of this long journey towards open standards and interoperability in UK education.

The final push, if you like.

 I would, of course, fulfil my obligations to the Board in terms of time, commitment and energy – as was ever the case!”

 If you were to distil my ambition into a single point it would be this; to ensure that we deliver a SIF model that leverages the global Specification wedded to a data model that embodies the principles of an open standard, specifically Due Process, Consensus, Transparency, Balance and, of course, Openness.
 
If you want to know more about me, don’t hesitate to get in touch.
 
All the best,
 
Mark

Diversification!

Onwards and upwards…

Software for Data Analysis Limited have been working closely with the National Casino Forum to design and engineer SENSE, the backbone system that crystalises a new approach to Corporate Social Responsibility in the world of UK Land Based Casino gambling. Liaising closely with representatives of all the major players in the industry, SDA have integrated a huge range of administrative and technical systems to develop and deliver a single, seamless product. Having added some of their technical fairy-dust on the way, SENSE can now be found on the shop floor of every UK Casino, enabling people to self-exclude from gambling if things go wrong. The Gambling Commission have already recognised it as a “significant achievement”.

Here’s the press release:

“UK gambling trade association the National Casino Forum (NCF) aims to raise public awareness for responsible gambling by announcing the launch of SENSE – the Self-Enrolment National Self-Exclusion tool which it will roll out through its land based casino partners

This national programme is being introduced by casinos in advance of the Gambling Commission’s licensing condition which is due to come into force on 6 April 2016.  This condition will require operators to participate in multi-operator self-exclusion schemes so that customers are able to self-exclude from gambling facilities.

The SENSE scheme enables customers to voluntarily self-exclude from all participating land-based casino premises and is mandatory for all NCF member operators. Enrolling in SENSE means that customers will, for the first time, be sharing their request to self-exclude from all participating land-based casinos for a minimum period of six months.

The system is designed to be simple and straightforward to use; a casino operator will read out the terms and conditions of SENSE and then ask the customer to electronically sign the enrolment form. The casino operator will also take a photograph of the customer and upload this along with their enrolment form onto the secure SENSE system.  Customers can also download the SENSE information and self-exclusion form at www.playingsafe.org.uk.

Once a customer has enrolled in SENSE, operators at participating casinos will be alerted and any marketing material for that customer and memberships will be switched off. If a customer tries to access a casino when they are self-excluded, an operator will note this on the system and it will alert surrounding casinos that they are trying to gain access.  Customers will only be eligible to be removed from SENSE after the six month period and only upon request.

The Gambling Commission commented: “We see the development of sector specific self-exclusion schemes as an important step in providing greater protection to players who require help managing their gambling.

“The casino sector was well placed to lead the way in this but implementing SENSE now, well ahead of the deadline we set, is a significant achievement. We recognise that it required the considerable efforts and full commitment of all NCF’s members.”

Tracy Damestani, CEO of the National Casino Forum said: The NCF and its members took the decision to pioneer the first national self-exclusion programme.  Self-exclusion is an important step for people who have recognised that they have a problem with gambling and have made a commitment to deal with it.

We applaud the Gambling Commission’s decision to introduce a new provision which mandates that all gambling operators will need to implement more effective self-exclusion systems. NCF members recognised the need to have an easy to use system in place that can be used nationally across UK casino venues and we have been working on this initiative for the last two years. SENSE was created with the intention of encouraging responsible gambling throughout the industry and to help those people who may be at risk.”

“NCF represents over 98% of the UK’s land-based casinos.  The members’ commitment to implementing the SENSE system has been admirable; they have taken all the steps necessary to ensure their casino staff support customers who wish to self-exclude.  While

SENSE was developed as a casino initiative to be flexible and progressive, we hope to see other gambling sectors also take similar steps for their customer base.”

The SENSE web-based application system was developed with SDA (Software for Data Analysis).

Michael Hart, Managing Director of Software for Data Analysis Limited (SDA) added: “Developing and delivering SENSE has been an exhilarating time for SDA.  Investing our substantial expertise with data processing and systems development into such a cutting-edge and socially responsible project has been both demanding and rewarding.  I’m delighted with the result, and that we’ve been able to contribute to this groundbreaking product.””

Burn Before Reading

I’m sorry I just can’t help myself.

Every time I return to the fray I seem forced to grapple with a fresh example of inefficient, inconsistent or just plain inscrutable public sector blarney. My only catharsis is to write it down, here. Not to do so would create all manner of new, unwanted and probably damaging internal tensions that I would prefer to do without.

Here’s the deal:

“The Redacted is implementing a new multi-buyer e-procurement platform… that will allow us to manage our supplier base more effectively. To continue to receive notification of potential tender opportunities with the Redacted and its executive agencies… click on the link below to register…”

So. Registration. Should be straightforward, right? I’ve got the link and I’ve been “pre-invited” to register, so what can go wrong? I fling myself into the task with optimism and enthusiasm. Things start well: the first page has recorded some basic details and provided a system ID. Only ten more pages to go.

The second page requires some further information, which I don’t have to hand. Off I go to collect it. I’m already thinking “wouldn’t it have been good if I’d been provided with a list of things I’ll need”. Having collected the information I sit back down to key it in.

I’ve been logged out. Never mind, I’ll pick it up from where I left off.

Wrong. The form has forgotten me (already). So I re-key my previous entries and add the new details. On to the next page.

Rinse and repeat.

Too late I notice (by complete accident) that a date I had entered in free text had defaulted to the American format. I only discovered this by subsequently looking at the drop down calendar and finding that my input – 6/11/2015 – had been recorded by the system as 11th June 2015 – which, if it had gone unnoticed would probably have invalidated the registration. No guidance, no warning.

Rinse and repeat.

Suffice to say a really, really simple job took me nigh on two hours to complete. That’s two hours of quite expensive, sort-of-executive time. No doubt multiplied across the supplier roster. And we wonder at our productivity failings.

Finally, I finished. I figured that, as the invitation to apply had been extended by a specific Department, to SDA as one of their specific suppliers, and as the invitation had majored on providing us with information about “…a number of forthcoming tenders from across the Redacted and its executive agencies that we don’t want you to miss out on” I could now look forward to examining what was on offer. Of the 63 opportunities noted JUST ONE was with said organisation; the rest were from all manner of public bodies for whom we have never worked, and for which we were mostly unsuited.

I know the Government mantra: don’t build, buy; COTS is best! But really? At least put in some effort to MAKE IT WORK.

Disappointed by this episode I wrote to the “executive agency” that appeared to have been charged with the development of the system, explaining some of my reservations. (SDA are, after all, expert in form creation.) For the next couple of days I got the following message:

“This is an automatically generated Delivery Status Notification
THIS IS A WARNING MESSAGE ONLY. YOU DO NOT NEED TO RESEND YOUR MESSAGE.
Delivery to the following recipient has been delayed: commercialadmin@redacted.org.uk
Message will be retried for x more day(s)”

Culminating with:

“Delivery to the following recipient failed permanently:
commercialadmin@redacted.org.uk
Technical details of permanent failure:
The recipient server did not accept our requests to connect.”

Doh!

Burn before reading.

THE INFORMATION STANDARDS BOARD

The Department for Education in collaboration with other authorities in the Education, Skills and Children’s Services sector has, since at least 2009, been developing its own set of data-related standards under the management of the Information Standards Board (ISB).

According to its own website (http://data.gov.uk/education-standards/standards-adoption), “The core business of the ISB, supported by the Technical Support Service (TSS), is to successfully embed standards within the Education, Skills and Children’s Services (ESCS) system in England.”

The ISB has two “approved” statuses for its published standards – “Approved: Recommended” and “Approved: “Adopted”.  On the ISB website today, there are 269 “Recommended” standards, and zero “Adopted” standards.

So why, in five years, has the ISB failed in its core aim of issuing standards which are actually being used?

We believe the answer lies in the approach taken by the ISB in producing and publishing these standards.  Let’s take as our benchmark the work of the Internet Engineering Task Force (IETF), which is responsible for producing a large number of widely-deployed technical standards.  To quote from “The IETF Standards Process” (RFC 2026):

The goals of the Internet Standards Process are:

  • technical excellence;
  • prior implementation and testing;
  • clear, concise, and easily understood documentation;
  • openness and fairness; and
  • timeliness

Assuming we agree that these are all good goals to have when producing a standard, let’s assess the performance of the ISB against those goals.

1) Technical excellence

It could be argued that technical excellence should be relatively low on the list of priorities for ISB (its aim is simply to produce usable standards), but there is a minimum standard that the work is “fit for purpose”.  Unfortunately there have been numerous examples of documents published as “Approved” by the ISB which are simply not fit for purpose.

One of the foundations of the ISB data standards is the Business Data Architecture Data Types document.  This was first published on 20th September 2013 as version 4.0 and was so riddled with errors that that version is not even archived on the ISB website!

It contains statements such as the recursive definition of a date being “A string providing date information and hence containing following values – year, month and date”.  Those three components of a date are each defined to consist of a single digit (0 to 9).  Or defining a type called “Simple_Integer” as being “A simple unsigned string of numeric values.”, and another type called “Integer” with the simpler definition of “Signed numeric value”.

It was simply not possible to implement any of the definitions provided in this document without ignoring large parts of it and trying to guess what the document author intended.

When defining controlled lists of values for common concepts such as language, country and currency, the ISB have quite rightly decided to adopt existing ISO standards in those areas.

However, the ISB have fundamentally misunderstood the purposes of the ISO standards, which are titled “Language Codes – ISO 639”, “Country Codes – ISO 3166” and “Currency Codes – ISO 4217”.  i.e. these are standard lists of *codes* for languages, countries and currencies.

In trying to fit in with other controlled lists, the ISB have broken perfectly good existing standards by using the textual descriptions (e.g. Spanish, Spain and Euro) instead of the code defined by the standard.  The problem is when ISO codes remain the same but the textual description changes.

This was raised as an issue with ISB in May 2014 but no visible action has been taken.

Regarding the many other controlled lists and data documents, there is no way to reliably assess their fitness for purpose without attempting to implement them in the real world.  Which brings us to…

2) Prior implementation and testing

The ISB have stated that it is not their role to perform testing – the ISB propose standards and it is reliant on stakeholders to implement them.  However, given that no ISB standards have been through an implementation process and moved to “approved” status, this approach is obviously not working.

The ISB standards are also heavily dependent on each other, adding layer upon layer upon layer.  When mistakes are found in documents that many other documents depend on (such as the BDA Data Types document) or improvements are suggested to those documents, then these suggested improvements are rejected as being impossible to implement due to the many other standards that would be affected by such a change.

If no stakeholders have implemented any of these standards then in addition to not proving the standards are fit for purpose, it also raises the obvious questions around the need for those standards in the first place.

The motivation for a lot of the standards developed as part of the work of the ISB has been the DfE Data Transformation Programme, which is described as consisting of the “Data Exchange” and “School Performance Data Programme” projects, neither of which are  currently being actively pursued.

However, there is still value in the work undertaken by the ISB, especially in the production of controlled lists which can be used regardless of the over-arching data model.  Instead of investing in the production of further standards, the ISB should stop and invest in its own testing and implementation of at least the core standards and their XML representation.

To quote Albert Einstein, “In theory, theory and practice are the same. In practice, they are not.”

3) Clear, concise, and easily understood documentation

The documents published by the ISB are far from being clear, concise and easily understood.

The ISB staff developing the ISB data model need to use the ERwin software to view, develop and maintain the data model behind all the published ISB documents.

However, the “other side” of the process (organisations wishing to develop systems conforming to ISB) do not have any of that functionality, and are just provided with a set of static PDF documents, often containing 90% boilerplate text and 10% actual content.

There is also an XML Schema (xsd) file which partially specifies the XML representation of ISB data.  In order to obtain the full specification of this XML representation, an implementer is required to refer to the PDF documents.  No examples of XML files have been published.

To quote from the W3C, “XML Schemas express shared vocabularies and allow machines to carry out rules made by people. They provide a means for defining the structure, content and semantics of XML documents.”

The XML Schema provided by ISB defines the structure of an ISB XML file, but as a matter of policy declines to use the language of XML Schema to define the content and semantics of such files.

The main example of this is the lack of incorporation of controlled lists into the Schema, but also includes the lack of any documentation on the semantics of the structures being defined.  Instead, a user of the schema is referred to the many PDF documents as being the definitive source of documentation.

Given that XML will be the main method of transferring ISB data between systems, it is vital to ISB’s success that the documentation on the XML format is both accessible and unambiguous.  The XML Schema language should be fully used to aid in this task, not ignored.

It seems clear that the information published by the ISB needs to be stored in a structured way (e.g. in a database), and the content should be accessible via an interactive website.  In addition, the same database of information could be used to automatically generate PDF documents similar to those now created manually, or to create an XML Schema which as the W3C intended, would “allow machines to carry out rules made by people”.

4) Openness and fairness

In 2014, an independent review of ISB was undertaken, which included contributions from stakeholders outside the ISB and its constituent organisations.  However, the findings of this review have not been made public, not even to those who contributed time to the review. This is particularly shocking given this Administration’s emphasis on “transparency”.

5) Timeliness

It is difficult to judge the timeliness of the work of the ISB given that there is no apparent desire to implement any of the published standards.

And Now For Something Completely Different… Scholarly Articles from SDA!

SDA are delighted to announce two new peer-reviewed articles discussing their work to improve access to 1) School Performance data and 2) Free School Meals . Both papers have been spearheaded by Dr Alan Strickley, the former with contributions from SDA colleagues, and are available from Springer.com.

First up is:

A National Single Indicator for Schools in England: Helping Parents Make Informed Decisions

Alan Strickley, John Bertram, Dave Chapman, Michael Hart, Roy Hicks, Derek Kennedy, Mark Phillips.

Abstract

With an ever-increasing measurement of pupil and school performance and presence of resultant statistical tables and indicators, parents are faced with a sometimes overwhelming plethora of data and information when monitoring the performance of their children’s present or prospective school. The authors are part of a company that has, using open data, developed a parent/carer-accessible site to attempt to address issues and needs for parents/carers. Anecdotal evidence indicates that a single portal where parent/carers can find all the relevant data about schools in England would be an invaluable tool for monitoring and choosing a school. It was decided that such a site would be built around a National Single Indicator (NSI). The indicator is formed from an amalgam of expected progress measures: the main threshold level; pupils’ average points score; and the value added measure. By changing the weight attributed to each of these measures, the website allows parents to modify their relative importance according to the value they place on them. This dynamically alters the overall result to give users their own “personal indicator”, which means they can compare schools in a list tailored to their own specification.

The website is available at www.schoolperformancetables.com

The second article is:

Online Free School Meals as a Cloud-Based Solution: Three Case Studies of Its Use in England

Alan Strickley

Abstract

Online Free School Meals (OFSM) was a transformational programme supported by the Department for Education (DfE) in England. The full process is documented by Strickley[1]. Whilst the use of the system can be judged an overwhelming success, most Local Authorities (LAs) have stopped short of the full web-based system in which parents can apply directly via an online form as a result of the perception of negligible cost benefits created by a lack of technical expertise, scarce resources and server and development costs. The paper describes how these issues were overcome by developing a generic cloud-based solution. The paper looks at the general structure of the solution and examines the experiences of three types of user: an academy consortium, a single school and a large LA to illustrate adoption, implementation, usage and benefits. It concludes that a cloud-based system is cost effective by removing much administration and as a result of lowering the stigma of applying can result in an increase in applications. This has resulted in financial advantages for schools and LAs.

More information is available at www.cloudforedu.org.uk/ofsm/

Doublethink!

Reading Orwell’s 1984 was a formative experience for me. It helped determine my adult mistrust of the concept that we’re “all in this together”. The concept of Doublethink leaps out as the means by which this sort of fabrication might prevail.

Doublethink is the act of ordinary people simultaneously accepting two mutually contradictory beliefs as correct. Somewhat related… is cognitive dissonance, where contradictory beliefs cause conflict in one’s mind. Doublethink is notable due to a lack of cognitive dissonance — thus the person is completely unaware of any conflict or contradiction.”

Just recently SDA have been engaged in negotiations with, oh – let’s just say “gov.uk”. Our old contract is being replaced by a “new model contract” through which doublethink runs as if it were a stick of Brighton rock.

Examples of the new doublethink:

“The singular includes the plural and vice versa” (ouch; I thought these were discreet concepts)

“The reference to a gender includes the other gender and the neuter” (ditto)

“The words ‘in particular’ and similar words shall not limit the generality of the preceding words and shall be construed as if they were immediately followed by the words ‘without limitation’” (erm… so “in particular” = “without limitation”?)

This would be laughable if it wasn’t so sinister. Hang on – let me practice my doublethink – yes… actually it’s laughable and sinister. And it gets worse as you plough on, into the details where white begins to merge into black. Here we go:

“The Authority shall not acquire any right, title or interest in or to the Intellectual Property rights of the supplier or its licensors…”

…except that the supplier must…

“Hereby grant to the Authority perpetual, royalty-free and non-exclusive licenses to use the supplier software (and background IPRs) for any purpose relating to the services (or substantially equivalent services) or for any purpose relating to the exercise of the Authority’s (or any other Central Government Body’s) business or function.” (My italics.)

So just to be clear: they don’t want anything except complete and perpetual carte blanche to use suppliers’ IPR throughout Government! And STILL it goes on:

The Authority… may assign, novate or otherwise transfer its rights and obligations under the licences granted… to any body (including a private sector body) which performs any of the functions that previously had been performed by the Authority. (Yes, my italics again)

For the avoidance of doubt (a phrase which makes frequent appearances in this New Model Doublethink, sorry, contract) when you sign this thing you’re letting the Government use your stuff – or just give away your stuff for others to use – for ever. So next time you go head to head with, say REDACTED to provide the service you invented, don’t be surprised when they give you the finger. What they’re saying is “We sort of said we didn’t want your stuff (and then we sort of insisted we did) and, hey, now we’ve got it for free, forever… well, these guys are our mates/cost less (given we’ve got your IPR)/have another couple of years to run on their contract (and we’ve got your IPR).”

Oh – a final poke in the eye: the document you’ll be signing is doublethought thus:

No warranty is given by the REDACTED as to the completeness of this document or its suitability for any purpose. (Their bold and underline, so it must be important.) I take this as saying “This document nails you to the floor but we don’t even acknowledge that it’s fit for purpose.”

I guess that one man’s* doublethink is another man’s cognitive dissonance

(*where reference to a gender includes the other gender and the neuter).