The accuracy of facial recognition has improved dramatically over the past five years. Advances in both hardware and software have led this technology to the cusp of becoming an everyday part of daily life.
It has the potential to bring many practical benefits. However, it is surrounded by accusations of inaccuracy, bias against ethnic groups and has the potential for flagrant abuse by both corporations and governments.
This post provides a basic introduction to the technology, the controversies which surround the use of facial recognition. It then explores what role open source software and transparent data sets can play in helping people understand the technology.
Many open-source projects target existing, commercial hardware without official support from the hardware vendor. Some of the most famous examples include Linux and the GCC compiler; which all started as third party projects.
These days both of these projects see significant support from large hardware companies and are used as the official tooling for many widely sold products. Both now see significant first-party contributions from hardware vendors.
Over the last three years, I have been part of the community developing open source tooling for field-programmable gate arrays (FPGAs). These are programmable logic chips with great potential for “post Moore’s law” reconfigurable computing with many promising applications from consumer devices to datacentres.
In general, FPGA companies have not published the low-level details of the devices – unlike CPUs, where the instruction set is almost always public. The expectation is that everyone uses the closed-source vendor-specific toolchain provided.
As a result, to develop a complete open-source flow from design to device programming for most FPGAs, the low-level “bitstream” details must be documented by creating a large number of designs using the vendor-provided tools and examining the output. Claire Wolf did this for the Lattice iCE40 FPGAs five years ago in Project Icestorm. Subsequently, I created open-source documentation for their larger ECP5 FPGAs.
In both cases, combined with the low cost and simplicity of these Lattice parts, these projects have led to popular open-source flows for both devices. From this has sprung a number of open source development boards such as the myStormBlackIce, icebreaker and ULX3S.
Vendors are now acknowledging the importance of open source
Whilst downloading a newly released Lattice SDK, I found there was a new clause in the license agreement prohibiting this bitstream documentation. Fortunately, this SDK doesn’t directly affect any of the currently supported devices, but it would have become problematic if all their tools sport this license in the future:
e. Licensee shall not distribute, copy, transfer, lend, incorporate, modify, use or sublicense the Software or any Modules for any purpose except as expressly provided herein or as otherwise permitted under relevant law, or in advance by Lattice in writing. In particular, no right is granted hereunder … or (3) for reverse engineering a bit stream format or other signaling protocol of any Lattice Semiconductor Corporation programmable logic device.
Thanks to lobbying from the community, it is great to see that Lattice has shown commitment to open source by promptly removing the clause after being contacted about it, going as far as to publish a message of appreciation for the open-source community on Twitter:
Thanks for pointing out a new bitstream usage restriction in the Lattice Propel license. It is not our intent to hinder open source tools. See https://bit.ly/3eUM3OD re an updated license. We are excited with the open source community’s FPGA achievements and their potential.
This is a risk that Lattice has taken, but it is one that resonates well with the open-source toolchain developers and will hopefully yield good results for them in the future. It also shows the power of a strong open source community to achieve good results from companies and the growing awareness for the open source.
I hope that as time progresses we see more support for open source tools from FPGA vendors, perhaps even reaching a similar point to established open -source software tooling.
David Shah is a self-employed developer working on nextpnr, the open source FPGA place-and-route tool. His previous work also includes Project Trellis, open source bitstream documentation for the Lattice ECP5 FPGAs.
OpenUK, the advocate organisation for Open Technology (open source software, open hardware and open data) in the UK, has revamped its Kids’ Competition due to the impact of school closures and the Coronavirus pandemic.
A total of 400 MiniMU Glove kits each including a BBC micro:bit will be sent directly to participating kids in May, to help kids experiment and experience what can be achieved with the newly open sourced MiniMu gloves. Kits are being sent directly to kids to construct and they can then take part in fun activities designed to help them experiment and make music with the gloves.
A 10-episode animated series has also been designed by School Science Ambassador and 2020 EdTech Hall of Fame member David Whale, with curriculum related input from educationalist and Morrison’s Academy computer science teacher Pamela Boal. Each fun 10-minute episode has an activity for participating kids and will a friendly and fun introduction into open source, making music and developing other uses for the MiniMU glove. The aminated series has animation by Drawnalism and narration from voiceover artist Stephanie Bower.
A comment by Julian Kunkel, Simon Worthington, Jeremy Bennett, Andy Bennett
Governments worldwide are developing smartphone apps that track the location and movement profile of citizens in order to quickly identify contact persons of COVID-19 infections. According to The Financial Times, if even 40% of smartphone users install such an application, the infection levels would be significantly reduced in the UK. Therefore, the widespread usage of such an application is an important instrument in the current crisis.
How could such a smartphone app work? In a nutshell, a device can scan other nearby devices and exchange device IDs, for example, using Bluetooth. This information then needs to be stored with a timestamp. If the owner of a device contracts the virus, s/he could indicate this fact in the app allowing to associate the own device ID with the information that s/he may have infected others. This data then needs to be recorded on a server to allow the app of other users to query the register and then compare any contact information with the register of COVID-19 victims.
This post is part of the OSSG series “the role of open source in the UK”, where we collect and publish statements from companies and individuals in the UK regarding their experience with Open Source Software. We welcome any submission to this series. If you are interested, please send an email to Dr Julian Kunkel.
by Dr Julian Kunkel, Lecturer, Department of Computer Science, University of Reading
Open source is vital in providing teaching, in conducting research in computer science, and in enabling reproducible large-scale experiments in computational science that support the society. In this post, Julian describes his experience with Open Source in his career.
The Relevance of Open Source: A Personal Statement
Open-source software is for me the key enabler for productive work and for providing training and research environments for various reasons. Firstly, in my own work environment, I rely upon Ubuntu as the operating system to give me the freedom to conduct research and programming experiments easily on my laptop that can later be scaled up to data-center wide experiments.
Having full control over the system and easy means to repair a broken system, I haven’t lost any data in my 20-year usage of Linux albeit my work often requires to perform rigorous stress-testing of hardware components. I have high confidence and trust in the software stack due to the openness of the software stack. There are no hidden data transmission of private data and proper security schemes in place that protect my data and research. Another benefit I acknowledge is that key APIs are robust and software I rely on that has started to be developed 20 years ago can still be used.
For the last year or so, Open Source educational and advocacy work by our think tank, OpenForum Europe, has been framed by a key question: “Why did Open Source Software development end up as an unintended casualty in the original proposal of the EU’s Copyright Directive?”
In a time when
the digital transformation is at the heart of many policy discussions in
Brussels, and when Open Source-dependent technology such as IoT, Cloud,
blockchain and supercomputers are hot topics, no one involved in drafting the
legislation thought of software development. In short, the platforms and
repositories used by developers to drive the digital transformation through the
collaborative development of code were forgotten.
Consequently, as
the platforms fell into the scope of the Copyright Directive’s filtering
obligations, they ran the risk of being regulated out of practical existence in
the EU, or at least their users would experience a very negative cooling effect
on innovation.
In response to this regulatory risk, OpenForum Europe and the Free Software Foundation Europe started the SaveCodeshare.eu campaign. In the end we were successful in excluding software platforms from the final law. That said (and there is a lot to say about the process of getting there and the many other consequences of the Copyright Directive as a whole) our main takeaway was the grim realisation that Open Source software was overlooked, despite software being largely regulated by copyright law.
On the one hand,
this says something about knowledge gaps that exist among policy makers. But on
the other hand, it also says something about the state of Open Source advocacy
in Europe. Advocacy has not followed the times and is way behind reflecting the
reality of the role and position of Open Source in everything digital.
Open Source advocacy is still reactive. Communities of activists and advocates should (perhaps must) build the capacity to be proactive.
The need for a
maturing of Open Source representation in politics goes beyond simply not being
overlooked when drafting digitally relevant legislation. In our view, with Open
Source having gone mainstream, there are new risks and opportunities arising.
That means that the political conversation around Open Source has to go beyond
what it has focused on in the past, to how to become acknowledged as being of
strategic importance for Europe’s digital future.
To be part of that
conversation, the Open Source ecosystem needs to build the capacity to become
trusted partners of governments and public authorities, in order to capture the
big opportunities.
We believe that
to make that happen, to not just fend off regulatory risk, but also capture the
opportunities that are out there, all stakeholders in the ecosystem need to
step up. From the developers, Open Source vendors to the large IT and
industrial companies that develop and/or depend on Open Source’s innovative
benefits, there needs to be more effort, energy and resources spent on
political representation and educational efforts.
We have to at least take on the collective responsibility to make sure that Open Source Software never becomes an unintended casualty again. For those stakeholders that look further than defensive efforts, we need to be part of the conversations around the digitization of all sectors of our society. It is also our responsibility to do our part in ensuring that the much talked about Digital Sovereignty describes a digital reality that is neither locked-in to a small group of monopolistic vendors or for that matter, a chauvinist approach of a Europe closed for global collaboration.
OpenUK is a membership and trade organisation for “open” in the UK, actively representing the interests of UK businesses in the UK and internationally. It is building out a number of projects and workstreams to create a single voice for opens source software, open hardware and open data across the UK. This will be increasingly important post-Brexit, when we need to come together with once voice to be recognised as a strong presence in the UK and to influence Government, legislation and the public sector to ensure appropriate treatment of “open” in the UK.
OpenUK launch event at the House of Commons.
We have a
wide variety of new work streams supporting the goals of OpenUK and will be
working with our extended board to prepare our 2020 strategy in January and
will be sharing this via our new web site and NextCloud.
The
Committees we have set up and will be working on are:
Awards Committee – organising our 2020 OpenUK Awards in London on 11 June, as part of London Tech Week chaired by Amanda Brock with judges Andrew Back, Cheryl Chen and Chris Lamb
Events Committee – being formed in 2020. We have a healthcare event on 6 February, and open data series kicking off in March and a number of other events planned including topics such as open hardware and well-being/ working from home – chaired by Amanda Brock
Learning Committee – working on an open-source GCSE and a schools competition for early 2020, with the winners being part of the Awards. Over time we will work on code camps etc – chaired by Paul Taylor
Legal and Policy Committee – currently setting its remit, reviewing CCS and GDS contract terms, looking forward to a meeting with the Parliamentary All-Party Intellectual Property Committee, when a new Government is in place and responding to the recent Commission workshop – chaired by Chris Eastham
Museums Committee – being formed in 2020. Working on a permanent exhibition room at the National Computer Museum at Bletchley to be launched in January 2021 and temporary exhibitions open elsewhere – chaired by Stuart Mackintosh
Universities Committee – welcoming all universities in collaborative student projects – chaired by Bruce Darby of Edinburgh University
OpenUK is
actively looking for additional members for a number of our committees and
groups and would be pleased to hear from anyone interested in volunteering.
British Baked Podcasts,
celebrating the talent of the UK’s open sectors will be added weekly from
January and are being recorded with the support of BCS’s open source group and
Endecosm. We are also hoping to launch UK Faces of Open Source in 2020. http://www.facesofopensource.com/
Details
of the participants in all of our committees in our new web site which will be
live before Christmas, thanks to our friends Greg and Ele at Civic, who are
working hard to build this. A combination of our site and our Nextcloud, hosted
by OpusVL,will allow easy access to mailing lists and transparency across the
work of our committees and board. Andrew Katz, our Pro Bono GC and his team at
Moorcrofts are working hard on making sure all the necessary legals are in
place.
Amanda Brock has stepped into the role of CEO and will be OpenUK’s first employee.
Our board
will also be extending in January and details of the interim board for 2020
will be updated in the new site. By the end of 2020 we will move to an elected
board.
The
OpenUK events calendar on the new site will list what is happening across open
source software, open data and open hardware in the UK and beyond and will also
include the up and coming OpenUK events and even we will be attending in 2020.
Please contact us via the site, if you
would like an event listed.
Our final exciting news, is that OpenUK will be hosting a stand at FOSDEM for the first time on Saturday 1 February, potentially the first day after the UK’s Brexit from the European Union. It will be themed “Tea and Biscuits with the Brits”.
We welcome anyone based in the UK or who wants to showcase a UK business as part of our stand, to take part, give away their goodies and meet the folk of FOSDEM with us. Please contact amanda.brock@openuk.uk if you would like to help with our stand and hope that you will join us for tea, biscuits and a good old natter about open source in Brussels. Please also feel free to contact me if you are interested in participating in any of our committees or are interested in becoming a member of OpenUK or sponsoring our activities.
This post is part of the OSSG series “the role of open source in the UK”, where we collect and publish statements from companies and individuals in the UK regarding their experience with Open Source Software. We welcome any submission to this series. If you are interested, please send an email to Dr Julian Kunkel.
by Dr Jeremy Bennett, Chief Executive, Embecosm
Open source is central to the work of Embecosm, and over more than a decade we have built up a very successful business. In this post I’ll explain how we did it.
About the company
Embecosm Limited was established in 2008, initially to provide free and open source modelling and debug services to system-on-chip designers. It very quickly became clear that chip designers wanted more than just debug. The company expanded to cover development of the entire free and open source compiler tool chain. More recently we have broadened our expertise to cover operating system development, bringing up open source operating systems of all sorts.
This is Embecosm’s business today, providing open source software development services in our specialist fields. Much of our business is in the embedded space and very often pre-silicon, hence our continued expertise in modelling. We use everything from high-level functional models through instruction set simulators, cycle accurate models based on Verilog and VHDL, through to EDA event driven simulation.
With bases in the UK and Germany, Embecosm is now the world’s largest independent general open source compiler tool chain developer. We are not the only player in this area, CodePlay in Edinburgh specialise in OpenCL compilers, while AdaCore in France specialises in open source Ada compilers. Siemens in Germany also has a department offering compiler development services.
The business model
Embecosm follows a purely service business model. Customers pay for our engineering expertise to develop their compilers, models and operating systems. These are all inherently very difficult areas of software engineering, very much the rocket science end of the discipline. This is core to our business model―it is invariably more cost effective for customers to use our services than to attempt to recruit and manage an in-house team.
We are not a body shop. We supply a team to solve
the problem, bringing in specialists at different times. Early on we probably
want assembler and modeling specialists, later on the compiler team get to
work, then we need the documentation and training specialists to complete the
project.
The scarcity of the skills we offer is critical to driving our business. The fact that the software is always freely available is important (see “The risk factor” below), but doesn’t allow the customer to solve the problem on their own.
The risk factor
The value of free and open source software to the
customer is in the reduction of risk. It costs as much to use Embecosm to
develop/maintain a compiler tool chain as it does to buy in a proprietary tool
chain. However unlike the proprietary
tool chain, you are not locked in to one supplier. If you wish you can drop
Embecosm and use another tool chain supplier with no problem.
Indeed the ability to walk away from Embecosm at
any time, is a key reason that customers stay with us. It is a value of free
and open source software that is often overlooked, but in a business context
can be the most important.
Building profitability
A service business relies on reputation. This is the case even more for free and open
source software, with its basis in open communities. The first three years of
Embecosm were not profitable, and mostly spent writing application notes
explaining to people how to do all the things we do and talking about these
things at conferences. These application notes on integrating GDB, building
fast Verilator models, porting Newlib and so on, remain standards for the
industry.
But showing people how to do the work themselves,
ended up driving business to us. Reading our application notes allowed managers
to see how difficult the problem was and that Embecosm had the skills to solve
these problems. It makes the buying
decision to use Embecosm services much easier.
We remain completely open with all we do and
contribute widely to free and open source projects. Almost every customer asks
us to train up in-house staff, which we are happy to do. It provides us with
advocates inside the customer who understand our work, and can act as
“translators” to others in the customer, allowing us to provide a better
solution. Their experience invariably
leads to growing confidence in Embecosm’s skills and a strong bond between
customer and supplier engineering teams, which helps both.
We are also unashamed that our skills are
valuable. My staff are highly qualified and highly paid, reflecting the extreme
scarcity of the abilities we need. Our
charges to customers reflect the value we deliver.
In once case a customer had a team of 10
generalist engineers in India trying to develop a GCC tool chain for 5
years. Customers continued to complain
about the poor quality of the tool chain and eventually we were called in. By then standard regression testing was
flagging over 130 internal compiler errors.
All were fixed by one Embecosm engineer in one month and we then spent a
year training up the team in India with the specialist skills they needed to maintain
the tool chain.
So we may look expensive by the hour, but when you
consider what we deliver in that hour, we suddenly seem very good value. This is a general principle of business,
whether open source or not. The higher
value the services you can provide, the more profitable you will be.
Conclusions
Free and open source businesses can be very
profitable, particularly operating in areas where skills are scarce. Ongoing engagement with the wider community
is essential to building reputation, trust and ultimately more business.
Dr Jeremy Bennett is Chief
Executive of Embecosm (www.embecosm.com), specializing in the development of free and open source compiler
tool chains, operating systems and processor models. He is author of the standard textbook
“Introduction to Compiling Techniques” (McGraw-Hill 1990, 1995, 2003) and holds
a MA and PhD in Computer Science from Cambridge University. Since 2017 he has
served as Chair of the BCS Open Source Specialist Group.