Artificial intelligence: Can we trust it?

Just over a year ago, the Zentrum für vertrauenswürdige Künstliche Intelligenz (ZVKI, "Center for Trustworthy Artificial Intelligence") was founded in Berlin. The focus of its work is the protection of consumers: How can it be ensured that AI solutions are trustworthy? How can fair, reliable and transparent AI systems be identified and promoted? ZVKI experts Jaana Müller-Brehm (left) and Verena Till provide answers.

A few years ago, artificial intelligence (AI) was a term that was very reminiscent of science fiction. In the meantime, almost all of us are surrounded by AI solutions in our private and professional lives.

One application that uses AI processes and that many no longer want to do without and judge as trustworthy is the navigation device. Few question the suggestions of their "navigator". But trusting the navigation device can also have fatal consequences: Cars have already landed in rivers more than once because it guided them there.

If AI is taking up more and more space in our lives, then the question arises: under what conditions can we trust AI software? And what does this mean for our society, in which AI procedures are gaining importance? The ZVKI (Center for Trustworthy Artificial Intelligence) has taken up these and other questions and is working on various project components around the topic of "trustworthy AI". The center was founded in December 2021 as a project of the independent think tank iRights.Lab in collaboration with the Fraunhofer Institutes AISEC and IAIS and Freie Universität Berlin. In an interview, project coordinator Verena Till and her colleague Jaana Müller-Brehm explain to us what exactly AI and trust have to do with each other - and what challenges this will present us with in the future.

Focus on consumer protection

Verena Till explains the center's activities: "The ZVKI is a funded project of the German Federal Ministry for the Environment, Nature Conservation, Nuclear Safety and Consumer Protection (BMUV). The aim is to form an interface between science, industry, politics and civil society in order to shed more light on the ethical foundations for AI." The focus is on the question under which conditions AI applications can be considered trustworthy. From the perspective of consumer:inside protection, the aim is to determine how informed the population feels on the subject of AI, what information is lacking, and what framework conditions ensure trustworthy AI. Consumers as well as business and politics are to be sensitized to this important topic, explain the two ZVKI employees.

Whether roadshows, publications or certification for AI products: The spectrum of activities and approaches of the ZVKI is broad. And that is understandable and important, as Verena Till explains: "AI is assuming ever greater relevance in our lives, so the discussion about its social impact must also pick up speed. A number of questions arise in order to steer technological developments in a direction that is desirable for our society. There are enough topics and tasks.

When dealing with the topic of AI, the first question that arises is the definition. "This already presents us with the first challenge," says Jaana Müller-Brehm. "The term 'artificial intelligence' dates back to the 1950s. At that time, it was associated with the intention of reproducing human intelligence with the help of computers and software. This project can be considered a failure." In the meantime, the two experts continue, the term AI is used much more broadly. AI solutions include self-learning systems that use machine learning techniques to develop algorithms to solve very specific problems. Such programs are used to analyze huge amounts of data and identify patterns and similarities. For example, AI applications on video platforms analyze patterns from the click behavior of users and use them to derive recommendations for content. Often, however, quite simple systems whose codes have been completely specified by developers are also referred to as AI. Such very limited solutions can be found, for example, in customer service in the form of simple chat bots.

"We need to find a bracket for this multitude of methods and approaches that go under the term 'AI'. Often, artificial intelligence is about different methods of machine learning. We therefore distinguish between learning and non-learning algorithmic systems," the experts explain.

For Verena Till, however, it is not decisive in the context of consumer information whether a system or method can really be called "AI" or not. In her view, it is much more important that algorithms and AI systems are playing an increasingly important role in people's everyday lives, and that the question of the trustworthiness of these rapidly growing technologies is therefore becoming increasingly central. Jaana Müller-Brehm takes this idea a bit further: "Technological developments such as digitalization are always double-edged. It's important to promote the positive opportunities and minimize the negative effects - in other words, to take advantage of the scope for design."

Since the beginning of the project, the ZVKI has created structures and implemented measures to discuss the topic of trustworthy AI in an interdisciplinary manner. A network has been established that brings together stakeholders from science, business, politics, culture and civil society, as well as their approaches and ideas.

"We hope that in the coming years we will succeed in establishing a sustainable and possibly also internationally networked platform that will ensure the dialog of business, science and politics in the future," say the two ZVKI employees.

The project is therefore currently also focusing on the establishment of a non-profit association that will continue to pursue the project goals beyond the funding phase.

For the two ZVKI employees, the issue of consumer information and education, as well as the question of certificates, cannot be solved conclusively in one or two years: "Technical developments are rapid and dynamic. We have to react to this again and again. Technological progress should be coupled with a discussion about ethics and values so that we can ensure that technological development takes a socially positive direction."