Further initiatives of the Hamburg Kreativ Gesellschaft

Cases from the Prototyping Lab

Here you can find all the cases from past labs. Exciting prototypes relating to artificial intelligence as well as virtual and mixed reality.

Four people, two men and two women, sit around a table and work together on papers. They are concentrated in a brainstorming session, with other people in the background of the room. There is a bottle on the table and some of the participants are wearing conference lanyards. nextMedia.Hamburg

All cases from the Prototyping Lab

How are innovative technologies changing the future of media? In the Prototyping Lab, we are looking for answers to these and similar questions.

We give talented students from Hamburg's universities and experimental media and digital companies the opportunity to develop functional prototypes in just three months. In the lab, new market ideas are developed at the cutting edge and technological challenges for companies are solved. The interdisciplinary student teams are supported by renowned industry experts as mentors.

Prototyping Lab 2022 - Artificial intelligence

The group of 18 participants of the stands on a stage at the closing event of the Prototyping Lab 2022 and holds certificates in their hands. They smile at the camera while a large screen with the words 'Thank you for your attention! nextMedia.Hamburg
Participants of the Prototying Lab 2022

In the Prototyping Lab 2022, 12 students from four universities developed AI solutions for Carlsen Verlag, Jahreszeiten Verlag and RMS.

AI-based lettering of comics

Team Carlsen's challenge was to develop an AI that facilitates the lettering process when translating foreign comics. This process is normally done by hand and is therefore time-consuming, labour-intensive and costly. The AI should automatically recognise the speech bubbles of foreign comics, determine their shape and size and then refill them with German text. The text should be inserted in a visually appealing way and divided into suitable paragraphs.

The students developed a prototype that first recognises words using optical character recognition and then assigns them to groups, each of which represents a speech bubble. The speech bubbles are found and measured by the prototype in the version of the comic with empty speech bubbles. As the programme has numbered the speech bubbles in the original comic, the translation texts can be inserted into their respective speech bubbles using the measurement data.

A young man with brown-blonde hair, representing Team Carlsen, holds a microphone and speaks on a stage. A projection with a presentation can be seen behind him. He is wearing a blue jumper, dark grey jeans and a conference lanyard. nextMedia.Hamburg
Team Carlsen

How does conversion work in the world of online audio?

Radio has developed into a multi-channel medium as part of the digital transformation. One of the central questions in this digital world is that of advertising impact. How do we measure the conversion of a digital audio advert? How do we prove that an audio advert turns a listener into an interacting person? As part of the Prototyping Lab, the RMS team was therefore tasked with developing a solution to measure the impact of advertising in digital audio adverts.

To solve this challenge, the students developed an algorithm for audio recognition. Based on one second of an audio advert, the algorithm can recognise whether it is an audio advert from RMS or not. If it is recognised as RMS audio, the programme can determine which audio spot it is.

A young woman with dark blonde hair stands on a stage and speaks into a microphone. She is wearing a black skirt and a blouse with a floral black and white pattern and a white blazer over it. Two guests at the event can be seen blurred in the foreground. A projection of the Team RMS presentation can be seen in the background. nextMedia.Hamburg
Team RMS

AI application for food trend topics

In the Prototyping Lab, the Jahreszeiten Verlag team tackled the challenge of developing a market research tool for decision-makers at Jahreszeiten Verlag that can be used to identify food trends for the 20-30 age group. In the long term, strategic product development decisions should be made on the basis of the tool's data.

The team solved the challenge by designing a prototype with several components. In the data collection process, a scraper is first used to collect data from TikTok that can be used to analyse trends. The data is then processed using other programmes and stored in such a way that it can be read by decision-makers at Jahreszeiten Verlag and used for product development decisions.

Presenter in a grey hoodie gives a talk on stage, behind her "What's next?" is shown on a projection screen. The two other members of the Jahreszeiten Verlag team sit in the foreground and listen attentively. nextMedia.Hamburg
Team Jahreszeiten Verlag

Prototyping Lab 2021 - Artificial intelligence

Miro board for the launch of the Prototyping Lab 2021, showing a project overview with team members, agenda, partner logos and interactive elements. Contains colourful sticky notes with names, project phases and ideas distributed on the digital whiteboard. nextMedia.Hamburg
Digital kick-off for 2021

Whether in a publishing house, a media company or an agency - artificial intelligence can change the future of media. In the Prototyping Lab 2021, 20 students from five universities worked together with four partner companies to develop AI solutions for challenges in the content industry.

AI decision tool for book production

The challenge: Carlsen Verlag publishes more than 700 books every year. How can an AI tool help determine the ideal order quantity and timing for reprinting decisions? The aim was to reduce storage, production and waste costs while ensuring delivery capability.

The prototype: First, the internal stock sales data, title metadata and costing tables were analysed. During implementation, the team opted for an orchestration approach that combined data clustering and the use of a recurrent neural network (RNN). The recommendation process is divided into two phases: The prediction of the sales trajectories and the calculation of the reprint decision. In a final test, the prototype impressed with realistic forecasts and enormous time savings, as the calculation time per title was reduced by 50% (from 3 to 2 hours).

Web app for annual reviews

The challenge: The archive on spiegel.de contains more than one million articles. How can Spiegel process its large volumes of articles and meta-information in a meaningful way with the help of artificial intelligence and create new offers from them?

The prototype: The kick-off workshop gave rise to the idea of creating an interactive and clear review of the year. The team decided to use the already pre-trained open source AI model "Spa.cy" for the implementation, which already has a very high hit rate (91%) in this area. Due to the short time available and the large amount of data, the prototype was limited to the year 2020 and the entity of people. Under the working title "Spiegel-Zeitreise", a web application was created that uses artificial intelligence to create a visual review of the year from the archive with the five most important personalities and further information and articles about them. The backend system used for this with a connected database could also be used for other purposes in the future, e.g. for summarising and automatically indexing texts.

Event stage of the Prototyping Lab 2021 at the Design Centre Hamburg. The presenter in a black top and yellow trousers speaks at the microphone. The background shows a projected film with the words "Prototyping Lab 2021" and a red banner with the nextMedia arrow. nextMedia.Hamburg
Das Team Carlsen präsentiert ihren Prototypen auf der Bühne vor dem Publikum. nextMedia.Hamburg

Modular branding using AI

The challenge: Brand management is becoming increasingly complex and challenging in the digital age. Fork Unstable Media has developed the Modular Branding approach, which interprets brands as dynamic "personalities", so-called brand tokens. How can AI be used to utilise the potential of this model to automatically adapt brand profiles?

The prototype: As a starting point, the team chose the preferences of users determined using machine learning, which were to be translated into a personalised presentation of the website. KPIs such as dwell time and interaction rate were defined for this purpose. The biggest problem was the lack of usage data, which is why the team decided to train with artificial users under real conditions. A performance AI checks the defined KPIs of the website, while a design AI automatically adapts the presentation of the website. After 2000 repetitions, the accuracy is 30%, which is significantly higher than the values that a human estimate would produce.

Automated content metadata

The challenge: tigermedia faces the challenge of maintaining and categorising the more than 10,000 titles in its media library, to which new content is regularly added. The aim of the lab was therefore to intelligently analyse and prepare the amount of content in order to optimise the associated processes.

The prototype: AI was used to develop a fully automated process for extracting and analysing content that can be applied to every new title. In order to generate new metadata automatically, the audio files first had to be transcribed into full text using text-to-speech technology. This text was then converted into vectors in a process known as embedding. On this basis, the individual audio tracks were then summarised in similar clusters using the DBScan algorithm. In this way, suitable keywords or tags can be recommended for several titles, i.e. per cluster. The tool analyses and categorises 14 tracks in twelve minutes - a person cannot even listen to one track in its entirety in this time. As an add-on, a Bad Mouth filter has been added, which searches new titles for terms that are unsuitable for children and flags them.

The Prototyping Lab

The Prototyping Lab takes place once a year. You can find all the information about the current edition here:

Prototyping Lab 2019 - Artificial intelligence

Die 19 Teilnehmer*innen des Prototyping Lab stehen in zwei Reihen vor einer schwarzen Wand im Designzentrum Hamburg. nextMedia.Hamburg
Participants of the Prototying Lab 2019

Hamburg universities have built impressive prototypes together with Der Spiegel, N-Joy and Bauer Media to focus on AI technology.


Intelligent database for recipe searches

How can the Bauer Media Group's "House of Food" use AI to react quickly to new trends in the food segment? As a solution, an intelligent recipe database was developed in which ingredients were classified according to characteristics such as "vegan" or "gluten-free". Based on manual tagging of around 2000 files, the neural network was trained so that the prototype can automatically tag existing recipes and images. The following functions were also integrated: a search for food trends and diets, a reverse image search and a tool for calculating nutritional values.

Eine Studentin mit blonden Haaren aus dem Team Bauer Media steht vor einem Pult, hält ein Mikrofon in ihrer Hand und stellt die Ergebisse vor. Hinter ihr steht der Rest des Teams. nextMedia.Hamburg
Team Bauer Media
Eine Studentin mit braunen Haaren aus dem Team Bauer Media steht auf der Bühne, hält ein Mikrofon in ihrer Hand und stellt die Ergebisse vor. Ihr Blick geht auf das Publikum. Hinter ihr steht der Rest des Teams. nextMedia.Hamburg
Team Bauer Media

AI filter for identifying fake ads

Ad fraud refers to fraudulent adverts that conceal inferior products or malware, among other things. Until now, this problem could only be solved ex post and with a great deal of manual effort. The prototype for Der Spiegel was set up using a support vector machine and a bot on the Google Ad Manager. To classify the adverts, the AI was first tasked with checking all current and new adverts by analysing metadata and images and then automatically blocking questionable adverts. The result was convincing: fraudulent adverts were correctly identified 95% of the time in the 2000 test data.

Ein Student aus dem Team Spiegel stellt die Ergebnisse vor. Sein Blick ist auf die Präsentation gerichtet. Der Rest des Teams steht hinter ihm auf der Bühne und schaut ebenfalls gespannt auf die Präsentation. nextMedia.Hamburg
Team Spiegel

Music Prediction Machine

The challenge: In order to remain successful in competition with streaming services such as Spotify, an AI should help the music editorial team to select new songs that listeners are most likely to like.

The prototype: The AI is a simple neural network that analyses music tracks for similarities based on 33 characteristics. The song files are read into the analysis tool and characteristics such as speed, key and lyrics are checked and evaluated. The success of the prototype was verified during the test phase with the help of survey results and 500 songs rated in advance by the editorial team. To ensure user-friendliness for editors, a simple graphical user interface was developed for Linux systems. The Music Prediction Machine is constantly learning and can therefore make increasingly accurate predictions for new songs.

Ein Student aus dem Team N-Joy präsentiert die Ergbnisse. Er steht auf der Bühne mit dem Rest des Teams auf der Bühne und blickt ins Publikum. nextMedia.Hamburg
Team N-Joy
Das Publikum blickt gespannt auf die Bühne. nextMedia.Hamburg
Team N-Joy

Prototyping Lab 2018 - XR technologies

Die 19 Teilnehmer*innen des Prototyping Lab stehen oder Hocken in drei Reihen auf einer kleinen Bühne. Hinter ihnen eine Projektion der Begrüßungsgrafik zur Veranstaltung. nextMedia.Hamburg
Participants of the Prototyping Lab 2018

In the first lab, Hamburg students experimented with XR technologies (VR, AR and 360°) with Bauer, Foodboom and Der Spiegel.


VR application for interactive house construction

How can existing digital content be adapted and utilised for VR applications? The idea: to build and design the house of your dreams with your own hands - virtually and playfully according to the principle of a DIY construction kit. The prototype for Xcel Media worked with the full range of VR technology: VR goggles, two controllers and sensors in the room that are synchronised with these to enable realistic movement in virtual space. The application could potentially even be used to implement entire theme worlds, place advertising partners, add products to a shopping basket and pay online.

Zwei Studenten aus dem Team Xcel Media und eine dritte Person stehen auf der Bühne und sind im Gespräch miteinander. Im Hintergrund ist ein Screenshot aus der VR-Applikation projiziert. nextMedia.Hamburg
Team Xcel Media
Zwei Personen stehen auf der Bühne und testen die VR-Applikation. Eine der Beiden hat eine VR-Brille auf und navigiert durch die VR Umgebung. Im Hintergrund ist ein Livevideo projiziert, das zeigt was in der VR Brille zu sehen ist. nextMedia.Hamburg
Team Xcel Media

Experience the moon landing in 360°

How can VR storytelling be integrated into editorial processes and what added value will such multimedia formats offer in the future? As a prototype for a VR reportage, the team developed the 10-minute VR live experience "Behind the Moon" to mark the 50th anniversary of the moon landing. Radio messages and diary recordings in audio form as well as info markers about the space shuttle complement the report, which was published on Spiegel Online. A 360° video was also produced to make it possible to use the film without VR equipment.

Drei Teilnehmer*innen des Team Spiegel stehen nebeneinander und besprechen sich. nextMedia.Hamburg
Team Spiegel

Smartphone application "Foodbot"

The challenge: As a lifestyle brand for digital food content, Foodboom is looking for new multimedia applications with added value that can be easily integrated into its own offerings and social platforms.

The prototype: The "Foodbot" uses the camera function to recognise food and then makes suitable recipe suggestions. At the end of the process, the team had created 3,500 self-photographed labels for 18 selected ingredients and 20 specially created recipes. Technologically, the smartphone app is based on augmented reality (AR) and machine learning. The advantage of AR: innovative content can be created that is low-threshold, has low acquisition costs and is therefore easier to integrate into the media mix than a VR application. At the same time, users can enjoy interactive, digital realities, clearly differentiating the functional prototype from other Foodboom offerings with this added value experience.

Zwei Studentinnen aus dem Team Foodboom stehen auf der Bühne und Präsentieren die Ergbnisse. Im Vordergrund ist das Publikum zu sehen. nextMedia.Hamburg
Team Foodboom
Eine Person benutzt die App und fotografiert eine angschnittene Gurke, die sie in der Hand hält. nextMedia.Hamburg

The Prototyping Lab

The Prototyping Lab takes place once a year. You can find all the information about the current edition here:

Contact

Cigdem Boom-Aker - nextMedia.Hamburg

Subscribe to our newsletter

Subscribe to our newsletter and receive compact information about calls for applications, programs and events once a month.
Cases from the Prototyping Lab -

Wir verwenden Cookies, um externe Inhalte anzeigen zu können. Sie können unter “Einstellungen” der Erhebung von Nutzerdaten widersprechen. Weitere Informationen erhalten Sie in unserer Datenschutzerklärung.

Wir verwenden Cookies, um externe Inhalte anzeigen zu können. Sie können unter “Einstellungen” der Erhebung von Nutzerdaten widersprechen. Weitere Informationen erhalten Sie in unserer Datenschutzerklärung.

Your cookie preferences have been saved.