Communicating with devices, such as smartphones, by voice is part of everyday technology use. However, voice dialogs with industrial machines have higher requirements, such as data protection, operating safety and reasonable training costs, and have therefore only been established in exceptional cases to date (as of 2024), particularly in the industrial environment.
The aim of the research project is to design a universal platform for voice control of machines and automated systems that lowers these hurdles. This will be tested in several industry-specific use cases by means of an effective teach-in system using simulation. This makes voice control possible even for manufacturers of small quantities of machines in specific specialist areas.
As part of the DialoKIM project, methods and solutions are being developed to support small and medium-sized enterprises (SMEs), in particular in equipping the machines and systems they manufacture with intelligent voice input and output systems.
A generalizable methodology is being developed to train existing pre-trained language models in a domain-specific manner and to map these in representative use cases, particularly from the areas of machine tool operation and end devices for the consumer. For this purpose, a user-related and cross-system concept is being developed as part of the project, which supports the learning of voice control and voice output.
A semantic linking of use case-specific, in particular safety-critical boundary conditions, enables a holistic view and validation. This is first carried out virtually in a simulation model before testing on the real machine. Based on this, real-time analyses can be carried out with regard to quality, redundancy, dependency and impact on the entire system. The results developed as part of the project will be embedded in the systems of the consortium's associated partners in the form of demonstrators. In addition, it will be examined how generalizability and thus transferability of the approach to other domains can be ensured.
The protection of personal data and confidential company information should be guaranteed by the characteristics of the product, which can be checked and confirmed using a legal catalog of criteria.
SABO Mobile IT GmbH in Bühl produces software on behalf of German industrial customers with a focus on HMI (Human Machine Interfaces) and solutions in the sense of "Industry 4.0", both for planning and supporting industrial production processes (e.g. at Daimler, Audi and VW), as well as for supplementing devices and machines in the food technology, medical technology and mechanical engineering sectors.
More information
The core activity of EES Beratungsgesellschaft mbH is IT-related business process optimization in industry and SMEs. EES is a team of experts from various technical disciplines and advises companies and engineers on topics relating to visualization and simulation in the areas of development, sales and virtual commissioning. With its own open source solution, EES enables 3D simulation and virtual prototyping of systems to accelerate and secure their development and construction.
In project acquisition, planned systems can be visualized in dialogue with the customer for effective sales. EES has proven its know-how and expertise in the field of Industry 4.0 through numerous projects for well-known companies.
More information
The start-up agitum GmbH is a spin-off from the Karlsruhe Institute of Technology (KIT) and was founded in April 2021. The founders and employees are experts and researchers in the field of machine learning with a focus on natural language processing, as well as in the areas of process and requirements engineering, process automation and digitalization.
As a KIT spin-off, agitum has experience in national and international industry and research projects. agitum currently uses ML methods in its customer projects to extract unstructured data from documents, among other things. For example, transformer-based methods of optical character recognition are used. agitum contributes to the project in particular in the automated data acquisition and the development of application-specific algorithms.
The Chair of Production Engineering and Industrial Organization (FBK) is part of the Department of Mechanical and Process Engineering at the Rhineland-Palatinate Technical University in Kaiserlautern. The focus of basic and application-oriented research is on machining and digital technologies for production systems.
There is extensive expertise in the design, construction and operation of machines in the production environment. Another core research topic is machine learning, which is being researched as part of several collaborative and basic research projects relating to industrial production. Important preliminary work also exists in the area of designing interactive user interfaces for machines in production, for example through augmented reality.
More informationGet in touch with our contacts now to find out more about the innovative DialoKIM research project and the benefits for your personal use case.
Master of Computer Science
Managing Director SABO Mobile IT GmbH
Engelstr. 6
77815 Bühl
Germany
Phone:
+49 7227 4946
Software Developer
EES Beratungsgesellschaft mbH
Adalbert-Stifter-Str. 8
76275 Ettlingen
Germany
Research associate at RPTU Kaiserslautern Institute for Manufacturing Technology
and Production Systems
Gottlieb-Daimler-Str.
67663 Kaiserslautern
Germany
Managing Director Technology & Founders
agitum GmbH
Schönbornstraße 11
76661 Philippsburg
Germany