"BlinkIn Visual Assistance - Defining a new category of automated visual support towards to a visual AI Operating System for Europe (not Siri/Alexa). Our moonshot is to ""Give the world a Help Button""."

Informacje na temat projektu

BlinkIn Visual Assistant - June 2021

Identyfikator umowy o grant: 190155678

DOI

10.3030/190155678

Projekt został zamknięty

Data podpisania przez KE 21 Grudnia 2022

Data rozpoczęcia 1 Lutego 2023

Data zakończenia 28 Lutego 2026

Finansowanie w ramach

• The European Innovation Council (EIC)

Koszt całkowity

€ 3 900 750,00

Wkład UE

€ 2 500 000,00

Koordynowany przez

BLINKIN GMBH
Germany

Periodic Reporting for period 1 - BlinkIn Visual Assistant - June 2021 (BlinkIn Visual Assistance - Defining a new category of automated visual support towards to a visual AI Operating System for Europe (not Siri/Alexa). Our moonshot is to "Give the world a Help Button".)

Okres sprawozdawczy: 2023-02-01 do 2024-01-31

Podsumowanie kontekstu i ogólnych celów projektu

Blinkin aims to revolutionise the way technical problems are resolved in the real world by developing a platform that facilitates self-service for product users, supported by multimodal AI and backed by human experts. This initiative is driven by the need to address escalating service costs, diminishing professional service availability, and insufficient capabilities across various industries. The primary objective is to empower consumers to independently solve technical issues, such as setting up electronic devices or repairing home appliances, thereby reducing the burden on manufacturers’ customer support and field service teams while improving the time-to-resolution, the overall availability of support and the resources spent on each case. By doing so, Blinkin aligns the interests of consumers, professionals, and manufacturers, promoting efficiency, sustainability and self-reliance.

Prace wykonane od początku projektu do końca okresu sprawozdawczego oraz najważniejsze dotychczasowe rezultaty

Blinkin has developed the platform for AI-boosted Companion Experiences, which will enable product companies to create and publish step-by-step guides through a vastly enhanced Blinkin No-Code AI Studio. It will allow them to pre-script digital self-service experiences for their customers end-to-end, thereby controlling the personalised user journey and outcome much more effectively.
A significant achievement in the project has been to include the utilisation of companies' existing repositories of multimodal data (images, text, videos, etc.) in the development of Small & Large Vision-Language models. These models can be built using a Hybrid Fusion ML approach, ensuring robust semantic representation across different data modalities.
Once published, the web applications allow end-users to engage in tasks like image/video/text question-answering and summarization, enriching the self-service experience with .
In case the AI-guided self-service attempts by individuals (professional or consumer) require an on-demand intervention from a human expert of the product company, the integration with Blinkin’s Help Desk enables agents to support the user directly, ensuring their personal service needs are fulfilled.

Innowacyjność oraz oczekiwany potencjalny wpływ (w tym dotychczasowe znaczenie społeczno-gospodarcze i szersze implikacje społeczne projektu)

Blinkin's innovation ambition lies in its unique approach to cross-modal grounding, enabling the development of Vision-Language models that surpass traditional solutions in terms of efficiency and effectiveness.
The platform's future ability to leverage unstructured, unlabelled multimodal data to support complex problem-solving tasks represents a significant advancement. Our proposition aims to help organisations capture and unlock valuable knowledge hidden in vast amounts of their own data.
Another distinctive innovation is AI Studio, which provides an intuitive WYSIWYG no-code environment for transforming the aforementioned data into multimodal companions (specialised actionable web applications) in just minutes. The Studio also offers the option to automatically generate step-by-step guides from a selected source and deploy Visual AI as-you-go using only text prompts.
Moreover, the built-in seamless transition in the end-user experience from AI-fuelled self-service to live expert assistance - while securing the users’ individual progress in their self-service attempts - will ensure effective support beyond the state of the art in customer service.

blinkint-parta-img.jpg