"BlinkIn Visual Assistance - Defining a new category of automated visual support towards to a visual AI Operating System for Europe (not Siri/Alexa). Our moonshot is to ""Give the world a Help Button""."

Informazioni relative al progetto

BlinkIn Visual Assistant - June 2021

ID dell’accordo di sovvenzione: 190155678

DOI

10.3030/190155678

Progetto chiuso

Data della firma CE 21 Dicembre 2022

Data di avvio 1 Febbraio 2023

Data di completamento 28 Febbraio 2026

Finanziato da

• The European Innovation Council (EIC)

Costo totale

€ 3 900 750,00

Contributo UE

€ 2 500 000,00

Coordinato da

BLINKIN GMBH
Germany

Periodic Reporting for period 1 - BlinkIn Visual Assistant - June 2021 (BlinkIn Visual Assistance - Defining a new category of automated visual support towards to a visual AI Operating System for Europe (not Siri/Alexa). Our moonshot is to "Give the world a Help Button".)

Periodo di rendicontazione: 2023-02-01 al 2024-01-31

Sintesi del contesto e degli obiettivi generali del progetto

Blinkin aims to revolutionise the way technical problems are resolved in the real world by developing a platform that facilitates self-service for product users, supported by multimodal AI and backed by human experts. This initiative is driven by the need to address escalating service costs, diminishing professional service availability, and insufficient capabilities across various industries. The primary objective is to empower consumers to independently solve technical issues, such as setting up electronic devices or repairing home appliances, thereby reducing the burden on manufacturers’ customer support and field service teams while improving the time-to-resolution, the overall availability of support and the resources spent on each case. By doing so, Blinkin aligns the interests of consumers, professionals, and manufacturers, promoting efficiency, sustainability and self-reliance.

Lavoro eseguito dall’inizio del progetto fino alla fine del periodo coperto dalla relazione e principali risultati finora ottenuti

Blinkin has developed the platform for AI-boosted Companion Experiences, which will enable product companies to create and publish step-by-step guides through a vastly enhanced Blinkin No-Code AI Studio. It will allow them to pre-script digital self-service experiences for their customers end-to-end, thereby controlling the personalised user journey and outcome much more effectively.
A significant achievement in the project has been to include the utilisation of companies' existing repositories of multimodal data (images, text, videos, etc.) in the development of Small & Large Vision-Language models. These models can be built using a Hybrid Fusion ML approach, ensuring robust semantic representation across different data modalities.
Once published, the web applications allow end-users to engage in tasks like image/video/text question-answering and summarization, enriching the self-service experience with .
In case the AI-guided self-service attempts by individuals (professional or consumer) require an on-demand intervention from a human expert of the product company, the integration with Blinkin’s Help Desk enables agents to support the user directly, ensuring their personal service needs are fulfilled.

Progressi oltre lo stato dell’arte e potenziale impatto previsto (incluso l’impatto socioeconomico e le implicazioni sociali più ampie del progetto fino ad ora)

Blinkin's innovation ambition lies in its unique approach to cross-modal grounding, enabling the development of Vision-Language models that surpass traditional solutions in terms of efficiency and effectiveness.
The platform's future ability to leverage unstructured, unlabelled multimodal data to support complex problem-solving tasks represents a significant advancement. Our proposition aims to help organisations capture and unlock valuable knowledge hidden in vast amounts of their own data.
Another distinctive innovation is AI Studio, which provides an intuitive WYSIWYG no-code environment for transforming the aforementioned data into multimodal companions (specialised actionable web applications) in just minutes. The Studio also offers the option to automatically generate step-by-step guides from a selected source and deploy Visual AI as-you-go using only text prompts.
Moreover, the built-in seamless transition in the end-user experience from AI-fuelled self-service to live expert assistance - while securing the users’ individual progress in their self-service attempts - will ensure effective support beyond the state of the art in customer service.

blinkint-parta-img.jpg