Summary of the project

Nowadays, building and training such solutions to market is not very reliable, pending on external datasets quality. To improve actual systems, we propose a combination of state-of-the-art few-shot classifiers like CLIP, plus the addition of robust generative data augmentation such as Stable Diffusion and DreamBooth. This synergy of technologies will allow to build better AI image-based systems in terms of efficiency and quality. 
The main innovation of this project background in the integration of various state-of-the-art technologies for the development of a methodology to build more robust search engines, in automatic and explainable way, especially for scarce data of very specific domains that SMEs as end users may own. For building such systems, we propose a new methodology based on CLIP linear probing with a robust data augmentation based initially in to new generative models (Stable Diffusion and DreamBooth). 
Nowadays, scarcity of cross media data use to produce an unreliable training to data scientist. So, a robust data augmentation could be required rely in a better database with specific. Very specific domain images of a company cannot be extracted by the CLIP zero-shot methodology because the CLIP has never seen those kinds of images (out-of-domain). So, CLIP linear probing is required for re-training these new-domain images (fine-tuning the last layer). 
If a domain-drift is spotted (identifying new contexts in the user query images) a supervised data augmentation like DreamBooth can be used to generate the company items in these new scenarios/domains.

The team:

Raquel Espinosa
Javier Abellán
José Miguel Bolarín

COOKIES

AI4Media may use cookies to store your login data, collect statistics to optimize the website's functionality and to perform marketing actions based on your interests.

COOKIES
They allow you to browse the website and use its applications as well as to access secure areas of the website. Without these cookies, the services you have requested cannot be provided.
These cookies are necessary to allow the main functionality of the website and they are activated automatically when you enter this website. They store user preferences for site usage so that you do not need to reconfigure the site each time you visit it.
These cookies direct advertising according to the interests of each user so as to direct advertising campaigns, taking into account the tastes of users, and they also limit the number of times you see the ad, helping to measure the effectiveness of advertising and the success of the website organisation.

Required Cookies They allow you to browse the website and use its applications as well as to access secure areas of the website. Without these cookies, the services you have requested cannot be provided.

Functional Cookies These cookies are necessary to allow the main functionality of the website and they are activated automatically when you enter this website. They store user preferences for site usage so that you do not need to reconfigure the site each time you visit it.

Advertising Cookies These cookies direct advertising according to the interests of each user so as to direct advertising campaigns, taking into account the tastes of users, and they also limit the number of times you see the ad, helping to measure the effectiveness of advertising and the success of the website organisation.