It contains the intelligence generated by shoppers when they interact with a retailer, with its product and through any of its channels.
While Pinterest built its Taste Graph to power its internal personalization, the Fashion Taste API works with fashion retailers to build their own Fashion Taste Graph, retain the shoppers intelligence, and build their unique moat.
Omnichannel personalization solutions in fashion ecommerce
The Taste Profile of a fashion shopper summarizes her taste and the drivers behind her purchases. By having the clean and structured data of the shopper, an omnichannel personalization solution shows the shopper the clothes and products she is more likely to buy, in that specific moment.
Taste Profiles of fashion shoppers include the summary of 5 drivers: what products the shopper tends to like; what occasion she dresses for; what influences drive her purchases, if any; what brands she has in her closet (which can be captured with digital closets); and finally, wether the shopper is likely to buy trends or not.
Watch videos of the 4 best examples of omnichannel ecommerce personalization for fashion retail. Each of these real ecommerce examples have been built on top of the taste profiles of shoppers, so the experience is personalized to each of them.
1. In-Bedroom Fashion Stylish. You will WOW your shoppers!
Once you have the closet of your customer (see the Digital Closet below), the jump into her bedroom is a natural step. We’ve built a voice controlled automated fashion stylist, that will help your customers with their daily outfits. We can program the stylist to display your collection, so she can browse your catalogue while deciding what to wear. This devices will introduce your retail in your customer bedroom. We believe it is the Future of Fashion Retail and ecommerce.
2. In-Store Outfit Recommender. 2nd of the 4 Best Examples of Omnichannel eCommerce Personalization in Fashion Retail
The omnichannel experience can reach also your store. Your customer can scan a QR code, and automatically receive ideas to combine the items is planning to buy. And also ideas in real time to create complete looks with garments in your store.
All these ideas, once you have captured the interest of your client in a product, can be sent to your client via notification or newsletter to encourage new purchases and foster ecommerce sales.
3. Smart Fitting Room with Clothes and Outfit recommender
The omnichannel personalization technology has been provided by the Fashion Taste API, and their fashion taste graph. You can see below how customers are interacting with smart screens, smart digital closets and automated personal fashion stylists.
4. Digital closets. 4th of the 4 Best Examples of Omnichannel ecommerce Personalization in Fashion Retail
The forth of the 4 Examples of Omnichannel Personalization is Digital Closets.
Owning the closet of your client, you’ll be able to offer a memorable service that will also increase the effectiveness of any personalized omnichannel ecommerce recommendation. You won’t recommend what she already owns, but what she needs and likes. You’ll behave as a smart personal shopper in her pocket.
The Fashion Taste API digital closet includes a simple and non-friction system to capture the closet of your client. Her closet it’s a great source of information about her taste, her style, the brands she likes, and more.
Our personalization taste graph will combine her clothes, creating outfits as a personal stylist would do. And using the same internal process, they will also create outfits for her with the clothes of your catalog. They will solve her typical question “How could a wear this garment?” before she left your store. She will be more confident with her purchase, and the return possibilities will be totally reduced
Let’s finish with an outfit recommender that could be used in your fitting rooms or in ‘Personal stylist spots’ in your shop.
Those are only examples of what you can do understanding your customer, her needs and her closet.
Today we’ve talked about 4 personalized omnichannel examples that will impact in your final customer, creating a useful and memorable experience she won’t forget. All of them are based on the understanding of your customer taste, her needs, her closet and the behavior of similar customers. With all this information captured, you’ll be able offer a personal shopper assistant for each customer. Not only in-store, also at home or whenever she is.
And why a personal shopper experience will have impact in your company? The clear impact points will be:
Retention and fidelity of your customer
Decrease of returns, as your client will be more confident with her purchases
The Fashion Taste API algorithms mix and match the clothes of the shopper by using the intelligence generated in its Taste Graph, and filtering by the taste of the shopper, as previously defined by the Taste Profile created of her.
A Taste Graph is the tool to understand the taste of each individual shopper, what clothes she has in her closet, and what are the drivers behind her purchases. A Taste Profile summarizes the taste of an individual shopper, what clothes she has in her closet, and what are the drivers behind her purchases.
You can see a version of this digital closet technology by installing the Chicisimo iOS app.
The video above shows how a shopper is using her digital closet in an iPhone app, and how she is selecting one of her clothes. After doing that selection, the smart wardrobe offers her three services:
First, she sees the other clothes, so she can choose a second garment to obtain the results that we describe below;
Second, she sees complete outfits or ensambles with the first -or the two first- garment she’s selected, and the rest of the clothes in her closet;
Third, the digital closet shows how other women are wearing clothes similar to the one in her selection.
The technology to build this has been developed by the Fashion Taste API:
We are glad to interview Andrés Torrubia today, a successful tech entrepreneur with a strong background in artificial intelligence. What sets Andrés apart is his unique role here in the Spanish tech ecosystem, exposing us to AI in unique ways.
As a developer, he is a very active member of the international AI ecosystem and brings that experience back to us. “Machine learning communities are vibrant and welcoming. Teaming up with others is a norm rather than the exception“, he says below.
And as you’ll see as you read the interview, Andrés can help us understand how the world will look like, when ruled by Chinese and US AI superpowers. “We are letting core infrastructure (finance, telecommunications, news, etc.) in the hands of foreign players“, he argues.
Andres (@antor, 44) likes to say that he has the luxury of living in near the beach in Alicante (Spain) while working in the US through FIXR.COM. He has participated in multiple deep learning competitions, most notably he finished #1 in a Self-driving car LIDAR point cloud segmentation challenge organized by Alibaba in China competing against 1400+ teams.
In this interview, we mostly wanted to ask him about how AI might impact our lives, and how to be prepared for it.
We’ve all been hearing about AI for a long time, but something has changed in the last few years. How AI is different now than it was 10 years ago? What has changed?
Deep learning is the single reason AI is in the news today. Thanks to deep learning, AI has become effective, useful and more accesible.
While most of the theory and methods that support supervised deep learning are more than a decade old, the surge in availability of datasets and computing power has allowed deep learning to achieve results that many in the industry thought would take much longer.
Some countries with very different political systems to ours are investing heavily on AI, much more than Europe. This might bring some challenges to Europeans. How do you see Europe in a world where others dominate AI? What consequences do you think this could have?
AI is a general purpose technology that will be used across many industries and facets of society, even those that have been relatively immune to information technology disruption.
Unfortunately in Europe -at least in technology- we have a history in investing in core research but fail to leverage those investments commercially. The web was invented in Europe (CERN), yet the only originally European web browser is almost history (Opera); the MP3 audio compression format was invented in Germany, yet multimedia codec licensing is a US operation (MPEG LA), etc. The more you look at the value chain from fundamental research to consumer commercialization, the more you see US (and recently Chinese) companies making inroads in our daily lives; with local (European) players getting a smaller piece of the action.
In Europe -at least in technology- we have a history in investing in core research but fail to leverage those investments commercially.
This trend has already happened in the information economy and AI will accelerate it even more due to its self-reinforcement cycle: good AI companies gather more data, with more data they will build better products, which they will commercialize and reap more profits, which they will use to hire the best talent which in turn adds a positive loop in the cycle.
In the same way that it is almost impossible to compete with Google in the search engine business, it will be very difficult if not impossible to compete with Google, Amazon or Apple in voice recognition due the massive advantage they have in data (each time we use their system we are helping them make them better), resources and talent to build AI voice recognition products.
In contrast to Europe, China has used a combination of:
1) asymmetry (making it difficult or impossible for foreign tech companies to compete in the Chinese market while importing technology and know-how to China from those countries) and,
2) a sharp multi-level focus to build its AI ecosystem: education, incentives to bring talent working abroad back to China, loose regulation, data sharing, financial incentives, etc.
I believe the consequences of not having a strong AI industry are two-fold:
1) Economic influence: in a similar way that a bigger share of the information economy is being played by US companies, AI will make it feasible for these companies to cross the line from the information economy to the physical economy. For example: the last mile of (e.g. Amazon) package delivery is done by a local courier, soon it could be done by autonomous drones powered by AI.
As AI becomes infrastructure, we are letting core infrastructure (finance, telecommunications, news, etc.) in the hands of foreign players.
2) Trust: as AI becomes infrastructure, we are letting core infrastructure (finance, telecommunications, news, etc.) in the hands of foreign players, which is ok as long as they are friendly but even if they are there is an evident risk of misalignment of values. The US sees healthcare and education differently than us in Europe, and China has a different view altogether. This will become an issue if Chinese censorship starts happening outside China as they gain more influence globally.
European regulation intends to defend citizens. Do you think all this regulation is a disadvantage for EU tech companies, compared to their US and Asian counterparts?
I think it is a bit more complex. In the US antitrust laws are intended to protect consumers, not competitors. European regulation may be well intended but in my opinion badly executed, for two reasons:
Early regulation can severely hamper success of emerging companies, especially startups. In the US and China (at least in technology) the tendency has been to leave markets loosely regulated to allow small companies and entrepreneurs to focus on product market fit without spending precious resources in legalese and compliance. Once those small start-ups get bigger (think Google, Amazon, etc.) they welcome regulation because they can afford to spend on compliance and they know new contenders cannot.
Execution. We are in a sad state of affairs when technology companies like Google pay more in fines to the European Commission than in taxes, when the user experience to browse the web is utterly destroyed with the pretext of cookie disclaimers, information sharing (which could have been done at the browser level), when focus is placed on privacy and not human manipulation at scale, etc.
How do you think we could influence our politicians to make better technology decisions?
We need a much stronger technology industry in Europe. If you look at the European stock exchanges and compare them to the US and Asia, Europe top stocks look more similar to those of the 80s than in the US (we do not have Googles, Facebooks, Amazons, Netflix, etc.).
Some would say that technology and AI by extension can bring a lot of benefits to society: highly-paid jobs, money in the form of tax receipts, and progress. While this is true I think it is short-sighted. The challenges we are going to face in the next decades are immense: an ecology crisis positively reinforced by more energy demand, growing and aging population, disruptive job displacement, wealth inequality and international tensions.
I see technology and AI as a matter of survival. Same as when countries used to mobilize all of their precious resources when at war
I see technology and AI as a matter of survival. In the same way that countries used to mobilize all of their precious resources when at war, we should acknowledge that the world is entering uncharted territory and the two solutions to go by are either to look back to the past (and give up many of the rights and benefits we’ve worked hard to earn, like healthcare, education, freedom. etc.) or invest in science to help us conquer the next stage of human welfare.
No political discourse that I know of has technology, science and the scientific method as its main toolbox. We owe our world to fundamental discoveries in physics which supported by math gave birth to our technological society with all of it benefits. I think it’s time to move from nineteen century politics and devise a social system that while it may look utopian today could be achieved thanks to science and technology.
You are the co-founder and CEO of Fixr.com and Howmuch.net, and you use AI to solve a number of problems there. Could you give us an estimate of the % of revenue that you attribute to using AI? I know it’s not an easy question:) Do you think your competitors not using AI are less efficient in their business model?
Our case is very specific, what I can say is that the majority of our growth is due to AI.
You participate in many AI international competitions. Can you please describe the process? The first steps and how it evolves. Meaning: you start DiDi’s challenge competing alone against thousands of other engineers, then you partner with a Russian nuclear physicist… For a beginner, all that process is kind of frightening. Tell us about it please.
Get your hands dirty.
No matter how much you read, nothing compares to building your code from scratch. The first step is to download the dataset and build an intimate relationship with the data. I like to do some exploratory data analysis (EDA) rather than treating data as a black box. The process looks a lot more like interactive programming in BASIC from the 80s rather than regular, boring, boilerplate software engineering in Java. Many machine learning practitioners use Python inside Jupyter notebooks which allows to extremely fast experimentation and immediacy.
In competitions you do not have time to create completely new deep learning architectures, so instead you should get familiar with the data and focus your strategy on how to use your limited resources to train your system in the most efficient way. More often than not, labelled data contain errors so part of your strategy should be how to deal with them: use them anyway, fix them, discard them, etc.
Machine learning communities are vibrant and welcoming. Teaming up with others is a norm rather than the exception as sharing tricks, techniques and tools with people from diverse backgrounds is incredibly enriching. It may look daunting, but it is not.
Machines can read images, more and more. Be bold: what is the biggest change this will bring?
Computational perception has been in my opinion one of the Achilles heels of the IT industry. We do not realize but many common actions we perform daily are the result of us adapting our natural behavior to make it easier for computers to understand us.
We have to drive cars manually not because computers cannot control cars but because computers do not understand the exterior environment of a car (obstacles, pedestrians, etc.).
When we go to a supermarket we have to be in line for a while and go though the cash registry where they scan every item we bring. We do so because the computer cannot determine what we’ve taken without us almost spelling it for them.
Those are just two perception applications, but huge ones. From a product management perspective the way I think of perception AI is: how would the user experience look like if they had a person with them translating what they see and ear in real time to a computer? AI makes this potentially doable.
The convenience that this will bring will be great, the danger again is not privacy, but the potential use of this perceptual data to perform individual manipulation at scale. Personally, I am totally fine walking into a store and have my face recognized as I take a bunch of snacks and have the supermarket charge them to my account directly without going to the hassle of waiting in line through the cashier, etc; but not at the expense of the supermarket leveraging this data for other purposes or worse still selling it to other parties to build a super detailed profile of me that would eventually be so precise that they would know which ads would trigger my desire to buy a certain product or even worse coerce me into doing something (without me even realizing it).
Cities are big generators of data. Apart from autonomous vehicles, what’s going to change?
I wish that city management (and by extension city politics) was more driven where data is available, so the first step is to collect and make city data transparent. I am not a smart city expert, but I think governments are pretty bad at picking winners, so my thinking would be to make the data available, identify the problems first and then devise solutions. As an engineer / entrepreneur sometimes is tempting to fall in love with the solution to a problem, but it should be the other way around: you have to fall in love with the problem, and then find the best solution.
An engineer wants to learn AI. Where should she start?
Learn by doing. I really recommend taking Fast.ai courses and then participate in small projects or competitions. If not an engineer, take the AI for everyone by Andrew Ng.
Last question: you are being interviewed by Chicisimo – you know we’ve built the Fashion Taste API to help fashion retailers understand the taste of each individual shopper. We think AI and data are going to transform fashion. And you? How do you think that AI will change fashion?
Oh! If you saw my closet you would understand why I am not even qualified to answer your question and if you captured my data I would be an outlier in your dataset ;-).
Hope you enjoyed the interview. There are some many gems in it, it’s difficult to decide what’s the best part . Thanks for reading!
We learnt that two important questions were: How do people describe their clothes, outfits and what-to-wear needs? What clothes do they have in their closets and how do they wear them? In order to respond to these questions, we built a fashion ontology and a taste graph, and all the infrastructure to automate outfit advice.
An outfit is aplaylist of clothes. It is also a correlated list of descriptors: it can be comfy, or perfect for the weekend. An outfit contains correlations among clothes, and the deep meaning that a person assigns to her clothing preferences. Outfits provide a unique perspective into closets.
Taste graphs bring a unique opportunity to own the fashion space
The biggest opportunity in fashion technology today is to build a mechanism to understand post-purchase clothing behaviour. And then, build technology on top of that understanding: technology to help people feel better with their clothes.
Traditional tech efforts focus on efficiently selling more clothes to people, and ignore the post-purchase experience. Once the purchase is finished, companies are blind and can’t see what happens next.
Offering a post-purchase experience that helps people feel well with their clothes, will let the winner own people’s attention, and so many more things as a result.
Taste graphs will power a Spotify for fashion
A Spotify for fashion will understand your taste and needs, because it’ll be powered by a taste graph.
It will help you decide what to wear at any time. You’ll be able to easily store your clothes in a virtual closet, and it will put outfits together for you. It will help you plan your outfits depending on your context, and will suggest new clothes that match your wardrobe.
Helping people feel well with their clothes will be the key functionality of such a service. People want to feel well with their outfits. They want to feel confident, comfortable, happy, beautiful, unique, sexy, stylish, powerful. Instead of that, many people feel stressed or bored or tiny. More than about clothes, it’s about wellness.
1.- Capture units of taste data
Before we try to understand taste, we need to understand what type of data we need to focus on. Spotify focuses mostly on playcounts (each time you listen to a song), and a playcount clearly defines your current behaviour.
We have learnt that the units of capturable taste data are related to text and images. Words express a need (“i need ideas to go to the office”). Images ofclothes represent the clothes people own, and need help with. There are other units of capturable taste data, but it comes down to text and images. Then, in our mobile app we’ve built different easy-to-use input interfaces to capture data and allow people to communicate with the system. You can also see our In-Bedroom Fashion Stylist and our Digital Closet technology.
2.- An Ontology to understand fashion data
But fashion has a problem: it lacks a common classification system. The expression of clothing behaviour is very fragmented: text and images have different meanings for each person, and each person expresses the same concept differently. Due to the lack of this classification (or taxonomy), people’s data is noisy and algorithms cannot work with it. To solve this problem, we’ve built a fashion ontology, which is the backbone of our taste graph.
Our ontology gives structure and meaning to the incoming data. It allows us to interpret data. It is a multilevel “list” of hundreds of thousands of unique ways to describe what-to-wear needs. Think of Netflix initial classification system or Google’s synonym matching.
A derivative of our main ontology is our ontology of meta-garments, abstractions of specific garments. These meta-garments are the result of another learning: only certain attributes of a garment are relevant when solving the problem at hand. This ontology is 100% user-driven, it’s been built from the bottom up, and it is the result of the need to help people with their outfit needs.
3.- Taste graphs to understand fashion taste
When we get dressed in the mornings, we establish correlations among clothes, and among our ways of describing our outfits and needs. Look at yourself today: you are wearing a playlist of correlated descriptors and clothes. You’ve built an offline taste graph.
Taste graphs capture those correlations among descriptors, outfits and people. Think of it as a brain that understands “what goes well with” any garment, or for any occasion, etc. It has this understanding because it analyzes hundreds of millions of correlations, outfits and queries. Then, it filters them to your specific characteristics and context.
Our taste graph allows us to respond with output to any input. We call it the Social Fashion Graph and we patented it back in 2012. You might think that the image below is super simple, but that’s how simple we want the system to be: receive input > produce output.
The end game
Taste graphs will provide structured and correlated taste data. And then will allow teams to build personalized and meaningful services for each person. Our closets will be taste graphs connected to ecommerces catalogues (also graphs), and everything will change. Taste graphs will transform fashion. Head over to the Fashion Taste API to learn more.
The largest opportunity is fashion technology today is to focus on helping people feel better with their clothes. To do so, we need to understand fashion taste. Once we achieve that, we will be able to build personalized experiences on top of people’s unique taste.
But understanding fashion taste and clothing behaviour at scale is a difficult challenge. That’s our focus at the Fashion Taste API. We are building the infrastructure to automate outfit advice. This infrastructure includes four assets:
1.- A fashion app that has virtual closet. The app helps women as an outfit planning app and Apple features regularly features as App of the Day world-wide. The app helps us learn outfit and clothes behaviour;
2.- A taste graph that is in charge of structuring fashion data, and assigning the right descriptors to outfits and to people. In fashion technology, obtaining clean data is not easy because of the lack of a fashion taxonomy. We’ve built a fashion ontology, and we’ve embedded it into the taste graph that helps us solve this problem. The Social Fashion Graph, that’s how we call our taste graph;
3.- A data portal. This portal provides transparency to the team, and ease of access to data;
4.- Fashion technology patents. These patents protect innovations in three fields: image-based shopping, outfit and closet data, and outfits search.
Are you interested in fashion technology? Please read more about the Fashion Taste API.
About a year ago, we shared our approach and our vision on how we’ve applied machine learning to helping women plan their outfits and use a virtual closet. We didn’t have a blog back then, so we shared our thoughts on Medium. Now, we want to link to it from here.
In that post, we focused on the following aspects: