The Role of Image Recognition at Virtusize

The Role of Image Recognition at Virtusize

The Role of Image Recognition at Virtusize

< Figure 1: Types of image recognition. >


Why does Virtusize need computer vision?

Choosing the right size when shopping for clothes online is hard. At Virtusize, our main goal is to make that decision easy, and machine learning plays a big role in achieving that. One branch of machine learning is computer vision, which among other things includes image recognition, and is a particularly useful tool in fashion tech. Even a task as simple as scraping the product type, whether an item is a pair of pants or a skirt for example, could be tricky on some product pages. In those cases, we need image recognition to know what the product type is. Another important use case is extracting product measurements from pdf tables using optical character recognition(OCR). Furthermore, image recognition is the only method that can be used at scale to predict the style or fit of a product, because product descriptions usually don’t have that type of information. Is this sweater a cardigan or a pullover? Is this skirt tight or flared? Questions like these can be answered after training models on thousands of images to tell the difference between various categories.

What is image recognition?

There are several types of image recognition as seen in Figure 1. The simplest one is classification. That’s when a model assigns a single label to an image. If a model is trained to tell the difference between tight and flared skirts, then after receiving an image it will output “flared”, for example. A classification and localization model will draw a bounding box around the item of interest before classifying it. This could be useful for images with particularly busy backgrounds. If multiple objects need to be

< Figure 2: The architecture of VGG16 algorithm. >

recognized, then object detection is the best choice. Every object in the list of possible categories will get a bounding box and a label. For tasks that require knowing the shape of an object, semantic or instance segmentation is needed. Semantic segmentation recognizes each category as a unit while instance segmentation gives a separate shape to each object in the class.

What is transfer learning?

Image classification models require a lot of images and a lot of time to train them. For example, a well-known convolutional neural network model proposed in 2014 calledVGG16 [1] took more than two weeks to train on 14 million images belonging to one thousand categories. If you don’t have thousands of images for each category and lack access to GPUs (computing power), transfer learning is a good solution. As an example, let’s look at VGG16’s architecture shown in Figure 2. For a model that predicts flared vs. tight skirts, the simplest thing to do would be to replace the very last layer that outputs a one thousand dimensional vector into a layer that outputs a two dimensional vector. Then only that last layer needs to be retrained while keeping the weights of all the other layers fixed.If that doesn’t give accurate results, the weights from the first couple of layers can be fixed while the other layers are retrained. This way a model keeps what it learned from millions of images about recognizing basic shapes and textures while still identifying the specific characteristics of your images. If one architecture doesn’t achieve desired accuracy, one can always try others. There are many pretrained models these days:Inception, ResNet, MobileNet, DenseNet, etc.

< Figure 3: An image recognition model can categorize jackets into different styles: fashionable, formal, and protective. >

How does image recognition improve our product?

Below are a couple of examples of how computer vision helps us improve user experience for Virtusize users. An online store will often combine all kinds of jackets into one category. A puffy winter jacket will be under the same category as a thin leatherjacket, for example. Recommending a size becomes tricky if we don’t know whether several other garments are meant to be worn underneath. Having an image recognition model label a jacket as “protective” lets us know that an item should be somewhat loose since it will be worn over shirts or sweaters.This idea of intended fit applies to any kind of garment. A sweater could be very tight or loose depending on the style as shown in Figure 4. The only way to know the intended fit of an item is to look at its image, and the only way to do it at scale is with computer vision. Knowing that a shirt is supposed to be tight prevents us from recommending a size that is too large. These are just a few of the several applications of computer vision at Virtusize. Hopefully this post provides a good introduction to image recognition and its potential in fashion tech.

< Figure 4: An image recognition model can predict whether an item’s intended fit istight, regular, or loose. >

References

[1] Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks ForLarge-Scale Image Recognition. https://arxiv.org/pdf/1409.1556.pdf

< Figure 1: Types of image recognition. >


Why does Virtusize need computer vision?

Choosing the right size when shopping for clothes online is hard. At Virtusize, our main goal is to make that decision easy, and machine learning plays a big role in achieving that. One branch of machine learning is computer vision, which among other things includes image recognition, and is a particularly useful tool in fashion tech. Even a task as simple as scraping the product type, whether an item is a pair of pants or a skirt for example, could be tricky on some product pages. In those cases, we need image recognition to know what the product type is. Another important use case is extracting product measurements from pdf tables using optical character recognition(OCR). Furthermore, image recognition is the only method that can be used at scale to predict the style or fit of a product, because product descriptions usually don’t have that type of information. Is this sweater a cardigan or a pullover? Is this skirt tight or flared? Questions like these can be answered after training models on thousands of images to tell the difference between various categories.

What is image recognition?

There are several types of image recognition as seen in Figure 1. The simplest one is classification. That’s when a model assigns a single label to an image. If a model is trained to tell the difference between tight and flared skirts, then after receiving an image it will output “flared”, for example. A classification and localization model will draw a bounding box around the item of interest before classifying it. This could be useful for images with particularly busy backgrounds. If multiple objects need to be

< Figure 2: The architecture of VGG16 algorithm. >

recognized, then object detection is the best choice. Every object in the list of possible categories will get a bounding box and a label. For tasks that require knowing the shape of an object, semantic or instance segmentation is needed. Semantic segmentation recognizes each category as a unit while instance segmentation gives a separate shape to each object in the class.

What is transfer learning?

Image classification models require a lot of images and a lot of time to train them. For example, a well-known convolutional neural network model proposed in 2014 calledVGG16 [1] took more than two weeks to train on 14 million images belonging to one thousand categories. If you don’t have thousands of images for each category and lack access to GPUs (computing power), transfer learning is a good solution. As an example, let’s look at VGG16’s architecture shown in Figure 2. For a model that predicts flared vs. tight skirts, the simplest thing to do would be to replace the very last layer that outputs a one thousand dimensional vector into a layer that outputs a two dimensional vector. Then only that last layer needs to be retrained while keeping the weights of all the other layers fixed.If that doesn’t give accurate results, the weights from the first couple of layers can be fixed while the other layers are retrained. This way a model keeps what it learned from millions of images about recognizing basic shapes and textures while still identifying the specific characteristics of your images. If one architecture doesn’t achieve desired accuracy, one can always try others. There are many pretrained models these days:Inception, ResNet, MobileNet, DenseNet, etc.

< Figure 3: An image recognition model can categorize jackets into different styles: fashionable, formal, and protective. >

How does image recognition improve our product?

Below are a couple of examples of how computer vision helps us improve user experience for Virtusize users. An online store will often combine all kinds of jackets into one category. A puffy winter jacket will be under the same category as a thin leatherjacket, for example. Recommending a size becomes tricky if we don’t know whether several other garments are meant to be worn underneath. Having an image recognition model label a jacket as “protective” lets us know that an item should be somewhat loose since it will be worn over shirts or sweaters.This idea of intended fit applies to any kind of garment. A sweater could be very tight or loose depending on the style as shown in Figure 4. The only way to know the intended fit of an item is to look at its image, and the only way to do it at scale is with computer vision. Knowing that a shirt is supposed to be tight prevents us from recommending a size that is too large. These are just a few of the several applications of computer vision at Virtusize. Hopefully this post provides a good introduction to image recognition and its potential in fashion tech.

< Figure 4: An image recognition model can predict whether an item’s intended fit istight, regular, or loose. >

References

[1] Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks ForLarge-Scale Image Recognition. https://arxiv.org/pdf/1409.1556.pdf

< Figure 1: Types of image recognition. >


Why does Virtusize need computer vision?

Choosing the right size when shopping for clothes online is hard. At Virtusize, our main goal is to make that decision easy, and machine learning plays a big role in achieving that. One branch of machine learning is computer vision, which among other things includes image recognition, and is a particularly useful tool in fashion tech. Even a task as simple as scraping the product type, whether an item is a pair of pants or a skirt for example, could be tricky on some product pages. In those cases, we need image recognition to know what the product type is. Another important use case is extracting product measurements from pdf tables using optical character recognition(OCR). Furthermore, image recognition is the only method that can be used at scale to predict the style or fit of a product, because product descriptions usually don’t have that type of information. Is this sweater a cardigan or a pullover? Is this skirt tight or flared? Questions like these can be answered after training models on thousands of images to tell the difference between various categories.

What is image recognition?

There are several types of image recognition as seen in Figure 1. The simplest one is classification. That’s when a model assigns a single label to an image. If a model is trained to tell the difference between tight and flared skirts, then after receiving an image it will output “flared”, for example. A classification and localization model will draw a bounding box around the item of interest before classifying it. This could be useful for images with particularly busy backgrounds. If multiple objects need to be

< Figure 2: The architecture of VGG16 algorithm. >

recognized, then object detection is the best choice. Every object in the list of possible categories will get a bounding box and a label. For tasks that require knowing the shape of an object, semantic or instance segmentation is needed. Semantic segmentation recognizes each category as a unit while instance segmentation gives a separate shape to each object in the class.

What is transfer learning?

Image classification models require a lot of images and a lot of time to train them. For example, a well-known convolutional neural network model proposed in 2014 calledVGG16 [1] took more than two weeks to train on 14 million images belonging to one thousand categories. If you don’t have thousands of images for each category and lack access to GPUs (computing power), transfer learning is a good solution. As an example, let’s look at VGG16’s architecture shown in Figure 2. For a model that predicts flared vs. tight skirts, the simplest thing to do would be to replace the very last layer that outputs a one thousand dimensional vector into a layer that outputs a two dimensional vector. Then only that last layer needs to be retrained while keeping the weights of all the other layers fixed.If that doesn’t give accurate results, the weights from the first couple of layers can be fixed while the other layers are retrained. This way a model keeps what it learned from millions of images about recognizing basic shapes and textures while still identifying the specific characteristics of your images. If one architecture doesn’t achieve desired accuracy, one can always try others. There are many pretrained models these days:Inception, ResNet, MobileNet, DenseNet, etc.

< Figure 3: An image recognition model can categorize jackets into different styles: fashionable, formal, and protective. >

How does image recognition improve our product?

Below are a couple of examples of how computer vision helps us improve user experience for Virtusize users. An online store will often combine all kinds of jackets into one category. A puffy winter jacket will be under the same category as a thin leatherjacket, for example. Recommending a size becomes tricky if we don’t know whether several other garments are meant to be worn underneath. Having an image recognition model label a jacket as “protective” lets us know that an item should be somewhat loose since it will be worn over shirts or sweaters.This idea of intended fit applies to any kind of garment. A sweater could be very tight or loose depending on the style as shown in Figure 4. The only way to know the intended fit of an item is to look at its image, and the only way to do it at scale is with computer vision. Knowing that a shirt is supposed to be tight prevents us from recommending a size that is too large. These are just a few of the several applications of computer vision at Virtusize. Hopefully this post provides a good introduction to image recognition and its potential in fashion tech.

< Figure 4: An image recognition model can predict whether an item’s intended fit istight, regular, or loose. >

References

[1] Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks ForLarge-Scale Image Recognition. https://arxiv.org/pdf/1409.1556.pdf

Tell us more about you to download

ありがとうございます!下のボタンより資料をダウンロードしてください。
ダウンロード
Oops! Something went wrong while submitting the form.
Thank you! Please download the file below.
Download a file
Oops! Something went wrong while submitting the form.
감사합니다! 파일을 다운로드해주세요!
파일 다운로드
Oops! Something went wrong while submitting the form.

Up next

全く新しいレコメンドサービス「FittingRoom Discovery」を提供開始しました!

サイズレコメンド改善に関する記事を公開しました!

バーチャル試着の「Virtusize」、diadora テニス公式ショップへ提供開始

【イベント登壇】日本ネット経済新聞社主催のウェビナーイベントに弊社CEO:Andreasが登壇いたしました!

【ファッション通販サイト|SHEL'TTER WEBSTORE調査】バーチャル試着Virtusize利用者のうち、90%以上が「今後も継続的に利用するつもり」と回答

[Product update]スーツケースの表示が変わりました

Virtusize, a virtual fitting solution, starts providing services to diadora Tennis Official Shop

[SHEL'TTER WEBSTORE Survey] More than 90% of virtual try-on Virtusize users say they intend to continue using the site in the future.

[Media Coverage] An interview with our CEO: Andreas was published in the Senken Shinbun!

New Partner - Felissimo

The E-Commerce Fit Dilemma: The Returns Problem in Online Fashion and how to Solve it

Media Coverage: Article about Virtusize's patent acquisition was published in Japan Net Keizai Shinbun!

글로벌 온라인 피팅 솔루션 버츄사이즈, 영국 프리미엄 컨템포러리 브랜드 올세인츠(Allsaints)에 서비스 제공 시작

버츄사이즈, 아웃도어 브랜드 네파(NEPA)에 서비스 제공

입어볼 수 없다면, 가지고 있는 옷과 비교해보세요. 사이즈 솔루션 ‘버츄사이즈’

버츄사이즈, 온라인 쇼핑 솔루션 새 버전 출시

코로나(COVID-19) 바이러스가 일본 패션시장에 미친 영향

비대면 패션/유통 부상한다

The Role of Image Recognition at Virtusize

< Figure 1: Types of image recognition. >


Why does Virtusize need computer vision?

Choosing the right size when shopping for clothes online is hard. At Virtusize, our main goal is to make that decision easy, and machine learning plays a big role in achieving that. One branch of machine learning is computer vision, which among other things includes image recognition, and is a particularly useful tool in fashion tech. Even a task as simple as scraping the product type, whether an item is a pair of pants or a skirt for example, could be tricky on some product pages. In those cases, we need image recognition to know what the product type is. Another important use case is extracting product measurements from pdf tables using optical character recognition(OCR). Furthermore, image recognition is the only method that can be used at scale to predict the style or fit of a product, because product descriptions usually don’t have that type of information. Is this sweater a cardigan or a pullover? Is this skirt tight or flared? Questions like these can be answered after training models on thousands of images to tell the difference between various categories.

What is image recognition?

There are several types of image recognition as seen in Figure 1. The simplest one is classification. That’s when a model assigns a single label to an image. If a model is trained to tell the difference between tight and flared skirts, then after receiving an image it will output “flared”, for example. A classification and localization model will draw a bounding box around the item of interest before classifying it. This could be useful for images with particularly busy backgrounds. If multiple objects need to be

< Figure 2: The architecture of VGG16 algorithm. >

recognized, then object detection is the best choice. Every object in the list of possible categories will get a bounding box and a label. For tasks that require knowing the shape of an object, semantic or instance segmentation is needed. Semantic segmentation recognizes each category as a unit while instance segmentation gives a separate shape to each object in the class.

What is transfer learning?

Image classification models require a lot of images and a lot of time to train them. For example, a well-known convolutional neural network model proposed in 2014 calledVGG16 [1] took more than two weeks to train on 14 million images belonging to one thousand categories. If you don’t have thousands of images for each category and lack access to GPUs (computing power), transfer learning is a good solution. As an example, let’s look at VGG16’s architecture shown in Figure 2. For a model that predicts flared vs. tight skirts, the simplest thing to do would be to replace the very last layer that outputs a one thousand dimensional vector into a layer that outputs a two dimensional vector. Then only that last layer needs to be retrained while keeping the weights of all the other layers fixed.If that doesn’t give accurate results, the weights from the first couple of layers can be fixed while the other layers are retrained. This way a model keeps what it learned from millions of images about recognizing basic shapes and textures while still identifying the specific characteristics of your images. If one architecture doesn’t achieve desired accuracy, one can always try others. There are many pretrained models these days:Inception, ResNet, MobileNet, DenseNet, etc.

< Figure 3: An image recognition model can categorize jackets into different styles: fashionable, formal, and protective. >

How does image recognition improve our product?

Below are a couple of examples of how computer vision helps us improve user experience for Virtusize users. An online store will often combine all kinds of jackets into one category. A puffy winter jacket will be under the same category as a thin leatherjacket, for example. Recommending a size becomes tricky if we don’t know whether several other garments are meant to be worn underneath. Having an image recognition model label a jacket as “protective” lets us know that an item should be somewhat loose since it will be worn over shirts or sweaters.This idea of intended fit applies to any kind of garment. A sweater could be very tight or loose depending on the style as shown in Figure 4. The only way to know the intended fit of an item is to look at its image, and the only way to do it at scale is with computer vision. Knowing that a shirt is supposed to be tight prevents us from recommending a size that is too large. These are just a few of the several applications of computer vision at Virtusize. Hopefully this post provides a good introduction to image recognition and its potential in fashion tech.

< Figure 4: An image recognition model can predict whether an item’s intended fit istight, regular, or loose. >

References

[1] Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks ForLarge-Scale Image Recognition. https://arxiv.org/pdf/1409.1556.pdf

< Figure 1: Types of image recognition. >


Why does Virtusize need computer vision?

Choosing the right size when shopping for clothes online is hard. At Virtusize, our main goal is to make that decision easy, and machine learning plays a big role in achieving that. One branch of machine learning is computer vision, which among other things includes image recognition, and is a particularly useful tool in fashion tech. Even a task as simple as scraping the product type, whether an item is a pair of pants or a skirt for example, could be tricky on some product pages. In those cases, we need image recognition to know what the product type is. Another important use case is extracting product measurements from pdf tables using optical character recognition(OCR). Furthermore, image recognition is the only method that can be used at scale to predict the style or fit of a product, because product descriptions usually don’t have that type of information. Is this sweater a cardigan or a pullover? Is this skirt tight or flared? Questions like these can be answered after training models on thousands of images to tell the difference between various categories.

What is image recognition?

There are several types of image recognition as seen in Figure 1. The simplest one is classification. That’s when a model assigns a single label to an image. If a model is trained to tell the difference between tight and flared skirts, then after receiving an image it will output “flared”, for example. A classification and localization model will draw a bounding box around the item of interest before classifying it. This could be useful for images with particularly busy backgrounds. If multiple objects need to be

< Figure 2: The architecture of VGG16 algorithm. >

recognized, then object detection is the best choice. Every object in the list of possible categories will get a bounding box and a label. For tasks that require knowing the shape of an object, semantic or instance segmentation is needed. Semantic segmentation recognizes each category as a unit while instance segmentation gives a separate shape to each object in the class.

What is transfer learning?

Image classification models require a lot of images and a lot of time to train them. For example, a well-known convolutional neural network model proposed in 2014 calledVGG16 [1] took more than two weeks to train on 14 million images belonging to one thousand categories. If you don’t have thousands of images for each category and lack access to GPUs (computing power), transfer learning is a good solution. As an example, let’s look at VGG16’s architecture shown in Figure 2. For a model that predicts flared vs. tight skirts, the simplest thing to do would be to replace the very last layer that outputs a one thousand dimensional vector into a layer that outputs a two dimensional vector. Then only that last layer needs to be retrained while keeping the weights of all the other layers fixed.If that doesn’t give accurate results, the weights from the first couple of layers can be fixed while the other layers are retrained. This way a model keeps what it learned from millions of images about recognizing basic shapes and textures while still identifying the specific characteristics of your images. If one architecture doesn’t achieve desired accuracy, one can always try others. There are many pretrained models these days:Inception, ResNet, MobileNet, DenseNet, etc.

< Figure 3: An image recognition model can categorize jackets into different styles: fashionable, formal, and protective. >

How does image recognition improve our product?

Below are a couple of examples of how computer vision helps us improve user experience for Virtusize users. An online store will often combine all kinds of jackets into one category. A puffy winter jacket will be under the same category as a thin leatherjacket, for example. Recommending a size becomes tricky if we don’t know whether several other garments are meant to be worn underneath. Having an image recognition model label a jacket as “protective” lets us know that an item should be somewhat loose since it will be worn over shirts or sweaters.This idea of intended fit applies to any kind of garment. A sweater could be very tight or loose depending on the style as shown in Figure 4. The only way to know the intended fit of an item is to look at its image, and the only way to do it at scale is with computer vision. Knowing that a shirt is supposed to be tight prevents us from recommending a size that is too large. These are just a few of the several applications of computer vision at Virtusize. Hopefully this post provides a good introduction to image recognition and its potential in fashion tech.

< Figure 4: An image recognition model can predict whether an item’s intended fit istight, regular, or loose. >

References

[1] Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks ForLarge-Scale Image Recognition. https://arxiv.org/pdf/1409.1556.pdf

Up next

全く新しいレコメンドサービス「FittingRoom Discovery」を提供開始しました!

サイズレコメンド改善に関する記事を公開しました!

バーチャル試着の「Virtusize」、diadora テニス公式ショップへ提供開始

【イベント登壇】日本ネット経済新聞社主催のウェビナーイベントに弊社CEO:Andreasが登壇いたしました!

【ファッション通販サイト|SHEL'TTER WEBSTORE調査】バーチャル試着Virtusize利用者のうち、90%以上が「今後も継続的に利用するつもり」と回答

[Product update]スーツケースの表示が変わりました

「理想のファッションに出会える」
ECサイトをビジネスの強みにしませんか?

お問い合せ