Objects on images indexing

    July 11, 2019

    There is an enormous amount of visual information in the world. The most actual task is to find exactly what you need. Instead of Google image search, there are a lot of specific tasks with a limited number of object types on images tagging and indexing.

    Let’s look at the computer vision technologies usage example for detecting wedding accessories and classify them, providing information on different accessories characteristics provided in the table below.

    wedding accessories classification

    Technology

    The first step of this project is the data labeling. The customer has provided a dataset of wedding photos without any labeling. And we used Amazon MTurk service to provide such.

    Amazon pipeline consists оf :

    1. HTML template, which workers used for drawing bounding box and select the label.
    wedding rings detection
    Rings

    The second step was to train a neural network for category detection. We tested several neural net architectures, as MobileNet, NasNet, ResNet, YOLO to find the best accuracy/speed ratio. Finally, YOLOv2 neural net was trained on the labeled dataset.

    wedding Bouquet detection
    Bouquet                                                              

    The third step was to train an ensemble of models to make classification of detected categories by tags. We used PyTorch pre-trained vgg16 models to train it on a labeled dataset.

    Bride detection
    Bride
    detection characteristics
    The demonstrated approach may be used in eCommerce to automate image tagging. It’s applicable also for quick search of goods with similar characteristics.
    • #Computer vision
    • #Data science
    • #Image recognition
    • #Machine learning
    • #Object detection

    Share Article

    Success stories

    LLM-based financial investment advisory chatbot
    #FinTech
    #Large Language Model
    #NLP
    #Text analysis

    LLM-powered investment advisory chatbot for efficient investment decision making

    Digital financial market infrastructure for efficient and secure transactions
    #Distributed ledger technology
    #FinTech
    #KYC
    #Transaction monitoring

    Building a scalable, secured system allows users to instantly create transactions in any asset, from anywhere on Earth, at any time.

    Transaction monitoring and suspicious data detection solution
    #Data analytics
    #FinTech
    #Sensitive data
    #Transaction monitoring

    Transaction monitoring system development with complying data security standards

    CONNECT WITH OUR EXPERTS