Windows 10: Search for Similar Images on Bing in Windows 10 Photos app

Brink · Jun 19, 2018

How to: Search for Similar Images on Bing in Windows 10 Photos app

How to Search for Similar Images on Bing in Windows 10 Photos app

The Photos app included in Windows 10 is a universal app that allows you to enjoy, organize, edit, and share all your digital memories. It brings together photos and videos from all your devices, enhances them to make great photos even better, and organizes them into beautiful albums for you.

Starting with version 2019.19031.17720.0 and higher, the Photos app now lets you search for similar images in Bing Visual Search.

This tutorial will show you how to search for similar images in Bing directly from the Photos app in Windows 10.

Here's How:

1. While viewing an image in the Photos app, right click or press and hold on the image, and click/tap on Search for similar images on Bing. (see screenshot below)

2. Click/tap on Agree to send this image to Bing. (see screenshot below)

3. default web browser for you to review the search results. (see screenshot below)

That's it,
Shawn

Related Tutorials

How to Sign in and Sign out of Photos app with Microsoft Account in Windows 10

How to Resize Image in Windows 10 Photos app

How to Crop Image in Windows 10 Photos app

How to Add 3D Effects to Images and Videos in Windows 10 Photos app

How to Add or Remove Favorites in Photos app in Windows 10

How to Add and Remove Folders in Photos app in Windows 10

How to Turn On or Off Show OneDrive Cloud-only Content in Windows 10 Photos app

How to Turn On or Off Linked Duplicates in Windows 10 Photos app

:)

Sangeeta Sarkar · Oct 27, 2019

Photo options and search engine in Windows 10

Hi Ruth,

Thank you for posting your query on Microsoft Community.

When you say skip movies, music and games, what exactly do you mean by that?

I would suggest you to use Photo app in Windows 10 so that all the photos will be listed in one place.

For reference Photos app for Windows help:

http://windows.microsoft.com/en-US/windows-8/photos-app-faq

Note : Steps applies to Windows 10 as well.

You can use any search engine you desire. Bing comes as default search engine in Windows 10. If you prefer some other search engine then you can use that search engine.

Hope this helps. If you need further assistance with Windows, let us know and will be glad to help.

Thank You.

Brink · Oct 27, 2019

New Bing features use machine learning for enhanced image search

aJ_Qwx-hTIQ

On Tuesday, Bing Search announced new features that further use machine learning to provide enhanced image search for topics like shopping and celebrities, as well as a “one-stop shop” of the latest top news headlines.The enhanced image search builds on Bing Visual Search, released in June, which lets you search for images similar to an object you manually selected from another Bing image, say, a purse shown in an image of your favorite celebrity.

“Since then we’ve taken the functionality one step further; now Bing automatically recognizes objects and selects them for you, so you don’t have to manually draw boxes,” the Bing Team writes in a blog post. “You can then browse for similar-looking results in Related Products and Related Images.”

To learn more, visit the Bing Blogs.
Click to expand...

Source: New Bing Search features use machine learning to offer enhanced image search, ‘one-stop shop’ for latest top news headlines - The Fire Hose

Anju Thekkethil · Oct 27, 2019

WINDOWS 10 MICROSOFT PHOTO APP

Hello,

Welcome to Microsoft Community.

The Photos app brings together pictures from all your devices using OneDrive, so that you can browse them by date, album or folder. It also automatically enhances photos, and creates albums for you, to showcase your best shots.

I suggest you to follow the methods below and check if it helps:

Method 1:

I suggest you to change the Default apps in the setting app and verify the result. You may follow the steps in the below:

Go to settings and system.

Click on Default Apps and select the appropriately.

Method 2:

I suggest you to reinstall Photo app using the PowerShell command
and reinstall using the Windows store. Follow the below steps.

Open the　Start　menu, type　Windows PowerShell　in the search bar.

Right click on the　Windows　PowerShell　and select　Run as　administrator.

Enter the below command to uninstall the Photo app.

　　get-appxpackage　　*Microsoft.Windows.Photos* | remove-appxpackage

More reference:

http://windows.microsoft.com/en-US/windows-10/photos

Hope this helps. If the issue remains unresolved, please get back to us and we would be happy to help.

Brink · Oct 27, 2019

Introducing Bing Visual Search

Over the years people have come to expect search engines to automatically detect intent and provide great search results for text queries typed into a single search box. Now Bing takes the first step to achieve the same for images. The Bing Team sets out to connect your camera to a deep search experience.

We started several years ago by introducing ‘Search By’ Image capability. This allowed a user to specify an entire image to be used as a search query. But what if you only want to search for a certain object you saw in an internet image – or one you photographed? So far you'd have to jump through hoops to accomplish this - but not anymore. In this post we will share some recent work we’ve done to solve this challenge and some of the technical wizardry that made it possible.

Introducing Bing Visual Search

Let's say you are looking for kitchen decoration inspiration, and an image attracted your attention. You click on a thumbnail result to get to the ‘Detail View’. You really like the overall décor, but you are particularly interested in that nice-looking chandelier. Would it be possible to see where you can get one just like that? With Bing Visual Search, now you can!

In the Detail View, you will now see a magnifying glass symbol in the top left of the image. It is called the visual search button.

Clicking the visual search button displays a visual search box on the image. You can click and drag this box to adjust it to cover just the object of your interest. You can also simply draw a box around the chandelier if that’s more convenient.

Every time you adjust the visual search box, Bing instantly runs a visual search using the selected portion of the image as the query.

We realize that many Bing image search users may be shopping for items they see in the image or a similar product. We automatically detect the shopping intent and, in addition to regular image search, we also run a product search to find matching products:

Now you can simply click on the chandelier that is right for you, pick the best merchant on the detail page and finalize your purchase!

If you're not in a shopping mood after all, you can still click on “Related Images” to continue exploration of similar images. We are continuously working to detect more intents and bring the best information to the results to satisfy your search needs.

After you’ve found the perfect chandelier options for your project, it’s easy to conduct a visual search for other items. For example, in our example image you can select that beautiful bowl and find a similar one for your kitchen. You can search for any object you see in the image.

Visual search is in its infancy, and we are aware of cases where there is still room for improvement. For example, you may need to tweak your visual search box to fully capture the object of interest to get the best results.

All this goodness is available on your PC or mobile device by visiting Bing.com or in the Bing mobile app. Developers can build visual search into their app using Bing APIs as described here.

Please try out our visual search - just be careful as it can get quite addictive! Let us know what you think using Bing Listens or the Feedback button on Bing.

Under the hood

So how does it all work?

In text based search, the first step is query understanding. Similarly, in visual search, we first need to understand the query image. The major difference is that now instead of query terms we need another way to represent the query-image. Once the query understanding phase is complete, the subsequent steps in the execution of the query are similar:

As a first step in the query-image understanding process, we run Image Processing Service to perform object detection, extraction of various image features including DNN features, recognition features, and additional features used for duplicate detection.

Next comes text query inference step. Here we try to generate the best text query to represent the input image. This is based on a pipeline widely used in Bing image search to identify so called BRQs (for 'best representative query'). You can learn more about how this process works in our earlier post at: The Image Graph - Powering the Next Generation of Bing Image Search).

Subsequently we run a triggering model to identify different scenarios for search by image. Here we leverage the expertise already used in Bing answers triggering. For instance, if we detect that the query-image has the shopping intent, then we show rich segment specific experience.

Once the image understanding phase is complete, we enter the next step: matching. In order to implement search by image inside of existing Bing index serve stack, designed mostly for text search, we need to get text-like representation for the image feature vector. To accomplish this we employ a technique known in vision area as Visual Words. This technique allows us to quantize a dense feature vector into a set of discrete visual words, which are essentially a clustering of similar feature vectors into clusters, using the joint k-means algorithm. The visual words are then used to narrow down a set of candidates from billions to several millions.

After the matching step, we enter the stage of multilevel ranking. We need to rank millions of image candidates, and we’ll do that based on feature vector distances. To speed up the calculations, we use an innovative algorithm developed by Microsoft Research in collaboration with University of Science and Technology of China called Optimized Product Quantization (for more information see the paper: Optimized Product Quantization for Approximate Nearest Neighbor Search). The main idea is to decompose the original high-dimensional vector into many low-dimensional sub-vectors that are then quantized separately as pictured below.

After quantization is complete we need to calculate distances between the query-image and result-image vectors. Instead of using the usual Euclidean distance calculation, we perform a table lookup against a set of pre-calculated values to speed things up even further.

As a result of Optimized Product Quantization, we have reduced candidate set from millions to thousands. At this point we can perform a more expensive operation to rank the images more accurately. After multiple levels of ranking the de-duplication step is executed to remove any duplicate images from the results. The set of images we end up with after this step is the final result set that will be returned to the user.

What’s Next?

We’re constantly working to make the experience better. For example, you may soon notice that we will automatically help you pick objects without needing to draw a box, and provide other tools to help refine your search. We’re also continually focused on bringing the most comprehensive and highest quality visual search results.

Let us know what you think and stay tuned for more improvements!

- The Bing Team
Click to expand...

Source: Beyond text queries: Searching with Bing Visual Search | Search Quality Insights

Mike_L1011 · Oct 27, 2019

Bing image search not updating in Bing Search App Windows Phone 8 (Nokia Black Update)

Hello .

Thank you for posting in the community regarding you Bing picture in Search.

Does picture changes if you set Bing for the lock screen? (settings -> lock screen-> Background -> Bing)

Waiting for your reply.

Regards,

Maria
Click to expand...

Hello Maria,

I applied a similar solution to yours in the evening and today my Bing search image in the Windows Phone 8 app now shows the correct background image corresponding to the homepage today. However, my lock screen image did not update until I refreshed the
lock screen settings.

It seems the problem has been fixed for now. I'll write back with an update tomorrow to see if anything changes.

Thanks for the reply and assistance!

Windows 10: Search for Similar Images on Bing in Windows 10 Photos app

Search for Similar Images on Bing in Windows 10 Photos app

Search for Similar Images on Bing in Windows 10 Photos app

Search for Similar Images on Bing in Windows 10 Photos app

Search for Similar Images on Bing in Windows 10 Photos app - Similar Threads - Search Similar Images

How to remove Bing Image from Search Bar on Windows 10

Getting Rid Of Bing Image in Search Bar Windows 10

Getting Rid Of Bing Image in Search Bar Windows 10

Getting Rid Of Bing Image in Search Bar Windows 10

Bing image search anomaly, Indian cultural bias in Bing Images

Bing photo search missing

Bing: Can't Search Images by Size?

Bing Updates Image Search for Office and Edge

Being a Part of the Bing Image Search Ecosystem