Paimon

Paimon

👀谢谢关注喵

Evaluation of Meta AI's Open Source Image Matting Model

1. Segment Anything#

segment-anything

It seems that a proxy is needed to access their official website, but they also provide a Github repository that can be set up locally.

2. How to Use#

Hover & Click#

First, randomly select a simple composition to test the effect.
When the mouse moves, it will automatically select the entire area where the mouse is located.
Clicking the left mouse button will select it. If the selection is incomplete, you can select the unselected part with the left mouse button.
If you have selected unnecessary parts, select "Remove Area" on the left panel and click on the unnecessary parts to remove them.
After the selection is complete, click on "Cut out object" on the left panel to output.
1.png
This is the output effect. It can be seen that the recognition rate is acceptable, but there is no feathering, so the edges are not very smooth.
2.png

Box#

In addition to the first method of clicking to select, similar to the use of templates in PS,
it also provides the Box method, which automatically recognizes objects when the mouse is long-pressed and dragged to select.
This time, let's use a slightly more complex image to see the effect.
3.jpg
4.jpg
Only the units that are fully selected by the selection box will be recognized, and those partially selected will not be recognized.
The overall recognition rate is okay, but if the image is too large and there are too many distractions, it may select some strange things.

Everything#

Segment Anything also provides a fully automatic way of cutting.
This method will automatically select all objects in the image and output them as separate files.
Let's use an image with a lot of objects. The scanning time is about 2-3 seconds.
QQ 截图 20230406170913.jpg
QQ 截图 20230406171005.jpg
As expected, it cannot properly cut out a bunch of beans.
It can recognize radishes properly, but the edge processing is not very good.

3. Conclusion#

Overall, the effect is relatively average, although the processing speed and recognition rate are acceptable.
However, as an auxiliary tool, it is already qualified, although the effect is not as good as removebg.
But it is open source and free, and I hope that future updates can improve the edge processing.

Loading...
Ownership of this post data is guaranteed by blockchain and smart contracts to the creator alone.