Vision Detector vs Segment Anything Clipper

Vision Detector is an AI image analysis tool that supports CoreML machine learning models, multi-modal Large Language Models, and on-device Apple Intelligence. Choose the mode that best fits your use case. You can choose one of the following image input sources: - Live video by built-in camera - Still image by the built-in camera - Photo Library - Files (iCloud, Google Drive, Dropbox, etc) For live video inputs, continuous inference is performed on the camera feed. However, the frame rate and other parameters depend on the device. # Notification Center Vision Detector can call Notification Center for predefined conditions. Broadcasting notifications send notification to your all Apple devices signed in with the same Apple Account. ## CoreML Mode Vision Detector locally executes CoreML models using Apple’s Vision framework. Before using this mode, prepare a machine learning model in the CoreML format (.mlmodel or .mlpackage) using Create ML. Import ML models via iClpoud or AirDrop. Vision Detector supports the following types of CoreML models: - Image classification - Object detection - Style transfer ## Vision LLM Mode Vision Detector can use multi-modal large language model (LLMs). Define what to do with prompt as following samples: - If the image is screen shot, answer the name software - Call notification when you see a cat - Count number of persons in the image, and notify when it changes ## Apple Intelligence mode Available with iOS 27 on selected devices (iPhone 17 Pro, iPhone Air, etc). The images are completely processed on your device locally with your prompt.

Segment your photos to extract parts of it! Use our example image to figure out how to use it. Then, import your own images to take the mask of your images.