Surgical instrument detection: Datasets & Models
Computer vision that detects and localizes surgical instruments in images and video from the operating room or sterile processing area. Useful for automating instrument tracking, counting, and workflow monitoring.
Surgical instrument detection
This workflow performs surgical instrument detection, locating and classifying tools such as scalpels, forceps, scissors, and clamps with bounding boxes. It accepts still images or video frames from operating room cameras, overhead surgical cameras, or sterile processing station feeds, and returns the class and pixel location of each detected instrument.
Try it out
Powered by general detection model
Run on custom image
Drop an image here or click to upload
Why automate surgical instrument detection
Manually counting and tracking surgical instruments is tedious, error-prone, and time-consuming, and a miscount can carry serious patient safety consequences such as retained foreign objects. Automating this with computer vision provides a consistent, always-on check that flags discrepancies faster than a manual tally and frees clinical staff to focus on the patient. In sterile processing, automated detection helps verify that trays are complete and correctly assembled before they reach the OR. The result is fewer counting errors, better documentation, and a reliable audit trail.
Key benefits
Teams gain faster, more consistent instrument counts and tray verification while reducing the manual burden on nursing and sterile processing staff. The workflow integrates with existing OR and sterile processing cameras, so there is no need to rip out current infrastructure, and it scales across multiple rooms and facilities. Trained detection models like RF-DETR deliver accurate localization even in cluttered scenes, and the pipeline can be retrained as new instrument types are added.
How to use it
- Upload an image: Drop any photo into the widget above to try surgical instrument detection for free, right on this page.
- Preview instant results: The model detects scalpel, forceps, surgical scissors, clamp, retractor within seconds and returns an annotated image with structured predictions, so you can immediately see how well it works. Adjust the detection classes and re-run until the results fit your scenario.
- Like what you see?: With a free Roboflow account, you can deploy this workflow with the Serverless Cloud API, customize it in your workspace, or train RF-DETR on your own images for production accuracy.
- Get started for free: No code or training data required to begin: upload, review the results, and make it part of your stack in a single click.
Recommended model for surgical instrument detection
RF-DETR is state of the art for real-time object detection, instance segmentation, and keypoint detection, with higher accuracy and lower latency than comparable models, and it's Apache 2.0 licensed. When you're ready to build a production model for surgical instrument detection, fine-tune it on your own labeled images, then deploy to a Serverless Cloud API endpoint.
Not sure where to start?
Describe your Surgical Instrument Detection project to Roboflow Agent.