CRESSim: Simulator for Advancing Surgical Autonomy

Diagram of the transformer deep learning architecture.

Overview

Realistic and real-time surgical simulators play an increasingly important role in surgical robotics research, such as surgical robot learning and automation, and surgical skills assessment. The ability to simulate the diverse types of objects and contact-rich manipulation tasks, such as tissue cutting and blood suction, is important as they typically present in surgeries. We propose another surgical simulator for the da Vinci Research Kit (dVRK), CRESSim, that enables simulating various contact-rich surgical tasks involving different surgical instruments, soft tissue, and body fluids. The real-world dVRK console and the master tool manipulator (MTM) robots are incorporated into the system to allow for teleoperation through virtual reality (VR). With CRESSim, we aim to advance surgical autonomy and augmented dexterity for surgeons by developing autonomous agents capable of completing surgical subtasks.

Learn more about the technical details here. If you find this project helpful for your research, please consider citing one or more of the papers listed below.

Project Papers

[2024] Learning Autonomous Surgical Irrigation and Suction with the da Vinci Research Kit Using Reinforcement Learning

Yafei Ou, Mahdi Tavakoli
Paper not available yet

[2024] From Decision to Action in Surgical Autonomy: Multi-Modal Large Language Models for Robot-Assisted Blood Suction

Sadra Zargarzadeh, Maryam Mirzaei, Yafei Ou, Mahdi Tavakoli
arXiv preprint arXiv:2408.07806 [arxiv] [bib]

[2024] A Realistic Surgical Simulator for Non-Rigid and Contact-Rich Manipulation in Surgeries with the da Vinci Research Kit

Yafei Ou, Sadra Zargarzadeh, Paniz Sedighi, Mahdi Tavakoli
2024 21st International Conference on Ubiquitous Robots (UR) [paper] [arxiv] [bib]

[2024] Autonomous blood suction for robot-assisted surgery: A sim-to-real reinforcement learning approach

Yafei Ou, Abed Soleymani, Xingyu Li, Mahdi Tavakoli
IEEE Robotics and Automation Letters [paper] [bib]