1. Homepage
  2. Programming
  3. CS 8395-04: Special Topics - Intelligent Surgical Robots - Project 2: Modeling the latent space from reconstructing robot kinematics

CS 8395-04: Special Topics - Intelligent Surgical Robots - Project 2: Modeling the latent space from reconstructing robot kinematics

Engage in a Conversation
USVanderbilt UniversityCS 8395Special Topics - Intelligent Surgical Robotsneural networklatent space

CS 8395-04: Special Topics - Intelligent Surgical Robots

Fall 2022 CourseNana.COM

Project 2 Due: Nov 10th, 17th, Dec 8th CourseNana.COM

The goal of this project is to implement a neural network for modeling the latent space from reconstructing robot kinematics from endoscope images obtained during robot-assisted procedures. You will work in pairs for this project and only one student in each pair needs to submit the project to Brightspace. CourseNana.COM

You have a lot of freedom for where you want to take this project - some ideas for improving the latent space representation results are below. Please note that you’ll have a full month for this project so the scope should match the time frame. CourseNana.COM

  1. Learn from both left and right simultaneously and enforce consistency between frames
  2. Use a more up-to-date network that accounts for temporal information (such as recurrent neural networks
    • variations, or transformers)
  3. Change the network structure so that both kinematics and images are used as input. Then, use a different task as the self-supervised training loss (such as contrastive/triplet loss)
  4. Cluster in full latent space (rather than the 2D projection made by UMAP) and compare results
  5. Train a supervised network for skill and action segmentation and compare results
  6. Develop a semi-supervised network that can learn from both labeled and unlabeled data

You also have the option of exploring another temporal modeling problem. Please either send me an email about your plan or talk to me after class if you decide to do this so I can check that your project is appropriate in both scope and theme. You will also need to follow the outlined submission steps if you go this route (submit a in week 1, your preliminary code in week 2, and the final report in week 3). You may need to spend more of part 1 describing the problem. CourseNana.COM


Literature review - proj2 part1

Scan the literature on the topic of instrument segmentation. You can take a look at the works that cite the JIGSAWS dataset as a starting point (https://scholar.google.com/scholar?cites=260619035228262 4469&as_sdt=5,43&sciodt=0,43&hl=en). After you have an understanding of the existing work, use that knowledge to develop a plan for what you will implement for action modeling. Write a one page report on your plan and how it relates to the existing literature. CourseNana.COM

Implement your plan - proj2 part2

Spend the next week implementing your plan. Submit your code as a checkpoint by the end of the week. It’s OK if it doesn’t work fully yet. You’ll continue to train and improve it throughout the next weeks. CourseNana.COM

Final report - proj2 part3

Continue training your network. Once you’re satisfied with the results, write up a final report with the results you’ve obtained. Your final report should be at max 5 pages. Your final discussion should include: CourseNana.COM

  1. Tables and/or graphs showing your results
  2. Discussion of whether your results matched your expectations
  3. Comparison of this algorithm to homework 3
  4. How you could improve your project if you had more time

Prepare a presentation for describing your method and results. Presentations will take place Dec 6th and 8th. Please sign up for a slot here (as a group) https://docs.google.com/spreadsheets/d/1de70lS4-45L oM2688-55-x4HNwxnHCJjbd7Doz7wR_M/edit?usp=sharing. Your presentations should be around 15 min. CourseNana.COM


Depending on which of the above you choose, you may not necessarily get better performance (especially if you choose to experiment with different network architectures). That’s OK! The point of this class is to discuss reallife constraints that make it challenging to apply cutting-edge machine learning techniques to surgical robotics data. CourseNana.COM

Instead, the focus of the evaluation will be on whether you’ve done something interesting and whether it has clinical value. This will be judged based on your write-up. You can use readings from this class and additional readings as sources for why something would be clinically useful. CourseNana.COM

Get in Touch with Our Experts

WeChat WeChat
Whatsapp WhatsApp
US代写,Vanderbilt University代写,CS 8395代写,Special Topics - Intelligent Surgical Robots代写,neural network代写,latent space代写,US代编,Vanderbilt University代编,CS 8395代编,Special Topics - Intelligent Surgical Robots代编,neural network代编,latent space代编,US代考,Vanderbilt University代考,CS 8395代考,Special Topics - Intelligent Surgical Robots代考,neural network代考,latent space代考,UShelp,Vanderbilt Universityhelp,CS 8395help,Special Topics - Intelligent Surgical Robotshelp,neural networkhelp,latent spacehelp,US作业代写,Vanderbilt University作业代写,CS 8395作业代写,Special Topics - Intelligent Surgical Robots作业代写,neural network作业代写,latent space作业代写,US编程代写,Vanderbilt University编程代写,CS 8395编程代写,Special Topics - Intelligent Surgical Robots编程代写,neural network编程代写,latent space编程代写,USprogramming help,Vanderbilt Universityprogramming help,CS 8395programming help,Special Topics - Intelligent Surgical Robotsprogramming help,neural networkprogramming help,latent spaceprogramming help,USassignment help,Vanderbilt Universityassignment help,CS 8395assignment help,Special Topics - Intelligent Surgical Robotsassignment help,neural networkassignment help,latent spaceassignment help,USsolution,Vanderbilt Universitysolution,CS 8395solution,Special Topics - Intelligent Surgical Robotssolution,neural networksolution,latent spacesolution,