SI 475 Robotics and Computer Vision

Official PDF version

Instructor

Distinguished Visiting Professor Keith Sullivan, Hopper Hall 453, x36810,

Grading

Your final grade will be computed as follows:

If you receive more than three negative peer evaluations, you will receive a 50% penalty on each lab grade.

Plus/minus grades will be assigned based on the following numerical cutoffs:

- +
A 90–92 93–100
B 80–82 83–86 87–89
C 70–72 73–76 77–79
D 60–66 67–69
F 0–59

Updates to the course policy

In case this course policy needs to be changed during the semester, students will be notified by email and verbally during class. The current version will always be posted on the course website.

Collaboration

The guidance in the Honor Concept of the Brigade of Midshipmen and the Computer Science Department Honor Policy must be followed at all times. See https://www.usna.edu/CS/resources/honor.php. Specific instructions for this course:

All collaboration and outside sources should always be cited. The same rules apply for giving and receiving assistance. If you are unsure whether a certain kind of assistance or collaboration is permitted, you should assume it is not, work individually, and seek clarification from your instructor.

Use of Generative AI

The use of generative AI tools to help complete assignments is treated the same as collaboration or assistance with a human (see above) and is therefore prohibited under most circumstances. Please talk with your instructor if you believe there are ways to use generative AI tools without hindering the course learning objectives.

Absences

Students are responsible for all class material including the recommended readings. However, the readings are not exhaustive and students missing class should arrange to copy notes from a classmate.

Remote Classes

Remote classes may be recorded for future reference. Remnote attendees will make every effort to connect to class sessions and give them undivided attention. Remote attendees will adhere to the same uniform and grooming standards as those attending in person.

Late Policy

Labs will not be accepted late without a really good reason, which was clearly communicated as early as possible.

Classroom Conduct

Everyone in the classroom will show appropriate respect to each other at all times. All discussions will be civil.

The section leader is responsible for recording attendance, bringing the class to attention, notifying the CS department office if the instructor is more than 5 minutes late, and directing the class in useful work in the instructor’s absence.

Drinks are permitted, but they must be in closable containers. Food, alcohol, smoking, smokeless tobacco products, and electronic cigarettes are all prohibited. Electronic devices must be silent during class and should never serve as a distraction to other students.

Extra Instruction

Extra instruction (EI) is strongly encouraged and should be scheduled by email. EI is not a substitute lecture; students should come prepared with specific questions or problems.

Course Description

Robots are everywhere from warehouses to autonomous cars to vacuums. Two big challenges in robotics are moving in the world and sensing the world. This course presents an overview of robot mapping and navigation (state estimation and SLAM) followed by an overview of computer vision on a robot (optical flow, 3D vision, object identification). Course projects and labs will culminate in an autonomous robot performing surveillance of a building.

Credits

2-2-3

Pre-requisites

IC211 and (IC312 or SY301)

Learning Objectives

  1. Understand concepts and theories related to autonomous robotic systems
  2. Understand how robots sense, learn, and adapt to the world they are embedded within.
  3. Apply acquired knowledge in a laboratory environment by designing, coding and debugging robotics control programs using a robotics platform and heterogenous sensor suite (supports Student Outcome (d)).
  4. Evaluate the impact on human society that would be made by intelligent robots (supports Student Outcomes (e) and (g)).
  5. Present a completed systems to peers (supports Student Outcome (f)).

Student Outcomes

Graduates of the program will have an ability to:

  1. Analyze a complex computing problem and to apply principles of computing and other relevant disciplines to identify solutions.
  2. Design, implement, and evaluate a computing-based solution to meet a given set of computing requirements in the context of the program’s discipline.
  3. Communicate effectively in a variety of professional contexts.
  4. Recognize professional responsibilities and make informed judgments in computing practice based on legal and ethical principles.
  5. Function effectively as a member or leader of a team engaged in activities appropriate to the program’s discipline.

Textbooks

There are no required textbooks for this class. All required reading will be the provided class notes. If you are interested in the topics of the class, here are some useful resources:

Syllabus

  1. Robot Controls (2 classes)
  2. State Estimation (2 classes)
  3. Localization and Mapping (4 classes)
  4. Basic Computer Vision (4 classes)
  5. Robot System Integration (8 classes)