Welcome to the Final Day of Our Hands-On Course!

Today you'll integrate everything: the environment (URDF), movement (navigation & grasping), perception (detecting objects), and knowledge (reasoning about actions).

Goal: By the end of this session, you will execute a complete milk delivery task: navigate to the fridge, open it, find the milk, grasp it, and place it on the table.

• Completed Chapters 1–3
• Understanding of URDF, perception, planning, and knowledge queries

You'll write a high-level plan that orchestrates all components:

1. Query Knowledge Base: "What do I need to do to get the milk?"
2. Plan Movement: Navigate to the fridge
3. Perceive: Use your camera to find the milk
4. Grasp: Pick up the milk
5. Transport: Move to the table
6. Place: Put the milk down

The simulation will execute your plan step-by-step, and you'll see if it works!

Use PyCRAM to write code defining:

• The goal (transport milk from fridge to table)
• The constraints (don't crash, grasp gently, etc.)
• The sequence of actions

Run your plan in simulation:

• Does the robot navigate correctly?
• Does it perceive the milk?
• Can it grasp and move it?

Fix any issues and try again.

Change the scenario:

• Move the milk to a different location
• Add obstacles
• Change the target location (e.g., counter instead of table)

How robust is your plan?

Launch the Full Simulation Lab →

Watch examples of the task completed:

Box Opening and Object Manipulation:

Human-Robot Collaboration in VR:

By completing this course, you've learned:

• How to model environments with URDF
• How to move and perceive with robots
• How to reason about tasks with knowledge bases
• How to orchestrate complex robotic behaviors

These are the fundamentals of autonomous robot programming!