Learn how to build and control an AI-powered simulated drone using Large Language Models, ROS 2, PX4, Gazebo, Ollama, and YOLO.
You will be able to give instructions such as:
- “Take off and hover at 5 meters.”
- “Fly in a heart shape.”
- “Search for a person, then approach the person.”
This beginner-friendly course takes you from a clean Ubuntu 24.04 installation to a complete drone system that can understand natural-language instructions, execute autonomous flight behaviors, and react to objects detected through its camera.
You will begin by setting up ROS 2 Jazzy, Gazebo, and PX4 Autopilot, then launch and test a simulated X500 drone. You will also learn how PX4 communicates with ROS 2 through the Micro XRCE-DDS Agent and how the simulated camera is bridged from Gazebo into ROS 2. Next, you will install Ollama and run a local Large Language Model that converts simple English instructions into drone actions. Instead of writing low-level commands.
