Here is a slightly curated list of learning resources and useful links in Computer Vision, Artificial Intelligence and related topics. For resources on robotics, visit the robotics resources post. If you have other great resources to suggest, feel free to contact me.

Deep Learning

Transformers

• CS25 - Transformers United, a Standford lecture on Transformers

Diffusion models

• Diffusion is spectral autoregression
• Denoising diffusion probabilistic models from first principles, a tutorial series on diffusion models in Julia

Reinforcement Learning

• Reinforcement Learning: An Introduction, by Sutton & Barto

• David Silver Lectures are a good introductory course.

• reinforcement-learning, a GitHub repo by Denny Britz to accompany Sutton's Book and David Silver's course

• OpenAI SpinningUp gives a general overview

• Stable Baselines, a RL library developed by the DLR Institute of Robotics and Mechatronics (DLR-RM)

  • ReadTheDocs

• Deep RL Bootcamp

Legged Robotics

• RSL RL, a RL library with algorithms, from the Robotic Systems Lab (RSL), Prof. Dr. Marco Hutter, ETH Zurich

Computer Vision

• CS231n - Deep Learning for Computer Vision, a Stanford CS class on using deep learning for computer vision tasks.

Object Detection

• MAN TruckScenes, World's First Public Dataset For Autonomous Trucking
  • Challenge on HuggingFace Spaces

Problems

Geospatiallearning

• torchgeo
  • Blog article

Here is a slightly curated list of learning resources and useful links in robotics. For resources on AI, visit the AI resources post. If you have other great resources to suggest, feel free to contact me.

General

Newsletters

• Weekly Robotics

Robot Operating System

Robot Operating System (ROS) is a commonly used open-source robotics middleware. Please note: there is a space in ROS 2: ROS 2.

A new ROS 2 distribution is released every year on May 23rd, the World Turtle Day. Each distro is related to a release of Ubuntu. Here are the names of the last distributions, with their corresponding Ubuntu versions:

<figcaption class="mb-4">
    Ubuntu, ROS and ROS 2 timeline
</figcaption>

Official resources:

• Website
• Documentation
  • The tutorials are great for anyone considering to begin with ROS 2

Robots

Legged Robots

• RSL RL, a library with RL algorithms for legged robotics, from the Robotic Systems Lab (RSL), Prof. Dr. Marco Hutter, ETH Zurich

Robot Learning

• LeRobot, a low-cost robotics project by HuggingFace, for accessible end-to-end robot learning
• Robot Learning Course, course material for Marc Toussaint's and Wolfgang Hönig's Robot Learning course in TU Berlin.

Simulation

• Genesis, a generative simulation tool for robotics

Datasets

Autonomous Driving

• MAN TruckScenes, World's First Public Dataset For Autonomous Trucking
  • Challenge on HuggingFace Spaces

Towards the end of 2023, in preparation for the holidays, I designed and soldered about twenty small Christmas tree 🎄 PCBs to give to my relatives. During this year's holidays, I took advantage of some free time to clean up and prepare the project to publish it as an open-source hardware project on GitHub.

About

This project taught me the basics of ATtiny microcontroller programming (via UPDI), PCB art, and SMD components soldering. I hope this project inspire anyone interested in #hardware, #embedded #programming, and #electronics. If you're interested in making one for next year, I wrote down all the tips and tricks for making your own Christmas tree PCB in an instruction guide.

This project was made with the following free and open-source software:

• FreeCAD for the outline
• Inkscape for the PCB art
• KiCad for the design of the PCB
• PlatformIO for embedded programming

Images

Links

For more info,

• Project Repo

My paper, Proprioception Is All You Need: Terrain Classification for Boreal Forests, will be presented in the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024), in Abu Dhabi, UAE. The paper presents BorealTC : a publicly available dataset containing annotated data from a wheeled UGV for various mobility-impeding terrain types typical of the boreal forest. The data was acquired in winter and spring on deep snow and silty loam, two uncommon terrains in an urban setting.

Here is the abstract:

Recent works in field robotics highlighted the importance of resiliency against different types of terrains. Boreal forests, in particular, are home to many mobility-impeding terrains that should be considered for off-road autonomous navigation. Also, being one of the largest land biomes on Earth, boreal forests are an area where autonomous vehicles are expected to become increasingly common. In this paper, we address the issue of classifying boreal terrains by introducing BorealTC, a publicly available dataset for proprioceptive-based terrain classification (TC). Recorded with a Husky A200, our dataset contains 116 min of Inertial Measurement Unit (IMU), motor current, and wheel odometry data, focusing on typical boreal forest terrains, notably snow, ice, and silty loam. Combining our dataset with another dataset from the literature, we evaluate both a Convolutional Neural Network (CNN) and the novel state space model (SSM)-based Mamba architecture on a TC task. We show that while CNN outperforms Mamba on each separate dataset, Mamba achieves greater accuracy when trained on a combination of both. In addition, we demonstrate that Mamba’s learning capacity is greater than a CNN for increasing amounts of data. We show that the combination of two TC datasets yields a latent space that can be interpreted with the properties of the terrains. We also discuss the implications of merging datasets on classification. Our source code and dataset are publicly available online: https://github.com/norlab-ulaval/BorealTC.

Terrains

For this paper, a ClearPath Husky A200 was driven on 5 different terrains:

Slides

Links

For more info,

• ArXiv
• Project webpage
• Norlab webpage

When I talked about my new website to my friend William Guimont-Martin, he immediately had one thing in mind:

So, here are my best squirrel photos. They were taken on May 20th, 2024, in Marais du Nord (46°57'35"N 71°23'35"W).