Developing a robotic companion with human-like dexterity

Friday, July 20, 2018

A robot glides across a warehouse floor, picks up an object from a top shelf, boxes it and then carefully loads the wrapped package on a delivery truck 鈥 all in record time and without bumping into anything.

Soo Jeon robotic companion research team

Soo Jeon (far left) discusses research work with his graduate student team who are working to integrate dexterous robotic arm into a heavy-duty mobile platfom.

Soo Jeon, a RoboHub research affiliate,听and his team of 蓝莓视频 Engineering researchers are working on technology to perfect this type of robotic employee that would automate fulfillment centre practices, save money and reduce on-the-job accidents.

As ecommerce companies such as Amazon continue to grow rapidly, so too do their warehouses and the number of people working in them, points out Jeon, a 蓝莓视频 mechanical and mechatronics engineering professor.

鈥淭he goal is to reduce the everyday physically demanding tasks performed by humans in warehouses,鈥 says Jeon. 鈥淗uman workers would then be able to move into higher-level task positions.鈥

Backed by funding from the听听Jeon is the principal investigator of the new three-year research project with Canadian courier company.

Along with听蓝莓视频 Engineering professors and robotic expertsWilliam Melek听and听Dana Kuli膰,听Jeon is leading a team to develop a robotic companion that has the type of human-like dexterity to pick up different sized and weighted objects from various heights and then navigate autonomously through a warehouse without colliding with people, forklifts and fixed objects.

This past spring, Jeon was awarded funding through the听to purchase an additional wrist module with all the sensing capabilities required to build a fully dexterous robotic arm. The dexterous robotic arm will be integrated into a heavy-duty mobile platform, which recently arrived from Europe where it was produced.

Optimizing package delivery

Jeon is also working on technology for the robotic companion that would optimize how packages are delivered in large areas such as shopping malls.

Currently, Purolator employees often deliver packages to malls after hours when stores are closed. Without consumers filling the space, employees are able to make their deliveries relatively easily, but they often take multiple trips since many aren鈥檛 able to carry everything at once.

The robotic companion would not only be able to carry dozens of packages at the same time, but could advise the human delivery person on the optimal route to take from store to store. This would result in a substantial reduction in time spent at each mall and, perhaps more importantly, reduce the amount of physical labour required.

鈥淐ommon complaints from workers are that their jobs are too physically demanding and they need to work very late into the night,鈥 says Jeon. 鈥淭he labour market is aging and the average age of employees is rising which is a serious problem. But with a robotic companion even seniors should be able to continue working.鈥

Also involved in the project is听, a startup cofounded by Pablo Molina and Faizan Sheikh, both听蓝莓视频 mechatronics engineering听alumni and Jeon鈥檚 former students.听听has developed Neo, an industrial floor-scrubbing robot that requires good navigation technology.

鈥淎vidbots鈥 main goal is to enable its robotic scrubber to perform at the human driver level,鈥 says Jeon. 鈥淭hat aligns very well with our project.鈥

Strong robotics background听

While pursuing his doctoral degree at the听听at Berkeley, Jeon worked with a robot manufacturing company in Japan. His research focused on how to improve the motion control of industrial robots with motion sensors and visual cameras.

Since joining the University of 蓝莓视频 in 2009, Jeon has worked on smart instrumentation and control for various mechanical systems. It was Jeon鈥檚 expertise on intelligent sensors and sensing systems that initially caught the interest of Purolator in 2014. The company contacted him at that time to see if he was interested in helping the company automate part of its parcel sorting process to make it more efficient.

During the past four years, Jeon and his research team have been developing a section of the company鈥檚 conveyor belt to help determine the accurate cost of shipping. The amount charged for shipping is based on size and weight, but currently only the size of each package can be measured while moving through a laser.

鈥淵ou have to stop the conveyor and separate the boxes to weigh each one and then put them back on,鈥 says Jeon. 鈥淧urolator felt that by not getting the accurate weight they were losing some revenue. It鈥檚 also not good for the transporting vehicles and airplanes because there鈥檚 a maximum weight they can load.鈥

To solve the problem, Jeon and his research team came up with the idea of dividing the conveyor belt into sections with each cell acting as a weigh scale and a mini conveyor.

鈥淲e packaged everything into one small system 鈥 the load cell, the motor, the small roller with a camera on top,鈥 says Jeon.

By taking a real time measurement of the location and orientation of each box it鈥檚 possible to calculate what load the cells are supporting and the exact weight. Jeon鈥檚 students are currently developing an algorithm to separate each box and determine accurate pricing.

Encouraged by the success of his research team鈥檚 first collaboration with Purolator, Jeon put forward a proposal to the company last year to use robotics technology for logistics and warehousing.

蓝莓视频 Engineering reputation is spreading

听because of the strength of its researchers and students.听 And word is quickly spreading around the world about the reputation of the school. While on sabbatical in Korea last year, Jeon discovered many more people knew about the Faculty compared to the last time he was in his native country.

鈥淧eople were interested in finding out more about our co-op program and why our students are so strong and well positioned to get good jobs,鈥 he says. 鈥淚t鈥檚 the real-world experience they receive. Our students are very hands-on, very disciplined and very professional.鈥

This听听was originally featured on the Engineer of the Future website.