Sign In

Learning with robots, one brick at a time

[6 January 2019, The STAR]

Universiti Teknologi PETRONAS (UTP) is piloting a programme that uses LEGO robots as a complimentary tool for teaching children with autism spectrum disorder.

SAMUEL remembers the day his nine-year-old child came home from school, excitedly looking for robots to play with.

"He was climbing the cupboards looking for his robot toys and he has not stopped playing with them since, he keeps them beside him, playing with them – adjusting and turning the limbs and parts," he adds.

Such a scenario may sound uneventful to most parents, but for Samuel, whose child has autism spectrum disorder (ASD), the reaction was a significant one. And it began that day in school, when a group of Universiti Teknologi PETRONAS (UTP) researchers brought a few robots to Samuel’s son’s school.

The robots, made with the LEGO EV3 Mindstrorm, had been specially programmed to teach children with special needs. "For my son and the other children this was something very new and children with ASD like to play and see something new," adds Samuel.

robots.JPGThe robots are the feature of Associate Professor Dr Noreen Izza Arshad’s ongoing research. In the last few years, Noreen, who is a senior lecturer at UTP’s Positive Computing Research Cluster at the Institute of Autonomous Systems with her team of ten researchers including Dr Ahmad Sobri Hashim and Dr Mazeyanti Ariffin have been delving into the use of robots as a teaching aid for children with special needs, in particular those with ASD.

The research began sometime in 2015 when she found that most of the special schools and institutions that are dedicated for autism are still using the monotonous conventional method in their teaching delivery. These include coloured cards, pictures, and sound instruments to name a few. "This is where problems arise because the teaching method is too monotonous. Children have a short attention span, and it is even worse for children with ASD because they have a hard time focusing on one thing at a time."

"These LEGO robotics kits are attractive, with powerful computational platform, and have been widely been used in recent years for educational purposes. But often robots, computers and tablets are not introduced to children with special needs and parents and teachers asked us why this was so. Even in schools, although there are robotics classes they are rarely open for children with special needs," she adds.

Delving deeper into the use of reprogrammable and multifunctional robots yielded encouraging insights into its use for children with special needs – with research pointing to toddlers considering robots as peers rather than toys because of its flexible capacity and features that appear to be more interactive and engaging.

"Robots also appear to be more effective because of the interactive and engaging multisensory design features compared to a software or computer-mediated therapy," she adds.

"There is also research that reveal that a child’s interest towards a robot naturally become the reason for their voluntary communication," she says, adding that there is a suggestion that because the features of a robot do not resemble human beings, this indirectly encourages these children to communicate.

She adds that studies have also shown that a robot’s appearance is seen as the main focus that attracts autistic children and triggers their curiosity toward the robot, as was the case with Samuel’s son.

Similarly it is believed that sound, music, vocal messages, colour, visual cues as well as movements that are considered as meaningful actions can aid in persuading a positive attitude.

Given these advantages, Noreen and her team visited a few schools, namely SK Coronation Park in Ipoh, SK Sultan Yussuf in Batu Gajah and SK Kampung Boyan in Taiping that cater to children with special needs.

"We discovered that the syllabus for children with special needs is different compared to those in the mainstream classes. We looked at the topics and subjects taught and selected those that can be delivered by robots. These include the teaching of numbers and Jawi, and the recognising of coins, body parts, animal sounds, shapes and the states of Malaysia," she said.

 

Say it again, Mr Robot

Noreen’s research is funded by the Ministry of Education under the Prototype Research Grant Scheme, which she received in 2015. With the RM110,000 grant, the team studied the current teaching delivery method for the various modules in the syllabus and worked on developing the robotic component.

In the case of teaching pupils to recognise the different coin values for example, the team developed a robot structure that could calculate the circumference of each coin and identify it.

"So when the child puts the coin on the robot, it will read the coin and say the value out loud," she says. In all, the team has developed 10 robots that could deliver various learning modules in fun ways.

Besides the abovementioned schools, the team also visited the National Autism Society of Malaysia (NASOM) Ipoh branch and a few autistic children at their homes. Collectively, tests were made among 30 autistic children and the results showed that the robotic intervention enhanced learning environment and could boost the children’s understanding by 50%.

"Let’s say the teacher is teaching them about colours, with the previously used method, they can only attentively listen for 5 minutes. But with the LEGO EV3 Mindstorm that we have programmed, they can stay focused for 20 minutes and interestingly they started to talk, touch, take turns, volunteer, and seem to enjoy the learning," says Noreen.

According to Noreen, feedback from teachers has been positive. "Most teachers say there is a breakthrough in getting the children to focus. The robots hold the children’s attention longer compared to previous teaching aids. They used to get grumpy by the first hour but here they play with the robot for hours without throwing a tantrum," she adds.

Irwana Mohd Amin, who teaches Year One and Year Three children with special needs, believes that robots can have a positive impact for children with special needs as well as slow learners.

Irwana, or Cikgu Irwana (as she’s often called), a teacher at SK Coronation Park in Ipoh recalls the occasions when Noreen and her team brought the robots to the school.

"The children were all very excited, because even though we do use teaching aids it’s usually flash cards or a laptop. It’s not as sophisticated as a robot," she quips.

The robots were tested in classes with slow learners and children with mild ASD aged between 9 and 11 years.

"The robot was programmed to teach the children about flags of the states of Malaysia. The robot was something very new to the children and we saw that they were more focused and found the whole session fun," she adds.

Irwana, who has a Masters in Special Education, reckons that the robots would be useful for teaching children with special needs. The setback however is the cost, especially for a public-funded school.

"If there were organisations that would sponsor the robots then we can put them to use to teach the children."

Noreen concurs, adding that a big plus would be for the Ministry of Education to set aside the funds for schools to purchase the robots to be used as teaching aids for children with ASD.

 

Robots for all


Despite the encouragement received from teachers and parents, it has not been bouquets all the way for the research team. There have been criticisms, for instance, that robots will render the children more uncommunicative.

"This is not the case. The robots are not there to eliminate communication. It is a tool to help creates the engaging and immersive learning in fun ways that would indirectly welcome communication," says Noreen.

Still, she concedes that there is a concern that children with ASD who may already have problems communicating, will retreat further away from people if they have a robot.

"So we are still exploring ways where we can programme the robot to teach communication skills."

The LEGO EV3 Mindstorm was also introduced to children in mainstream classes. At the Kausar Excel Centre in Bandar Sri Iskandar for example, the children were eager to interact with the robot.

"It was a good exposure to technology for the children because they were amazed at the inventiveness of the technology, and it also boosts their creativity and imagination," says Erni Yentti Amir, who is the founder of the learning centre.

The plan going forward, says Noreen is to publish instructional guides on how to programme the robots to teach the various modules – for example numbers, colours or shapes. These are the guides or manuals that Noreen and her team developed from scratch based on the teaching syllabus for children with special needs.

"To date there isn’t a guide in the market that is as comprehensive as ours. With this guide, all the teacher or parent needs to do is build the robot using step-by-step instructions and programme the robot based on what is to be taught. Basically from switching on the robot to actually using it for teaching activities," she adds.

To that end, UTP is in talks with Sasbadi Holdings Bhd – the education and solution provider for Lego Education robotics products in Malaysia – to get the guides onto bookshelves.

"My hope is to make the guides available to everyone. Eventually I even hope to see these special kids using the guides and even programming the robots themselves."