BGT ratings reportedly dropped by 500,000 one week after Diversity sparked backlash for their performance.
The powerful routine, which referenced the death of George Floyd in America, sparked over 15,000 Ofcom complaints.
Last weekend saw 5.3 million viewers tune in.
It comes after some viewers vowed to boycott the programme after Diversity’s dance, which they said shouldn’t have been on the family show.
The performance recreated a white police officer kneeling on Ashley.
Mr Floyd died after white officer Derek Chauvin knelt on his neck for eight minutes.
The routine also featured backing dancers dressed in riot gear while the group also took the knee during it.
Ashley hits back
Ashley responded to criticism and insisted “silence was never and will never be an option”.
Meanwhile, he added on Twitter: “So much to say… But I’ll just let the performance talk.
“Thousands of messages of love and support – thank you.
“For the thousands of messages of hate and ignorance – thank you. You highlight exactly what needs to change. Sending nothing but love to you all.”
Despite the criticism, many viewers felt tearful over the routine and praised the group.
One person said on Twitter: “You are AMAZING – what a powerful message on BGT tonight.
“You had me in tears and here’s to #BlackLivesMatter, let’s keep fighting this fight for equality.”
Another wrote: “That @Diversity_Tweet performance on #BGT has me in tears. So powerful, so timely, so perfect. Thank you @AshleyBanjo for your art.”
So much to say… But I’ll Just let the performance talk. Thousands of messages of Love and support – Thank you 🖤 For the thousands of messages of hate and ignorance – Thank you. You highlight exactly what needs to change. Sending nothing but love to you all 🙏🏽🇬🇧 #Diversity pic.twitter.com/3kP0ymUj88
— Ashley Banjo (@AshleyBanjo) September 6, 2020
A third added: “@Diversity_Tweet always get me in tears, their dance on #BGT was SO powerful, they are amazing!”
Meanwhile, Ashley recently told The Sun: “This performance is extremely special to me and the rest of Diversity.
“We wanted to use the platform we’ve been given to make our voices heard, express how the events of this year have made us feel and think about how we might look back on them in the future… We call it hindsight 2020.”
An ITV spokesman said: “Britain’s Got Talent has always been an inclusive show, which showcases diversity and supports strong storytelling in all forms and ITV stands behind the decision to broadcast Diversity’s performance on BGT.
Did you watch BGT last night? Leave us a comment on our Facebook page @EntertainmentDailyFix and let us know.