Chris Bosh had 23 points for the Raptors, who could have clinched a playoff berth with a victory. Toronto could still seal a spot if New Jersey loses or Washington wins.
The Raptors (38-38) are hardly playing like a team poised to make a strong playoff run. Toronto has lost three of four and 14 of 20. Fans booed the Raptors at the final buzzer.
The lowly Bobcats finished 2-1 against Toronto this season.
Richardson became the latest guard to torment the Raptors, scoring all his points in the first three quarters. He hurt them with penetration and went 4-for-7 from beyond the 3-point arc.
Toronto cut Charlotte's lead to one with 1:15 left, but Boykins' steal on Ford and fast-break layup and free throw gave the Bobcats a 101-97 lead with 41 seconds remaining.
The Bobcats made most of their free throws the rest of the way to seal the victory. Charlotte is trying to avoid a 50-loss season.
Rasho Nesterovic added a season-high 23 points for Toronto, but All-Star Bosh didn't get many touches in the fourth quarter.
Raymond Felton had 21 points for Charlotte.
Notes:@ Bobcats forward Gerald Wallace didn't play in the second half because of a strained left groin. ... Toronto decided not to file a protest to the NBA to try and reverse the outcome of an overtime loss against Atlanta on Wednesday. The Raptors argued that Ford got off a game-winning shot at the end of regulation, but officials ruled time expired. ... The Raptors have made the playoffs just five times in their 13-year history.