Are you measuring this with debugging tools on? I've just noticed that in recent versions of FF / Firebug, it takes maybe 10 x longer if firebug is on vs off.
Backbone doesn't handle nested observes / getter / setters / etc so it doesn't have to walk through the data as much as CanJS does.