Here is the gist of your problem:
@"isSync == 0 AND SUBQUERY(toBookOrders, $x, $x.toBook == SELF)"
If you divide this into two sub-products, as Scott suggests, you get:
isSync == 0SUBQUERY(toBookOrders, $x, $x.toBook == SELF)
, SUBQUERY true false, . (), - , true false. , , , , AND . .
, :
@"isSync == 0 AND SUBQUERY(toBookOrders, $x, $x.toBook == SELF).@count > 0"
, , isSync , OrderBooks - .