Based on the analysis of the rough set model on a tolerance relation and the fuzzy rough set, two types of fuzzy rough sets models on tolerance relations are constructed and researched. Then we propose the optimistic and pessimistic multi-granulation fuzzy rough sets models in a fuzzy tolerance approximation space with the point view of granular computing. In these models, the fuzzy lower and upper approximations of a fuzzy set are defined on multiple fuzzy tolerance relations. It follows the research on the properties of the fuzzy lower and upper approximations of the new models. The fuzzy rough set model, rough set model on a tolerance relation and multi-granulation rough sets models are special cases of the new ones from the perspective of the considered concepts, related relations and granular computing. The new models are meaningful generalizations of the classical rough sets.