With high-dimensional data appearing, the number of fuzzy rules increases which degrade the interpretability and increases the computation complexity of the fuzzy rule-based system. In this paper, we proposed a rule-reduced algorithm. Through the sparse encoding of the fuzzy basis functions (FBFs), rules are reduced. Least angle regression algorithm is proposed here to select the important rules. Compared with other sparse encoding algorithm, Least angle regression algorithm has the advantage of lower computation complexity and better performance. The experimental results show that our proposed algorithm has excellent performance, especially for high-dimension data.