A novel algorithm is presented to make the results of image matching more reliable and accurate based on SIFT (Scale Invariant Feature Transform).SIFT algorithm has been identified as the most resistant matching algorithm to common image deformations; however,if there are similar regions in images,SIFT algorithm still generates some analogical descriptors and provides many mismatches.This paper examines the local image descriptor used by SIFT and presents a new algorithm by integrating SIFT with two-dimensional moment invariants and disparity gradient to improve the matching results.In the new algorithm,decision tree is used,and the whole matching process is divided into three levels with different primitives.Matching points are considered as correct ones only when they satisfy all the three similarity measurements.Experiment results demonstrate that the new approach is more reliable and accurate.