Despite recent breakthroughs in object detection with static images,extending state-of-the-art object detectors from image to video is challenging.The detection accuracy sufiers from degenerated object appearances in videos,e.g.,occlusion,video defocus,motion blur,etc.In this paper,we present a new framework called Missing Recover Recurrent Neural Networks(MR-RNN)for improving object detection in videos,which captures temporal information to recover the missing object.First,We detect objects in consecutive frames to obtain the bounding boxes and their con dence scores.The detector is trained for every frame of the video.Then we feed these detections into a Recurrent Neural Net-work(LSTM [8] or BiLSTM [4])to capture temporal information.This method is tested on a large-scale vehicle dataset,"DETRAC".Our ap-proach achieves Average Precision(AP)of 68.90 based on SSD detector,an improvement of 2.68 over the SSD detector.Experimental results show that our method successfully detects many objects which are missed by basic detectors.