Utilizing space-based observer to achieve effective surveillance on space objects is the direction and trend of the space surveillance. Based on the analysis on the characteristics of the space optical surveillance, the passive tracking method for the surveillance data is put forward, according to extracting the linear moving information of the streak of the space object in surveillance image frame. And the corresponding tracking initiation method is also given. The data flux in information processing is reduced, and the comparative tracking precession can be provided at the same time.