This paper considers the cooperative tracking of linear multi-agent systems with a dynamic leader whose input informa-tion is unavailable to any followers. Cooperative iterative learning controllers, based on the relative state information of neighboring agents, are proposed for tracking the dynamic leader over directed communication topologies. Stability and convergence of the proposed controllers are established using Lyapunov-Krasovskii functionals. Furthermore, this result is extended to the output feedback case where only the output information of each agent can be obtained. A local observer is constructed to estimate the unmeasurable states. Then, cooperative iterative learning controllers, based on the relative observed states of neighboring agents, are devised. For both cases, it is shown that the multi-agent systems whose communication topologies contain a spanning tree can reach synchronization with the dynamic leader, and meanwhile identify the unknown input of the dynamic leader using distributed iterative learning laws. An illustrative example is provided to verify the proposed control schemes.