A matrix stripping method for the conversion of in-situ gamma ray spectrum, obtained with portable Ge detector, to photon flux energy distribution is proposed. The detector response is fully described by its stripping matrix and full absorption efficiency curve. A charge collection efficiency function is introduced in the simulation to take into account the existence of a transition zone of increasing charge collection after the inactive Ge layer. Good agreement is obtained between simulated and experimental full absorption efficiencies. The characteristic stripping matrix is determined by Monte Carlo simulation for different incident photon energies using the Geant4 toolkit system. The photon flux energy distribution is deduced by stripping the measured spectrum of the partial absorption and cosmic ray events and then applying the full absorption efficiency curve. The stripping method is applied to a measured in-situ spectrum. The value of the absorbed dose rate in air deduced from the corresponding flux energy distribution agrees well with the value measured directly in-situ.