C. Szepesvári, “Non-Markovian policies in sequential decision problems”, Acta Cybern, vol. 13, no. 3, pp. 305-318, Jan. 1998.