Spatio-temporal Interactive Pedestrian Intention Prediction with Illumination Transformation

Predicting pedestrian intention is a desirable capability for the safety of intelligent vehicles (IVs).Recently, deep learning-based methods have achieved decisive progress in improving prediction accuracy. However, the majority of these methods concentrate on drab lighting environments while disregarding the importance of rich pedestrian interactions. To handle above challenges, this paper proposes a pedestrian intention prediction framework which can model complex spatio-temporal interactions with multi-illumination environments. Firstly, a multi-illumination image generation method based on generative adversarial network is constructed to reduce the impact of complex lighting. Secondly, an interaction model based on 3D convolution and dense neural network structure is conducted to capture spatial-temporal pedestrians interaction. In addition, the pre-fusion and post-fusion quantify the improvement of different fusion methods on pedestrian intention prediction. Results on JAAD dataset show that the proposed prediction framework can effectively predict pedestrian intentions.