Mobility Prediction Based on Deep Learning Approach Using GPS Phone Data

Suhad Faisal Behadil; Nabaa Kareem Mhalhal1

doi:10.30526/37.4.3916

Authors

Suhad Faisal Behadil Computer Science Department, College of Sciences, University of Baghdad, Baghdad, Iraq. https://orcid.org/0000-0003-4617-8464
Nabaa Kareem Mhalhal1 Computer Science Department, College of Sciences, University of Baghdad, Baghdad, Iraq. https://orcid.org/0009-0007-5803-9273

DOI:

https://doi.org/10.30526/37.4.3916

Keywords:

Recurrent Neural Network, RNNs, Gated Recurrent Unit (GRU), Density-Based Clustering (DBSCAN), Next Location Path, Deep Learning

Abstract

Accurate prediction of activity location is a crucial component in various mobility applications and is particularly vital for the creation of customized, environmentally friendly transport systems. Next-location prediction, which entails predicting a user's forthcoming place by analyzing their previous movement patterns, has substantial ramifications in diverse fields, such as urban planning, geo-marketing, disease transmission, wireless network performance, recommender systems, and numerous other sectors. Recently, researchers have proposed a variety of predictors, including cutting-edge ones that utilize advanced deep learning methods, to tackle this problem. This study introduces robust models for predicting a user's future location based on their previous location. It proposes a Recurrent Neural Networks (RNNs) prediction scheme and a Gated Recurrent Unit (GRU), which are well-suited for learning from sequential data. Additionally, the clustering technique Density-Based Clustering (DBSCAN) is implemented to extract the stay points. Furthermore, the suggested method is more accurate at predicting the future than the current method, showing improvements in loss mean square error of up to 0.0005 in the RNN model and 0.01 in the GUR model. So, the models that were used led to a decrease in loss MSE, which was shown in the real-world dataset (Geolife) in this paper. The results are also consistent with other similar works that look at the same issue, showing how well the models can predict mobility.

References

Zaidi, S.M.A.; Chandola, V.; Yoo, E.-H. DST-Predict: Predicting Individual Mobility Patterns From Mobile Phone GPS Data. IEEE Access 2021, 9, 167592–167604. https://doi.org/10.1109/ACCESS.2021.3134586

Mo, B.; Zhao, Z.; Koutsopoulos, H.N.; Zhao, J. Individual Mobility Prediction in Mass Transit Systems Using Smart Card Data: An Interpretable Activity-Based Hidden Markov Approach. IEEE Transactions on Intelligent Transportation Systems 2022, 23(8), 12014–12026. https://doi.org/10.1109/TITS.2021.3109428

Aloubade, Y.K.A. Developing and Organizing an Easy Work Environment For Users of Computers Using Information Technology. Ibn AL-Haitham Journal For Pure and Applied Sciences 2022, 35(2), 117–130. https://doi.org/10.30526/35.2.2808

Li, Q.; Zou, D.; Xu, Y. Combining Individual Travel Behaviour and Collective Preferences for next Location Prediction. Transportmetrica A: Transport Science 2022, 18(3), 1754–1776, https://doi.org/10.1080/23249935.2021.1968066

Wang, X.; Fang, M.; Zeng, Z.; Cheng, T. Where Would I Go Next? Large Language Models as Human Mobility Predictors. arXiv preprint arXiv 2023, arXiv:2308.15197. https://doi.org/10.48550/arXiv.2308.1519

AlQaysi, M.K.; Salam Ali, S.F.B. Spatiotemporal Modeling in Wireless Communication Networks. Baghdad Science Journal 2022, 20(3), 0904-0904. https://dx.doi.org/10.21123/bsj.2022.6848

Hong, Y.; Martin, H.; Raubal, M. How do you go where? improving next location prediction by learning travel mode information using transformers. In Proceedings of the 30th International Conference on Advances in Geographic Information Systems, Seattle, Washington, 2022, Article No.: 61, 1-10. https://doi.org/10.1145/3557915.3560996

Alqaysi, M.K.; Behadili, S.F. Gravity Model for Flow Migration within Wireless Communication Networks. Iraqi Journal Science 2022, 63(10), 4474–4487. https://doi.org/10.24996/ijs.2022.63.10.32

De Barrena, T.F.; Ferrando, J.L.; García, A.; Badiola, X.; de Buruaga, M.S.; Vicente, J. Tool Remaining Useful Life Prediction Using Bidirectional Recurrent Neural Networks (BRNN). The International Journal of Advanced Manufacturing Technology 2023, 125(9), 4027–4045. https://doi.org/10.1007/s00170-023-10811-9

Mijwil, M.; Salman Shukur, B. A Scoping Review of Machine Learning Techniques and Their Utilisation in Predicting Heart Diseases. Ibn AL-Haitham Journal For Pure and Applied Sciences 2022, 35(3), 175–189. https://doi.org/10.30526/35.3.2813

Mo, B.; Zhao, Z.; Koutsopoulos, H.N.; Zhao, J. Individual Mobility Prediction: An Interpretable Activity-Based Hidden Markov Approach. arXiv preprint arXiv 2021, arXiv :2101.03996. https://doi.org/10.48550/arXiv.2101.03996

Chen, P.; Shi, W.; Zhou, X.; Liu, Z.; Fu, X. STLP-GSM: A Method to Predict Future Locations of Individuals Based on Geotagged Social Media Data. International Journal of Geographical Information Science 2019, 33(12), 2337–2362. https://doi.org/10.1080/13658816.2019.1630630

Asad, S.M. User Mobility Prediction and Management Using Machine Learning, Doctoral dissertation, University of Glasgow, 2022. https://doi.org/10.5525/gla.thesis.83181

Yan, M.; Li, S.; Chan, C.A.; Shen, Y.; Yu, Y. Mobility prediction using a weighted Markov model based on mobile user classification. Sensors 2021, 21(5), 1740. https://doi.org/10.3390/s21051740

Luca, M.; Pappalardo, L.; Lepri, B.; Barlacchi, G. Trajectory Test-Train Overlap in next-Location Prediction Datasets. Machine Learning 2023, 112(11), 4597–4634. https://doi.org/10.1007/s10994-023-06386-x

Graser, A.; Jalali, A.N.; Lampert, J.; Weißenfeld, A.; Janowicz, K. Deep Learning From Trajectory Data: a Review of Deep Neural Networks and the Trajectory Data Representations to Train Them. In Proceedings of the EDBT/ICDT Workshops, 2023.

Liao, D.; Liu, W.; Zhong, Y.; Li, J.; Wang, G. Predicting Activity and Location with Multi-Task Context Aware Recurrent Neural Network. IJCAI Int. Jt. Conf. Artif. Intell. 2018, 3435–3441. https://doi.org/10.24963/ijcai.2018/477

Gao, Q.; Zhou, F.; Trajcevski, G.; Zhang, K.; Zhong, T.; Zhang, F. Predicting human mobility via variational attention. In Proceedings of the The world wide web conference. 2019, 2750-2756. https://doi.org/10.1145/3308558.331361

K, Prinz. Next Place Prediction with Hidden Markov Models. Master's thesis, Johannes Kepler University Linz, Institute of Networks and Security, Linz, Austria, 2019.

Nurhaida, I.; Noprisson, H.; Ayumi, V.; Wei, H.; Putra, E.D.; Utami, M.; Setiawan, H.; Dwika Putra, E.; Utami, M.; Setiawan, H. Implementation of Deep Learning Predictor (LSTM) Algorithm for Human Mobility Prediction. International Journal of Interactive Mobile Technologies (iJIM) 2020, 14(18), 132–144. https://doi.org/10.3991/ijim.v14i18.16867

Zheng, Y.; Wang, L.; Zhang, R.; Xie, X.; Ma, W.-Y. GeoLife: Managing and Understanding Your Past Life over Maps. In Proceedings of the The Ninth International Conference on Mobile Data Management , Beijing, China, 2008, 211–212. https://doi.org/10.1109/MDM.2008.20

Faizan, M.; Zuhairi, M.F.; Ismail, S.; Sultan, S. Applications of Clustering Techniques in Data Mining: A Comparative Study. International Journal of Advanced Computer Science and Applications 2020, 11(12), 146–153. https://doi.org/10.14569/IJACSA.2020.0111218

Yang, Y.; Qian, C.; Li, H.; Gao, Y.; Wu, J.; Liu, C.J.; Zhao, S. An Efficient DBSCAN Optimized by Arithmetic Optimization Algorithm with Opposition-Based Learning. J. Supercomput. 2022, 78(18), 19566–19604. https://doi.org/10.1007/s11227-022-04634-w

Jiang, K.; Huang, Z.; Zhou, X.; Tong, C.; Zhu, M.; Wang, H. Deep Belief Improved Bidirectional LSTM for Multivariate Time Series Forecasting. Math. Biosci. Eng. 2023, 20(9), 16596–16627. https://doi.org/10.3934/mbe.2023739

Z., Z.; E. A., P.A.; M. H., H. Predicting Machine Failure Using Recurrent Neural Network-Gated Recurrent Unit (RNN-GRU) through Time Series Data. Bulletin of Electrical Engineering and Informatics 2021, 10(2), 870–878. https://doi.org/10.11591/eei.v10i2.2036

Shiri, F.M.; Perumal, T.; Mustapha, N.; Mohamed, R. A Comprehensive Overview and Comparative Analysis on Deep Learning Models: CNN, RNN, LSTM, GRU. arXiv 2023, arXiv:2305.17473. https://doi.org/10.48550/arXiv.2305.17473

Ghojogh, B.; Ghodsi, A. Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey. arXiv 2023, arXiv:2304.11461. https://doi.org/10.48550/arXiv.2304.11461

Luca, M.; Barlacchi, G.; Lepri, B.; Pappalardo, L. A Survey on Deep Learning for Human Mobility. ACM Computing Surveys (CSUR) 2021, 55(1), 1 – 44. https://doi.org/10.1145/3485125

Javid, A.M.; Das, S.; Skoglund, M.; Chatterjee, S. A ReLU dense layer to improve the performance of neural networks. In Proceedings of the ICASSP 2021—2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada, 2021, 2810-2814. https://doi.org/10.1109/ICASSP39728.2021.9414269

Yang, J.; Cao, J.; Liu, Y. Deep Learning-Based Destination Prediction Scheme by Trajectory Prediction Framework. Security and Communication Networks 2022, 8385854. https://doi.org/10.1155/2022/8385854

Joseph, F.J.J.; Nonsiri, S.; Monsakul, A. Keras and TensorFlow: A hands-on experience. Advanced deep learning for engineers and scientists: A practical approach 2021, 85–111. https://doi.org/10.1007/978-3-030-66519-7_12

Reyad, M.; Sarhan, A.M.; Arafa, M. A Modified Adam Algorithm for Deep Neural Network Optimization. Neural Computing and Applications 2023, 35(23), 17095–17112. https://doi.org/10.1007/s00521-023-08568-z

Bhimavarapu, U.; Battineni, G.; Chintalapudi, N. Improved Optimization Algorithm in LSTM to Predict Crop Yield. Computers 2023, 12(1), 10. https://doi.org/10.3390/computers12010010

Guo, B.; Wang, K.; Yang, H.; Zhang, F.; Wang, P. A New Individual Mobility Prediction Model Applicable to Both Ordinary Conditions and Large Crowding Events. Journal of advanced transportation 2023, 2023(1), 3463330, 1-14 . https://doi.org/10.1155/2023/3463330

Tajmouati, S.; Wahbi, B. El; Bedoui, A.; Abarda, A.; Dakkoun, M. Applying K-Nearest Neighbors to Time Series Forecasting : Two New Approaches. Journal of Forecasting 2024, 43(5), 1559–1574. https://doi.org/10.1002/for.3093

Ouaret, R.; Birregah, B.; Soulier, E.; Auclair, S.; Boulahya, F. Random Forest Location Prediction from Social Networks during Disaster Events. Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS), Granada, Spain, 2019, 535-540. https://doi.org/ 10.1109/SNAMS.2019.8931863.

Satopaa, V.; Albrecht, J.; Irwin, D.; Raghavan, B. Finding a “Kneedle” in a Haystack: Detecting Knee Points in System Behavior. In 2011 31st international conference on distributed computing systems workshops 2011, MN, USA, 166–171. IEEE https://doi.org/ 10.1109/ICDCSW.2011.20