search-head

Sie sind hier: Homepage >  Suche

    Joint caching and computing service placement for edge-enabled IoT based on deep reinforcement learning

    Joint caching and computing service placement for edge-enabled IoT based on deep reinforcement learning

    Freier Zugriff

    Abstract By placing edge service functions in proximity to IoT facilities, edge computing can satisfy various IoT applications’ resource and latency requirements. Sensing-data-driven IoT applications are prevalent in IoT systems, and their task processing relies on sensing data from sensors. Therefore, to ensure the quality of service (QoS) of such applications in an edge-enabled IoT system, dedicated caching functions (CFs) are required to cache necessary sensing data. This paper considers an edge-enabled IoT system and investigates the joint caching and computing service placement (JCCSP) problem for sensing-data-driven IoT applications. Then, deep reinforcement learning (DRL) is exploited since it can adapt to a heterogeneous system with limited prior knowledge. In the proposed DRL-based approaches, a policy network based on the encoder-decoder model is constructed to address the issue of varying sizes of JCCSP states and actions caused by different numbers of CFs related to applications. Then, an on-policy REINFORCE-based method is adopted to train the policy network. After that, an off-policy training method based on the twin-delayed (TD) deep deterministic policy gradient (DDPG) is proposed to enhance the training efficiency and experience utilization. In the proposed DDPG-based method, a weight-averaged twin-Q-delayed (WATQD) algorithm is introduced to reduce the bias of Q-value estimation. Simulation results show that our proposed DRL-based JCCSP approaches can achieve converged performance that is significantly superior to benchmarks. Moreover, compared with the original TD method, the proposed WATQD method can significantly improve the training stability.

    Zugriff

    Download

    Exportieren, teilen und zitieren

    Dokumentinformationen

    Titel :

    Joint caching and computing service placement for edge-enabled IoT based on deep reinforcement learning

    Beteiligte:
    Chen, Y. (Yan) (Autor:in) / Sun, Y. (Yanjing) (Autor:in) / Yang, B. (Bin) (Autor:in) / Taleb, T. (Tarik) (Autor:in)
    Erscheinungsdatum :

    2022-01-01

    Medientyp :

    Aufsatz (Zeitschrift)

    Format :

    Elektronische Ressource

    Sprache :

    Englisch

    Schlagwörter :

    IoT , deep reinforcement learning , edge computing , joint service placement , sensing-data-driven applications

    Klassifikation :

    DDC:    629

    Ähnliche Titel

    A Federated Learning-Based Edge Caching Approach for Mobile Edge Computing-Enabled Intelligent Connected Vehicles

    Li, Chunlin / Zhang, Yong / Luo, Youlong | IEEE | 2023

    Cooperative Edge Caching via Federated Deep Reinforcement Learning in Fog-RANs

    Zhang, M. (Min) / Jiang, Y. (Yanxiang) / Zheng, F.-C. (Fu-Chun) et al. | BASE | 2021

    Freier Zugriff

    Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System

    Ning, Zhaolong / Zhang, Kaiyuan / Wang, Xiaojie et al. | IEEE | 2021

    Deep Learning Based Caching for Self-Driving Cars in Multi-Access Edge Computing

    Ndikumana, Anselme / Tran, Nguyen H. / Kim, Do Hyeon et al. | IEEE | 2021

    Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

    Zhang, Degan / Wang, Wenjing / Zhang, Jie et al. | IEEE | 2023

    Zugriff

    Download

    Seitennavigation

    Dokumentinformationen

    Ähnliche Titel

    Exportieren, teilen und zitieren