Mobile devices today are expected to do far more than make calls and stream video. They run artificial intelligence applications, process sensor data, and execute computation-intensive workloads that often exceed the capabilities of their own batteries and processors. Mobile Edge Computing (MEC) has emerged as one of the most promising answers to this problem, allowing terminal devices either to perform tasks locally or to offload them to edge servers positioned close to the user. But the technology has a stubborn weakness: the wireless link between a device and its edge server can be badly degraded by the very city it serves, blocked by buildings, walls, and other obstacles that scatter and absorb the signal.
A new study published in the Journal of Network and Systems Management offers a strikingly elegant solution to this urban connectivity problem, and it comes from an unexpected direction — the sky. A research team led by Fang Xu and Zhiqiang Zhang of Hubei Engineering University and Hubei University, working with colleagues including Jian Yu, Min Deng, Yan Zhang, and Junchao Zhou, has developed a framework that combines a drone-borne Reconfigurable Intelligent Surface (RIS) with deep reinforcement learning to jointly optimize how mobile devices compute, offload, and communicate. The results suggest that by placing a programmable reflecting panel in the air and teaching it to steer signals intelligently, energy consumption in heavily loaded edge computing systems can be slashed by as much as 85.9 percent compared with conventional deep reinforcement learning baselines.
A Reconfigurable Intelligent Surface is, at its core, a planar array of many low-cost, nearly passive reflecting elements, each of which can be tuned to impose a controllable phase shift on an incoming electromagnetic wave. When the phases of these elements are coordinated, the surface can reflect impinging signals toward a chosen destination with constructive alignment, effectively creating a virtual mirror whose shape and orientation are defined in software rather than hardware. Mounted on an unmanned aerial vehicle, such a surface gains a further advantage: it can be repositioned to wherever the propagation environment demands, hovering above rooftops to establish alternative communication paths that bypass the obstacles choking ground-level links. In the system envisioned by the researchers, a UAV-RIS floats between battery-limited user devices and a nearby edge server, providing connectivity precisely where the direct channel fails.
The difficulty, of course, is that the environment is never static. Tasks arrive at user devices stochastically, channel conditions fluctuate with the movement of people and vehicles, and the queue of pending computations at each device grows and shrinks in ways that are difficult to predict. Optimizing such a system is a joint problem of formidable complexity: each device must decide how much computation to perform locally, how much power to devote to offloading its tasks wirelessly, and the RIS must simultaneously reconfigure its phase shifts so that the reflected signals from multiple users add up constructively at the edge server. Decisions in each of these domains affect all the others, and the action space grows combinatorially with the number of users and RIS elements.
To tame this problem, the team proposed a joint optimization scheme for local computation, task offloading, and RIS phase control that explicitly accounts for stochastic task arrivals and channel variations. Their solution is a deep reinforcement learning framework in which the optimization burden is split according to the mathematical character of each subproblem. RIS phase control, which involves continuous-valued phase shifts, is handled by the Deep Deterministic Policy Gradient (DDPG) algorithm, an actor-critic method capable of learning smooth policies over continuous action spaces. User power allocation, by contrast, is optimized through a multi-user parallel Twin Delayed Deep Deterministic Policy Gradient (TD3) architecture, allowing each user’s transmission power decisions to be learned in parallel while accounting for the mutual interference that couples users sharing the same spectrum.
The rationale behind this division of labor is technically significant. DDPG is known for efficient learning in continuous domains but can suffer from overestimation of action values, which the TD3 algorithm mitigates through twin critics and delayed policy updates. By deploying a parallel multi-user TD3 structure for power control, the framework captures the interdependence of users’ offloading decisions — when one device transmits more aggressively, it raises the interference floor for its neighbors, so no user’s power policy can be optimized in isolation. Meanwhile, the DDPG agent tunes the RIS phases as the channel and task queues evolve, keeping the reflected links aligned with the users who need them most at each moment. The result is a layered decision-making system in which communication and computation are optimized together rather than in sequence.
Simulation results reported in the paper demonstrate that this joint framework outperforms conventional centralized DDPG, centralized TD3, and the multi-agent MADDPG scheme. The gains are most dramatic under high-load conditions, exactly the regime in which edge networks are most likely to fail their users in practice. Compared with the DDPG baseline, the proposed approach reduces total device energy consumption by up to 85.9 percent. Compared with the TD3 baseline, it decreases the average task queue length by 26.7 percent, meaning that waiting computations are cleared faster and users experience less delay. Taken together, the two figures indicate that the framework achieves a superior trade-off between energy efficiency and task processing latency — the twin currencies by which mobile edge systems are judged.
The implications of the queue-length result deserve particular attention. In MEC systems, energy consumption and delay are usually in tension: offloading aggressively saves local computation energy but costs transmission energy and waiting time, while computing everything locally does the reverse. The queue length captures the backlog of unprocessed tasks and is a direct proxy for user-perceived latency. A 26.7 percent reduction suggests that the learned policies are not merely saving battery life but genuinely improving the responsiveness of the system, dispatching tasks along whatever path — local execution or RIS-enhanced offloading — serves them best as conditions change. Because the RIS phase configuration is adjusted dynamically, the system can follow users and channel fluctuations in real time rather than committing to a static reflection pattern.
The work also contributes to a rapidly growing research conversation about the future of wireless infrastructure. Reconfigurable intelligent surfaces are widely viewed as a candidate technology for sixth-generation (6G) networks, promising to turn the random reflections of the physical environment into a controllable design element. Prior studies have explored RIS mounted on buildings, on balloons, and on UAVs for applications ranging from data collection in dense urban environments to emergency communications in disaster zones. What distinguishes the present study is its holistic treatment of the computation problem: rather than optimizing the aerial link alone, it embeds the UAV-RIS within the full MEC decision loop, where task arrivals, battery budgets, and queue dynamics all shape the optimal behavior of the surface and the devices alike.
The research was carried out by authors affiliated with the School of Computer and Information Science at Hubei Engineering University in Xiaogan, the School of Computer Science at Hubei University in Wuhan, and the School of Mathematics and Statistics at Hubei Engineering University. It was supported by the National Natural Science Foundation of China, the Natural Science Foundation of Hubei Province, and several provincial education research programs. The team reports that no external datasets were generated or analyzed during the study, with results obtained through simulation of the proposed system model.
For the wireless industry, the study offers a concrete demonstration that intelligent surfaces and machine learning can be combined not as separate add-ons but as a single, coordinated control system. As cities densify and the appetite for on-device intelligence grows, the bottleneck will increasingly be the radio link between power-hungry devices and the compute resources that serve them. A drone hovering above the skyline, quietly reprogramming the phases of its reflective skin to bounce signals around concrete canyons while an AI agent decides which device should compute, transmit, or wait, may be a glimpse of how that bottleneck gets solved.
Subject of Research: Joint optimization of local computation, task offloading, and RIS phase control in a UAV-mounted reconfigurable intelligent surface-assisted mobile edge computing system using deep reinforcement learning.
Subject of Research: Technology and Engineering
Article Title: Joint Optimization of UAV-Mounted RIS-Assisted Mobile Edge Computing Using Deep Reinforcement Learning
Article References: Xu, F., Zhang, Z., Yu, J., Li, C., Deng, M., Su, L., Zhang, Y., & Zhou, J. (2026). Joint Optimization of UAV-Mounted RIS-Assisted Mobile Edge Computing Using Deep Reinforcement Learning. Journal of Network and Systems Management, 34(4), Article 125. https://doi.org/10.1007/s10922-026-10098-7
Image Credits: AI Generated
DOI: 10.1007/s10922-026-10098-7
Keywords: Mobile edge computing, Reconfigurable intelligent surface, Unmanned aerial vehicle, Deep reinforcement learning, Phase control, Power allocation, Task offloading, Energy efficiency, DDPG, TD3
Cite Scienmag News
APA MLA Chicago
Marilyn Langley. (September 3, 2026). Deep Reinforcement Learning Optimizes Drone-Mounted Smart Surfaces for Edge Computing. Scienmag. https://scienmag.com/deep-reinforcement-learning-optimizes-drone-mounted-smart-surfaces-for-edge-computing/
Marilyn Langley. “Deep Reinforcement Learning Optimizes Drone-Mounted Smart Surfaces for Edge Computing.” Scienmag, 3 September 2026, https://scienmag.com/deep-reinforcement-learning-optimizes-drone-mounted-smart-surfaces-for-edge-computing/. Accessed 3 September 2026.
Marilyn Langley. “Deep Reinforcement Learning Optimizes Drone-Mounted Smart Surfaces for Edge Computing.” Scienmag. September 3, 2026. https://scienmag.com/deep-reinforcement-learning-optimizes-drone-mounted-smart-surfaces-for-edge-computing/
Copy citation Download RIS
Tags: AI-driven edge computing frameworksAI-driven network resource allocationautonomous drone deployment for network optimizationdeep reinforcement learning for wireless networksdrone-assisted signal enhancementdrone-based network infrastructureDrone-mounted intelligent surfacesDrone-mounted Reconfigurable Intelligent Surfacesedge computing optimizationmobile edge computing challengesobstacle-aware wireless communicationobstacle-aware wireless link managementreconfigurable intelligent surfaces in communicationreinforcement learning in communication systemssmart surfaces for 5G/6G networkssmart surfaces for signal reflectionurban connectivity solutionsurban environment signal propagation mitigationurban signal scattering mitigation
