Wind power

Planning and scheduling in smart grids

The emergence of renewable energy sources in distribution grids creates several important challenges. For instance, power production will be more dependent on the weather (e.g., solar panels and wind turbines), and grids become congested if many consumers use electricity at the same time (e.g., electric vehicles). In the GCP project we develop AI-based algorithms to schedule flexible consumption of consumers, taking into account the capacity constraints of the grid and uncertainty in renewable power supply. My work can be subdivided into two research lines:

1) My planning research focuses on scalable algorithms for single-agent and multi-agent planning under uncertainty using Partially Observable Markov Decision Processes. I am particularly interested in planning algorithms which combine insights from AI and Operations Research.

2) We apply Constrained Markov Decision Processes to match demand and supply in smart distribution grids. Computational and algorithmic challenges arise from the large number of agents, line characteristics and power flows in the grid.

Publications

Column Generation Algorithms for Constrained POMDPs

Erwin Walraven and Matthijs T. J. Spaan
Journal of Artificial Intelligence Research, vol. 62, pp. 489–533, 2018.

Bootstrapping LPs in Value Iteration for Multi-Objective and Partially Observable MDPs

Diederik M. Roijers, Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 28th Int. Conference on Automated Planning and Scheduling, pp. 218–226, 2018.

Accelerated Vector Pruning for Optimal POMDP Solvers

Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3672–3678, 2017.

Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs

Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt and Matthijs T. J. Spaan
Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3562–3568, 2017.

Resource-constrained Multi-agent MDP Planning with Bounded Violation Probability

Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt and Matthijs T. J. Spaan
NIPS workshop on Learning, Inference and Control of Multi-Agent Systems, 2016.

Planning Under Uncertainty for Aggregated Electric Vehicle Charging with Renewable Energy Supply

Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 22nd European Conference on Artificial Intelligence, pp. 904–912, 2016.

Planning under Uncertainty for Aggregated Electric Vehicle Charging using Markov Decision Processes

Erwin Walraven and Matthijs T. J. Spaan
International Workshop on Artificial Intelligence for Smart Grids and Smart Buildings, 2016.

Planning under Uncertainty with Weighted State Scenarios (extended abstract)

Erwin Walraven and Matthijs T. J. Spaan
AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015.

Planning under Uncertainty with Weighted State Scenarios

Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence, pp. 912–921, 2015.

A Scenario State Representation for Scheduling Deferrable Loads under Wind Uncertainty

Erwin Walraven and Matthijs T. J. Spaan
The 10th Annual Workshop on Multiagent Sequential Decision Making Under Uncertainty, 2015.