3rd Planning and Reinforcement Learning Workshop @ ICAPS 2022

  • 2022
  • ServiceNow Research
March 01, 2022

Bridging the Gap Between AI Planning and Reinforcement Learning

Hector Palacios from ServiceNow Research will co-host the 3rd edition of the Planning and Reinforcement Learning Workshop: Bridging the Gap Between AI Planning and Reinforcement Learning as part of the 32nd International Conference on Automated Planning and Scheduling (ICAPS), which will be held virtually from June 19-24, 2022.

Both AI Planning and Reinforcement Learning communities focus on similar sequential decision-making problems. Yet, these communities remain somewhat unaware of each other on specific problems, techniques, methodologies, and evaluation. This workshop seeks to encourage discussion and collaboration between the researchers in the fields of AI Planning and Reinforcement Learning. We aim to bridge the gap between the two communities, facilitate the discussion of differences and similarities in existing techniques, and encourage collaboration across the fields.

The workshop solicits research at the intersection of the fields of Reinforcement Learning and Planning. Topics of interest include, but are not limited to:

  • Goal-directed Reinforcement Learning (model-based, Bayesian, deep, etc.)

  • Safe Reinforcement Learning and Planning

  • Monte Carlo Planning

  • Learning search heuristics for planner guidance

  • Model representation and learning for planning

  • Planning using approximated/uncertain (learned) models

  • Theoretical aspects of Planning and Reinforcement Learning

  • Action policy analysis or certification

  • Reinforcement Learning and Planning competition(s)

  • Applications of both Reinforcement Learning and Planning

  • Various levels of generalization (across goals, objects/domain, domains)

  • Goal-oriented sequential decision methods combining Planning, RL or other ML methods.

Papers should be submitted through EasyChair by Friday, March 18th (UTC-12 time zone). Make sure to visit the workshop website for further information on the submission procedure.

Got questions? Contact the organizers at prl.theworkshop@gmail.com.

To learn more about previous PRL workshops at ICAPS, visit the 2021 workshop recap. 

Workshop organizers include Michael Katz (IBM T.J. Watson Research Center). Hector Palacios (ServiceNow Research), Vicenç Gómez (Universitat Pompeu Fabra). 

We are excited to help bring this workshop together and hope to see you there!

Are you interested in doing fundamental or applied research at ServiceNow?

If you are interested in exploring full-time career opportunities with the ServiceNow Research team or wish to learn more about the part-time Visiting Researcher Program (for research internships), please take a moment to fill out this form so that hiring managers can learn more about your background and we can contact you about our current openings. Please note that ServiceNow Research internships through our Visiting Researcher Program start and run all year and are not limited to "seasonal" applications.

Follow @ServiceNowRSRCH on Twitter for our latest news, and updates from the community, and to get in touch.

© 2022 ServiceNow, Inc. All rights reserved. ServiceNow, the ServiceNow logo, Now, and other ServiceNow marks are trademarks and/or registered trademarks of ServiceNow, Inc. in the United States and/or other countries. Other company names, product names, and logos may be trademarks of the respective companies with which they are associated.


  • Total experience companies outperform: prism refraction with an arrow pointing to the right
    Employee Experience
    Survey says: Total experience-focused companies outperform
    Organizations are aligning employee experience and customer experience to create a positive total experience. See findings from the latest research.
  • 4 ServiceNow employees who worked on support case creation and auto-agent workflows
    Now on Now
    Streamlining support case creation and administration
    When customer feedback revealed areas ripe for improvement, ServiceNow employees listened and upgraded two support workflows: case creation and auto-agent.
  • Scaled Agile Framework (SAFe): business man looking at phone while standing on bridge overlooking a city
    IT Management
    How the Scaled Agile Framework (SAFe) truly supports business
    The Scaled Agile Framework (SAFe) delivery model can help IT leaders manage the transition from a stability-focused to a continuously evolving infrastructure.

Trends & Research

  • Total experience companies outperform: prism refraction with an arrow pointing to the right
    Employee Experience
    Survey says: Total experience-focused companies outperform
  • Customer service: smiling businessman on phone walking outdoors
    Customer Experience
    Survey: 3 tips to deliver world-class customer service
  • Enterprise SRE (site reliability engineering): where service reliability and business agility meet
    Application Development
    Service quality and the rising need for enterprise SRE