Research

My research lies in applied probability, with a focus on reinforcement learning (RL) algorithms in hard-exploration environments — settings where reward signals are sparse or highly stochastic. I study these problems through the framework of rare event estimation and simulation, using tools from stochastic processes, measure changes via exponential martingales, large deviation principles, and Feynman–Kac semigroups.

PhD thesis (in progress)

Exploration in reinforcement learning with scarce resources
Cotutelle: LAAS-CNRS / Université de Toulouse III & PEDECIBA / Universidad de la República.
Supervisors: Paola Bermolen (Uruguay), Matthieu Jonckheere (France).
Expected defense: October 2026.

Journal articles

  • E. Garcia, P. Bermolen, M. Jonckheere, S. Shneer. Efficiency of Parallel and Restart Exploration Strategies in Model Free Stochastic Simulations. Accepted in Stochastic Systems (INFORMS). arXiv:2503.03565

  • E. Garcia, P. Lessa. Dimension drop of harmonic measure for some finite range random walks on Fuchsian Schottky groups. Probability Theory and Related Fields, 2025. doi:10.1007/s00440-025-01404-6

  • E. Garcia, P. Lessa. On the discreteness of states accessible via right-angled paths in hyperbolic space. L’Enseignement Mathématique, 66, No. 3-4, 2020. doi:10.4171/LEM/66-3/4-4

Conference papers

  • E. Garcia, D. Mastropietro, P. Bermolen, M. Jonckheere. When to Parallelize Stochastic Exploration of Rare Rewards in Reinforcement Learning. Accepted at EUSIPCO 2026, Bruges, Belgium (August–September 2026).

In preparation

  • Moran Particle Systems for efficient policy evaluation in reinforcement learning with rare rewards (working title).

Research projects

  • Stochastic Models for Complex Interacting Systems · MATH-AmSud (South America–France), 2025–2027.
    Analysis of complex stochastic systems: interacting particle systems, random graphs, log-correlated fields, and SDEs. Role: Participant.

  • Learning and Control on Complex Networks (LAGOON) · STIC-AmSud (Argentina–Uruguay–France), 2023–2025.
    Machine learning and probability on complex networks. Coordinated by Prof. Matthieu Jonckheere (France). Role: Participant.

  • Grupo CSIC Probabilidad y Estadística · CSIC, Universidad de la República (Uruguay), 2023–.
    Coordinators: Prof. Ernesto Mordecki and Prof. Federico Dalmao.

  • Latitude – Crossroad between dynamical systems and group actions · MATH-AmSud (Uruguay–France–Chile), 2020–2022.
    Dynamics of flows in negative curvature, entropy, Lyapunov exponents, and growth in discrete groups of isometries. Included a research stay at Université de Rennes 1 (November 2021), under the supervision of Prof. Françoise Dal’Bo. Role: Participant.

Grants & fellowships

  • 2023–2026: Doctoral contract, LAAS-CNRS, Toulouse.
  • 2020–2022: Master’s fellowship, ANII (POS NAC 2019 1 157798).
  • 2018: Santander Iberoamérica undergraduate grant — research stay at FaMAF, Universidad Nacional de Córdoba, Argentina.