Phd thesis on robotics

Abstract: We establish a connection between optimizing the Bellman Residual and worst case long-term predictive error. In the online learning framework, learning takes place over a sequence of trials with the goal of predicting a future discounted sum of rewards. Our analysis shows that, together with a stability assumption, any no-regret online learning algorithm that minimizes Bellman error ensures small prediction error. No statistical assumptions are made on the sequence of observations, which could be non-Markovian or even adversarial. Moreover, the analysis is independent of the particular form of function approximation and the particular (stable) no-regret approach taken. Our approach thus establishes a broad new family of provably sound algorithms for Bellman Residual-based learning and provides a generalization of previous worst-case result for minimizing predictive error. We investigate the potential advantages of some of this family both theoretically and empirically on benchmark problems.

  1. Structure & property of material interfaces,
  2. Thin film solar cells, transparent conductors, electronic materials, investigation of optoelectronic properties, oxidation,
  3. Biomaterials, Nanotoxicology,
  4. Heat transfer and material flow modelling, Friction stir welding and processing of materials, additive manufacturing,
  5. Thermodynamic and kinetic modeling of material processes with experimental validation,
  6. Self-cleaning materials, Fusion peptides, Design of antibiotics, Drug delivery through cell-penetrating peptides

Phd thesis on robotics

phd thesis on robotics


phd thesis on roboticsphd thesis on roboticsphd thesis on roboticsphd thesis on robotics