6

In this git repo the online learning algorithms are classified as first order and second order. I tried searching what it means, yet I'm unable to understand the different between such first oder and second order online learning algorithms.

What is the difference between first order and second order online learning?

Stephen Rauch
  • 1,831
  • 11
  • 23
  • 34
Nadheesh
  • 61
  • 3

1 Answers1

4

First order and second order algorithms are algorithms which use respectively at least first derivative / second derivative.

This post explains well the definition.

alexandre_d
  • 428
  • 4
  • 12