Nonlinear methods

Non-linearity may result in models that trade interpretability for increased predictive accuracy. These notes discuss the challenges of non-linearity and introduce nearest neighbors and kernel methods.

Joshua Loftus
03-08-2021

Nearest neighbors

Kernel methods

Slides, notebooks

Slides for non-linearity video ([PDF])

Slides for \(k\)-NN video ([PDF])

Slides for kernel video ([PDF])

Notebook for \(k\)-NN

Reuse

Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

Citation

For attribution, please cite this work as

Loftus (2021, March 8). Neurath's Speedboat: Nonlinear methods. Retrieved from http://joshualoftus.com/ml4ds/07-nonlinear/

BibTeX citation

@misc{loftus2021nonlinear,
  author = {Loftus, Joshua},
  title = {Neurath's Speedboat: Nonlinear methods},
  url = {http://joshualoftus.com/ml4ds/07-nonlinear/},
  year = {2021}
}