How do I formulate soft margin SVM in primal form for quadprog function?

17 views (last 30 days)
Tushar Aggarwal
Tushar Aggarwal on 1 Nov 2015
Answered: Nitin Khola on 3 Nov 2015
I am not able to formulate the matrices needed for quadprog function to solve soft margin SVM.

Answers (1)

Nitin Khola
Nitin Khola on 3 Nov 2015
My answer is based on the following Wikipedia article and documentation links. Refer to these links for notation related questions: https://en.wikipedia.org/wiki/Support_vector_machine#Soft_margin. http://www.mathworks.com/help/optim/ug/quadprog.html
For the objective function, you just need need the H to be [1 0 0; 0 0 0; 0 0 0] assuming each of w,eta, and b are scalar quantities. In order to generalize this idea for vector w,eta, and b. You need H to be a multidimensional array so that the dimensions match when you are trying to do [w' eta' b']*H*[w eta b]. Another quantity required is "f" and it should be of the form [0; c; 0].
The constraints are linear as well. You can follow a similar method for setting up the constraints. Hope it helps!

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!