F = ((W-X)^2)*((X^2-1)^(1/2))*X;
int(F,X,1, W)
ans =

As you found, int fails to generate a result. That does not mean a closed form solution does not exist. It does suggest that possibility though. It may be just that int is unable to solve the problem. In fact, I checked, and Wolfram Alpha also fails. Still that does not mean nothing can be done.
expand(F)
ans = 
And there we see the integral can be brokn into three terms. Are they all impossible to solve? Clearly not. The W is a constant, so I'll ignore that for now, just computing indefinite integrals.
int(X*sqrt(X^2 - 1),X)
ans =

int(X^3*sqrt(X^2 - 1),X)
ans =

It is an integral of this intermediate general form (with an even power of X outside) that seems to be the sticky part, at least for int.
int(X^2*sqrt(X^2 - 1),X)
ans =

In fact though, Alpha actually was able to integrate a function of that general form. The complete mess, integrating F was just a bit too complicated for Alpha to digest.
A problem is, there is a term in there you won't like. There is an asin(x) term. But if x is GREATER than 1, the arc sine will be complex. In fact, Alpha is actually nice enough to show a plot of the result, and it does indeed have an imaginary part in the indefinite integral. So that may suggest there is no real solution after all.
Is that the case? Well, actually not. The INDEFINTE integral has an imaginary part. But that imaginary part appears to be constant for x above 1. And so the imaginary part will disappear when you form the definite integral, between bounds of 1 and W, as long as W>=1.
Of course, you can be lazy, and just compute a numerical solution.
f = @(x,w) ((w-x).^2).*((x.^2-1).^(1/2)).*x;
intf = @(w) integral(@(x) f(x,w),1,w)
intf =
@(w)integral(@(x)f(x,w),1,w)
Anyway, with some effort, we could probably get MATLAB to compute the definite integral in an analytical form, since it appears an analytical solution does exist. Sometimes that requires finding a transformation that solve did not see. The obvious transformation here might be something like x = sin(u), but you will need to be careful, because this will now move into the complex plane, since x is greater than 1. The problem is doable. It just takes a little more effort at this point. Thus, if we make the desired transformation, we will have
x = sin(u)
dx = cos(u)du
int(x^2*sqrt(x^2-1)*dx) = -i*int(sin(u)^2*cos(u)^2*du)
the limits will change of course. Here we will be moving along the imaginary axis for the integral, where the limits of integration become [pi/2,asin(W)]. Remember, when W is greater than 1, asin(W) is complex.
I2 = -i*int(sin(u)^2*cos(u)^2)
I2 =

Now we can try to put it all together. I think I've gotten all of my i's dotted at this point.
resultW = int((X^3 + W^2*X)*sqrt(X^2-1),X,[1,W]) - 2*W*(subs(I2,u,asin(W)) - subs(I2,u,pi/2))
resultW =

Does this result agree with integral, when we did it in a numerical form?
intF = matlabFunction(resultW)
Yes, it does. That took a little effort, but it seeems to be working. As we hoped, all of the imaginary terms drop out.