Manual Movement of Physics Objects

Hi,

I have a load of physics objects and I want to be able to move one of them via user input.

Imagine a load of balls on screen and a box which user moves.

If I just move the box object depending on user input I find the collision is not correct. Is there a correct way of handling manual movement of a physics object?