Interior door handle removal ??'s

How do you take off the interior door handle to get off the door panel so i can put in my shaved door handle kit? I have everything removed but the door handle won't come off so i can't get the door panel off.