Try force starting it once more:
Press and hold Home and Power button until you see the Apple logo again. As soon as it’s visible, let go of both buttons, your device should power up on it’s own. If that doesn’t work, use recovery mode:
Connect your iPhone to a computer. Locate your iPhone, if possible. Press and hold Home and Power button until you see the recovery mode screen: