Those are power led's, they show its got power. There is nothing wrong.
They are infamous as the only way to not show them is to disable Erp in bios. But then wake on lan won't work -
link
Are they on if you turn pc on and then off again? I have some things that will turn on when I plug PC back in and the power is off, but its mostly peripherals. They do turn off with windows though.