Some further discover. Run Ubuntu Live CD on the laptop, the display can light up correctly, default in portrait though, but can be adjusted. When connecting to HDMI, it will stick on portrait.
With xrandr command, I can see the display is eDP1. It seems that eDP1 can use LVDS to drive, but...