Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessment