Reading a 32-bit field

A network protocol sends a 32-bit value in big-endian order. On a little-endian MCU, which code reads it correctly and portably from a byte buffer?

uint8_t *p = rx_buf + 4;