Microsoft has confirmed that Xbox Series X will be backwards compatible with Xbox One controllers across ALL games.
XBOX UK Tweeted "ICYMI: Xbox Series X is backwards compatible with ALL Xbox One controllers across ALL games: Official Xbox Controllers, Xbox Adaptive Controller, Xbox Elite Wireless Controllers, and SCUF Controllers."