We already have
instance Monoid m => Applicative (Const m)
we could easily add
instance Monoid m => Alternative (Const m) where
  empty = coerce mempty
  (<|>) = coerce (<>)
which trivially satisfies left/right identity and associativity.
I propose we add this instance to base.