To handle 404 errors in React Router, you can use a <Route> with the 'path' prop set to '*'. This route will catch all unmatched URLs and render a 404 error component.