How about a thickwall tube with the inside turned to correct size.
Mill half of drill and tapp for 2 pieces holding the bearing half in place.
Preferably the last finish cut of the inside diameter would be done in the same setup as the sizing to prevent any offset in the chuck to give offset/angle in the bearing.
This way you take the pressfit out of the picture.
Would be faster setup.
What a trainwreck of a drawing compared to the nice solidmodel
