Would he want me back?

He has conquered & it's over! Sorry. That's the way male Whores are. If you can find another job, do so because it will be very uncomfortable working there with him. You miss that attention he's been giving you ... is all.