Solution: Error starting daemon: Error initializing network controller: could not delete the default bridge network: network bridge has active endpoints

Followed this link and tried to remove /var/lib/docker/network and it worked :)
Used command sudo rm -r /var/lib/docker/network

Ref: https://github.com/docker/docker/issues/17083