You may need an adhesive removal product to help you pull any old adhesive away from the concrete. If this job sounds like it's too much work for you to handle on your own, you do have the option ...

Putting diamonds on adhesive will likely only melt ... they will leave a textured surface on the concrete. Use a tooling meant for removal for waterproof membranes, hard thick coverings, pool ...