Clay County Sheriff Eddie says the suspect was wanted on a warrant for Possession of Methamphetamine.
Bond has yet to be set.
If convicted, the minimum sentence is 20 years in prison. The maximum penalty is life in jail.
Once the suspect had them, they demanded more and threaten to post the existing photos online. That's when she went to law enforcement.
He faces Felony Eluding, Possession of Meth and Destruction of Evidence charges.
He was reported missing the Sunday after borrowing a truck, trailer and lawnmower without returning them.
Oktibbeha County investigators say the argument started outside of Starkville, but ended inside the city limits.
The purse was later recovered at Zuber Park by city workers.
This is a developing story and will be updated.
The suspect turned himself in on Tuesday. He's been released on a $1,000 bond.