Is it worth it? That depends entirely on how badly you want to be a physician and whether there are alternative careers from which you would find a comparable level of satisfaction (both professionally and in your personal life).
It's possible, but definitely an uphill battle. I graduated from my first degree with a lower GPA than yours, spent the next 6 yrs making up for my failure during my first degree (ECs, MCAT, GPA), and will be starting med school in the fall. I kept going because the value that I assigned to being an MD is greater than the time and dedication that I sacrificed (and will continue to sacrifice).
Have you calculated your weighted GPA for each school? Is there a strong upward trend? This will determine how much more work you have ahead of you.
Think carefully about what it is specifically about being an MD that appeals to you, and how you might be able to achieve your goals through another route.