That's the insidiousness of various tropes. Blood magic may be relatively innocuous (as far as racism goes) in any number of instances, but it's the intersection of different factors that increases the problem. Using blood in rituals, greedy race that controls the banks, etc. This is why publishers need to use sensitivity consultants - people who can stay alert to the way these things factor together.
But at what point do things become ridiculous and laughable? Even IF the intent was to create the Goblins as an evil view on Jewish people, how serious do you think people who read/watch/play Harry Potter will take that. Even IF that intent was there, the parallels are so detail specific, that most people who this was made for will never realize it without specific help. And even if pointed out, most will just shrug, pat you on the head and advise you to wear your tinfoilhat and watch the skies for aliens... ;-)
We can look for parallels in many other stories/properties. Let's look at the Smurfs: Smurfette was create as a Golem like creature by the evil wizard Gargamel... Do I need to draw a map how you can draw connections? O wait, someone already wrote a book about that (Antoine Buéno) as well, over ten years ago! What about D&D, should we just remove Golems altogether under the banner of cultural appropriation?
If you're out looking for 'something', you'll find 'something' to get someone offended. If you try hard enough you could make a spoon the most racist tool ever created. Depending on who does it and how, it will either result in people laughing hard at you or it being the start of some moral crusade...
But why the heck would I equal a fantasy world Goblin with a real world life person? And even going further then that, ascribing motivations to those real life people based on some fantasy fiction? Are there people that do? Sure, but there are also people that belief the world is flat when shown the science to proof it's not. There is no fixing stupid! And polarizing everything will just create more stupid people and more hate.
Now, from the other side. I have to ask why someone Jewish would feel a resemblance to those same fantasy Goblins? Do all Scottish and/or 'large' people suddenly feel a resemblance to Shrek? I really hope not! Are there such people, of course, but see my previous answer...