In a medium bowl, soak potatoes in cold water, rinse, drain well, and towel dry. Place potatoes back in bowl. Drizzle olive oil on a cookie sheet. Place fish filets on top, sprinkle with salt, oregano, parsley, rosemary, and minced garlic.
Toss potatoes with oregano, salt, rosemary, garlic and olive oil. Place potatoes on cookie sheet with fish. Sprinkle with extra salt and oregano, if desired. Bake and serve!