I'm sorry but I have mis-spoke. I assumed you were talking about a Z3, not a Z4. I don't know how those doors come apart.
For a Z3, and most cars I have dealt with, the entire inner door seal is held in place with butyl tape, and you have to remove it to get to anything inside the door. You will probably need a roll of it, and it's readily available in auto parts stores and online.