Calculating Prompt Self Attention for SAM