Biceps Tendinitis. Biceps tendinitis is an inflammation or irritation of the upper biceps tendon. Also called the long head of the biceps tendon, this strong, cord-like structure connects the biceps muscle to the bones in the shoulder. Pain in the front of the shoulder and weakness are common symptoms of biceps tendinitis.