Well since it's your first time working out, that soreness is regular. The swelling may not be. Are you sure it's swollen or is it just bigger? Except if you're truly worried about it, it could be Golfer's elbow (though it usually comes with pain): Info here:
Except, it probably isn't anything to be worried about.