Help my boyfriend is jealous of my guy friend! help?

ok so my friend i known him since we were in dippers, he's mom is best friends with mine. i don't see him often. like probably once or twice every few months. but we talk alot. right cuz we known each other forever. well my boyfriend and i. we hang out all the time. and that. but he doesn't like the fact when me and my mom go out and visit our friends .he was always ok with it until recently. when i asked him to come along with us. (my friend lives a few hours away) well we all went to my moms friends house. we hanged out in the basement. and my friend said something. saying he remindered he saved my life from drowning when i was younger. and we just went on takling about that. but by the end somewhere they got into a fist fight. and my boyfriend told me that i should be dating with my friend. but i don't want my friend i want him. i thought inviting him to meet him would end this jealously. but now hes saying i have having a secret love affair with my friend. wtf should i do? help!