I don't think you need to be following Infinity to get the most recent Captain Marvel, but on the other hand I didn't think it was that great, so I'm not sure it's worth bothering with it! Did you read the most recent Avengers Assemble? I'm trying to decide whether to get it or not - I wasn't going to, but then I heard it was Jess-centric and dealt with the end of Enemy Within...

There seems to be disproportionately large swaths of the comic that are not about superheroes at all
I liked the comic, but I wasn't really a fan of those bits either! (I liked the art, the atmosphere and some of the character stuff, but could take or leave the actual plot.) The film basically cuts them out completely. The Hal stuff felt like it had been cut a lot too, but I may be misremembering how much of it there was in the comic, because of how much I disliked him... :)