How do I change my profile picture when using the comment feature, or Full Time editing history, in my documents?

The profile pic in the RichText comments and History are taken from Gravatar; so you can set up an account at using the same email address you're using for Overleaf. This has the added advantage that other sites you may be using, which are also using gravatar's services, will automatically be using the same profile pic!