Checklist

• I am sure the error is coming from Pyrogram's code and not elsewhere.
• I have searched in the issue tracker for similar bug reports, including closed ones.
• I ran pip3 install -U https://github.com/pyrogram/pyrogram/archive/master.zip and reproduced the issue using the latest development version.

Description

The bot will get stuck when all workers are busy uploading a file ONLY if a progress function is specified, I tried with 2 and 4 workers (respectively with 2 and 4 files) and I got stuck anyway.
It seems the progress function is not even called as I cannot see the prints on the console.
Below the code you will find the files I used as example, as you can see they are very small and so they should be uploaded almost immediately.
If the files are uploaded one at a time or without the progress function specified the upload goes well and everything is okay.
P.S. I am on Windows 10 x64, tried with Python 3.7 and 3.9

from pyrogram import Client, idle
from pyrogram.filters import command, regex
from pyrogram.types import (
    CallbackQuery,
    InlineKeyboardButton,
    InlineKeyboardMarkup,
    Message,
)

api_id = ""
api_hash = ""
token = ""
APP = Client("bug_test", api_id, api_hash, bot_token=token, workers=2)


def FProgress(current, total):
    print(current, total)


@APP.on_callback_query(regex(r"^up"))
def CbQryUpload(_, cb_qry: CallbackQuery):
    cb_qry.answer("ok")
    if cb_qry.data == "up1":
        cb_qry.message.reply_document("f1.txt", progress=FProgress)
    elif cb_qry.data == "up2":
        cb_qry.message.reply_document("f2.txt", progress=FProgress)


@APP.on_message(command("keyboard"))
def CmdKeyboard(_, msg: Message):
    kybrd = InlineKeyboardMarkup(
        [[InlineKeyboardButton("up1", "up1")], [InlineKeyboardButton("up2", "up2")]]
    )
    msg.reply_text("test simultaneous upload", reply_markup=kybrd)


APP.start()
idle()
APP.stop()

f1.txt
f2.txt

Steps to Reproduce

1. Execute the code above.
2. Send the /keyboard command to the bot.
3. Quickly click both buttons.
4. The bot gets stuck.