Hi everyone, thanks for using lmms-eval.

We are aware of there are challenges in integrating new tasks for new users in lmms-eval and lm-evaluation-harness.

It's welcome that you can share your issues and questions to us, so we can better assist you to add new tasks.

Also you can raise your modification suggestions on our document (sorry for not making it more clear).

https://github.com/EvolvingLMMs-Lab/lmms-eval/blob/main/docs/task_guide.md