Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.
Add AMI dataset #2853
Add AMI dataset #2853
Conversation
Hi ! Thanks for adding this dataset
Is there anything I can help you with ?
It looks like the dataset script only tries to generate one example "ES2002a.A"
Feel free to ping me if you have any questions or if I can help :)
|
Hey @cahya-wirawan, I played around with the dataset a bit and it looks already very good to me! That's exactly how it should be constructed :-) I can help you a bit with defining the config, etc... on Monday! |
|
@lhoestq - I think the dataset is ready to be merged :-) At the moment, I don't really see how the failing tests correspond to this PR:
could you maybe give it a look? :-) |
| _id: [os.path.join(annotation_path, "words/{}.{}.words.xml".format(_id, speaker)) for speaker in _SPEAKERS] | ||
| for _id in ids | ||
| } | ||
| words_paths = {_id: list(filter(lambda path: os.path.isfile(path), words_paths[_id])) for _id in ids} |
There was a problem hiding this comment.
FYI os.path.isfile is not supported yet for dataset streaming, but we can add it I think :)
(we just need to check in the remote zip file if the file exists, instead of checking locally)
This is an initial commit for AMI dataset