COLLECTED BY

Organization: Archive Team

Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.

History is littered with hundreds of conflicts over the future of a community, group, location or business that were "resolved" when one of the parties stepped ahead and destroyed what was there. With the original point of contention destroyed, the debates would fall to the wayside. Archive Team believes that by duplicated condemned data, the conversation and debate can continue, as well as the richness and insight gained by keeping the materials. Our projects have ranged in size from a single volunteer downloading the data to a small-but-critical site, to over 100 volunteers stepping forward to acquire terabytes of user-created data to save for future generations.

The main site for Archive Team is at archiveteam.org and contains up to the date information on various projects, manifestos, plans and walkthroughs.

This collection contains the output of many Archive Team projects, both ongoing and completed. Thanks to the generous providing of disk space by the Internet Archive, multi-terabyte datasets can be made available, as well as in use by the Wayback Machine, providing a path back to lost websites and work.

Our collection has grown to the point of having sub-collections for the type of data we acquire. If you are seeking to browse the contents of these collections, the Wayback Machine is the best first stop. Otherwise, you are free to dig into the stacks to see what you may find.

The Archive Team Panic Downloads are full pulldowns of currently extant websites, meant to serve as emergency backups for needed sites that are in danger of closing, or which will be missed dearly if suddenly lost due to hard drive crashes or server failures.

Collection: Archive Team: The Github Hitrub

This collection is a set of Github repository archives from two major sets: A panic grab upon the acquisition by Microsoft, and a larger, ongoing set of Pretty Much Everything.

TIMESTAMPS

The Wayback Machine - https://web.archive.org/web/20210112091543/https://github.com/expressjs/compression/pull/150

expressjs / compression

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: support brotli #150

Open

clarkdo wants to merge 5 commits into expressjs:master from clarkdo:brotli

clarkdo commented Jan 18, 2019

No description provided.


          feat: support brotli

051fd20

dougwilson added needs tests enhancement pr needs docs labels


          fix: lint error

0228f1d

dougwilson requested changes

Member

dougwilson left a comment

Thank you so much for volunteering to help get this feature a reality! From reviewing the PR, it looks like the following things still need to be done, so I'm listing so you have something concrete to work through:

(1) There is no documentation around this, specifically all the options like chunkSize, level, memLebel, stragety, windowBits, etc. are all using zlib constants and not the Brotli constants. I have not actually looked hard yet, but I assume these constants are not the right ones for Brotli (since the Node.js doc lists different constants) but at worse since all these constants are just integers, setting one of these options may break when br is accepted by the client, since they are going to be passed into createBrotliDecompress with this PR (this needs to be validated / tested).

(2) There are no tests added. This is picked up just by the coverage CI check, since the new line for br in the switch statement is not getting triggered, but there should be at least all the equiv tests for br that there are for the others.

I hope this helps! Thanks for picking this up!

README.md Outdated Show resolved Hide resolved

dougwilson mentioned this pull request

Support for Brotli compression #71

Open

clarkdo added 2 commits


          refactor: prefer other method if createBrotliDecompress is not supported

343a67e


          fix: correct code

09dce4f

Author

clarkdo commented Jan 18, 2019 •

edited

@dougwilson Thank you so much for the quick and detailed review.

For the options, which solution do you think is better ?

Try to match current options into brotli options for keeping consistency, this may be harder and risky since the zlip api are very different between zlib-based and brotli based.
Add a new brotli options field(maybe options.brotli) in options of compression and add doc (the same way as node is doing now)

For the test, since brotli is only supported in node 11.7, can we add it in travis ?

manniL mentioned this pull request

How can I cache pages? nuxt/nuxt.js#4698

Closed

manniL commented Feb 19, 2019

Friendly reminder @dougwilson ☺️

cecchi reviewed

cecchi left a comment

Thanks for working on this @clarkdo!

For what it's worth, in my testing the content negotiation provided by accepts (which uses negotiator under the hood) will choose gzip over br for most popular browsers. There's an issue tracking that behavior here: jshttp/negotiator#49

Working off of your branch I was able to get Brotli working end-to-end by swapping out the content negotiation from "accepts" to "accept": https://www.npmjs.com/package/accept, and fixing a couple typos.

I'm happy to contribute those changes if we want to prefer br over gzip. The changelist is visible here: deal#1

index.js Outdated Show resolved Hide resolved


          fix: correct createBrotliCompress

aaf605e

svewag commented Apr 24, 2019

Hi there 👋

I would really like to serve my static files with brotli. So are there any plans when this might be merged or can I help out somewhere?

Greetings Sven

bpierre mentioned this pull request

Brotli support aragon/apm-serve#28

Open

Fifciu mentioned this pull request

Add Brotli compression support vuestorefront/vue-storefront#4245

Open

2 of 7 tasks complete

Saiv46 commented Nov 8, 2020

Any progress?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

You can’t perform that action at this time.