The Wayback Machine - https://web.archive.org/web/20220331073603/https://github.com/topics/digital-signal-processing
Skip to content
#

digital-signal-processing

Here are 473 public repositories matching this topic...

Ravenwater
Ravenwater commented Jan 1, 2021

in the Sterling approximation of factorial(n), we use an oracle based on the sw::universal::decimal type, which is an adaptive data type, to generate a reference value. However, the direct approximation of the factorial through a native floating point type yields different approximations.

factorial(40) calculated with double and decimal oracle rounded to double
815915283247897734345611269
question good first issue numerical investigation

Improve this page

Add a description, image, and links to the digital-signal-processing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the digital-signal-processing topic, visit your repo's landing page and select "manage topics."

Learn more