FDA SRS UNII download links no longer scriptable

[creisle]

The snakemake workflow is failing to download the UNII data b/c it looks like the FDA changed the links to more complicated redirects. It can still be downloaded manually from https://precision.fda.gov/uniisearch/archive

I have sent them an email to ask about how this can be downloaded via a script and am awaiting a reply. In the mean time users will need to either download this data manually and put it in the correct spot for the rest of the workflow (see example below)

1. Manually download zip (ex UNII_Data_20211213.zip)
2. Place in snakemake data fda folder (default = snakemake_data/fda) snakemake_data/fda/UNII_Data_20211213.zip
3. Unzip cd snakemake_data/fda; unzip UNII_Data_20211213.zip
4. rename the main text file to remove the version mv UNII_Records_13Dec2021.txt UNII_Records.txt
5. go back to the main directory cd ./../../
6. Run the snakemake workflow as normal, snakemake will count the download step as complete snakemake ...

[mathieulemieux]

Seems the redirect is working with wget v1.21.1.
It wasn't with v1.14.
As an alternative, "curl -L https://precision.fda.gov/uniisearch/archive/latest/UNII_Data.zip > UNII_Data.zip" could work too.