Create new Exposure Time Calculator reference file schema

[rgcosentino]

RTB is requesting a new schema and data model for a new Exposure Time Calculator reference file that handles automatic and programmatic updates to the ETC yaml form used when there is a new release of the ETC engine.

See example file in /grp/roman/RFP/DEV/build_files/Build_26Q2_B21/ new_roman_etc_WFI01.asdf - new_roman_etc_WFI18.asdf

In []: af = asdf.open('new_roman_etc_WFI01.asdf')

In []: af.tree['roman'].keys()
Out[]: dict_keys(['form', 'meta'])

meta is a dictionary
form is a dictionary - ok with renaming to etc_form or other suggestions

[schlafly]

Do I understand correctly that you don't want to put any of the contents of 'form' in the schema, you want only to require that those two fields exist and are dictionaries?

[rgcosentino]

Yes for now. Still coordinating development of what is in the ETC form and dont want to overly constrain fields yet beforehand.

[schlafly]

@stscijgbot-rstdms

Hmm, okay. If you don't know what you want to call the 'form' field, I might leave that out of the schema as well? I guess the ETC folks will use this, not us, so whatever makes them happy.

I'm a little surprised that only the dark current, saturation, and maybe ff_electrons are per-detector quantities. The rest of these quantities look to be more like configuration options than detector properties. If we're going the CRDS route these might be better off thought of as a pars file.

[rgcosentino]

This was an attempt to help improve the workflow for the ETC team to update there files and using CRDS and a programmatic update of specific versions available and considering WFI has 18 detectors, we had to try to make this easier on us all.

[PaulHuwe]

@stscijgbot-rstdms

[stscijgbot-rstdms]

This issue is tracked on JIRA as RAD-267.

[stscijgbot-rstdms]

Comment by Paul Huwe on JIRA:

This is implemented in RAD PR-857: #857

[rachael-beaton]

@rgcosentino and @schlafly :
Some documentation is available on RDox to support the call-for-proposals: https://roman-docs.stsci.edu/simulation-tools/roman-wfi-exposure-time-calculator/etc-appendix-inputs-and-calculations#ETCAppendix:InputsandCalculations-DetectorParametersDetectorParameters

Eunkyu and I have a draft Technical Report that describes the each of values derived from reference files in detail. The decisions on individual detector values versus single values are (mostly) in the report. The science community requested that we have these assumptions clearly communicated. The numbers that the ETC actually needs require conversion/adjustment from what is stored in the reference files. We want to make the process of updating these numbers for the ETC streamlined and repeatable, as well as being able to have version control through CRDS.

[stscijgbot-rstdms]

Comment by Paul Huwe on JIRA:

PR approved and merged.