Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JP-3121: Updating JWST Ramp Fit Code to Work with New C Extension #8355

Merged
merged 1 commit into from
May 22, 2024

Conversation

kmacdonald-stsci
Copy link
Contributor

@kmacdonald-stsci kmacdonald-stsci commented Mar 13, 2024

Resolves JP-3121

This PR addresses the C extensions. In particular, tests need to ensure the dtypes of ndarrays are what is to be expected in a RampModel. Tests have been changed to ensure proper typing, as well as simplified.

Checklist for maintainers

  • added entry in CHANGES.rst within the relevant release section
  • updated or added relevant tests
  • updated relevant documentation
  • added relevant milestone
  • added relevant label(s)
  • ran regression tests, post a link to the Jenkins job below.
    How to run regression tests on a PR
  • Make sure the JIRA ticket is resolved properly

Copy link

codecov bot commented Mar 13, 2024

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes are missing coverage. Please review.

Project coverage is 57.97%. Comparing base (781e0e0) to head (81f6271).
Report is 9 commits behind head on master.

Files Patch % Lines
jwst/ramp_fitting/ramp_fit_step.py 0.00% 7 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #8355      +/-   ##
==========================================
+ Coverage   57.93%   57.97%   +0.04%     
==========================================
  Files         387      387              
  Lines       38839    38831       -8     
==========================================
+ Hits        22502    22514      +12     
+ Misses      16337    16317      -20     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@hbushouse
Copy link
Collaborator

@hbushouse
Copy link
Collaborator

@kmacdonald-stsci Regtest results at https://plwishmaster.stsci.edu:8081/job/RT/job/JWST-Developers-Pull-Requests/1461/testReport/ show differences in just one NIRISS test, in the rate and rateints files. The VAR_RNOISE array shows a smallish number of pixels with different values. Can you confirm whether this is expected? This was run using the latest stcal/main, which includes the new C code for ramp_fit, but with it deactivated (so it should've run the existing python version).

author Ken MacDonald <kmacdonald@stsci.edu> 1697200039 -0400
committer Ken MacDonald <kmacdonald@stsci.edu> 1702991072 -0500

Updating testing for C implementation of ramp fitting.

Updating test for C code.

Updating first group orphan testing.

Updating tests.  Not sure if the four CR test is a valid test.

Removing test cases in ramp fitting.

Updating the CHARGELOSS read noise computation to only update pixels and integrations affected by CHARGELOSS.

Updating the change log for PR 8355.
@kmacdonald-stsci
Copy link
Contributor Author

@kmacdonald-stsci Regtest results at https://plwishmaster.stsci.edu:8081/job/RT/job/JWST-Developers-Pull-Requests/1461/testReport/ show differences in just one NIRISS test, in the rate and rateints files. The VAR_RNOISE array shows a smallish number of pixels with different values. Can you confirm whether this is expected? This was run using the latest stcal/main, which includes the new C code for ramp_fit, but with it deactivated (so it should've run the existing python version).

Using the master branch in JWST and main STCAL results in those tests passing, so the failures aren't due to STCAL. The failures are due to the changes in the ramp_fit_step.py in this PR. In the master branch, the entire read noise array is updated due to CHARGELOSS recomputation of read noise variances, whereas in this branch only the pixels flagged as CHARGELOSS are updated. The differences in the regression tests are expected.

Copy link
Collaborator

@hbushouse hbushouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code updates and regtest results look good.

@hbushouse hbushouse merged commit aaf38ad into spacetelescope:master May 22, 2024
27 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants