Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Latest processes for maps #1064

Merged
merged 20 commits into from
Dec 16, 2024

Conversation

susannaaz
Copy link
Contributor

@susannaaz susannaaz commented Dec 10, 2024

Addresses issue #1009

Used with (F+B) script without the "on-the-fly" functions, added to the preprocessing module and to tod_ops and flags:

  • Rotation to telescope coordinates
  • Subscan poly filtering
  • Demod common mode deprojection
  • White noise cuts - low wn, high wn, fknee
  • Apply pointing model

@susannaaz susannaaz marked this pull request as ready for review December 10, 2024 17:20
Copy link
Contributor

@msilvafe msilvafe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for submitting this! In the future try to turn off your editors autoformatting it adds a lot of extra lines of code to review that are just an extra empty line, space, tab, etc. Also need to match the common sphinx docstring formatting we use and reconcile some redundancies across the code (including with @earosenberg's recent update for subscan flags). I've tried to put sufficient inline comments but let me know if you have questions or if I can help resolve any of these.

sotodlib/preprocess/preprocess_plot.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/flags.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/flags.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/flags.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/flags.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/flags.py Outdated Show resolved Hide resolved
sotodlib/preprocess/preprocess_plot.py Outdated Show resolved Hide resolved
sotodlib/site_pipeline/make_atomic_filterbin_map.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/azss.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/deproject.py Outdated Show resolved Hide resolved
sotodlib/coords/demod.py Outdated Show resolved Hide resolved
sotodlib/preprocess/preprocess_plot.py Outdated Show resolved Hide resolved
sotodlib/tod_ops/azss.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
sotodlib/preprocess/processes.py Outdated Show resolved Hide resolved
@chervias
Copy link
Contributor

I forgot to include this comment in the general message of the review. I agree with @msilvafe, there are a lot of extra tabs in files that will makes go crazy later on if we see them, so please delete them. Thanks!

…pdated noise logic to incorporate wrap_name from config\n\- added handling for 'fknee' and 'min_noise' in noise process based on user-defined thresholds
coeffs = np.dot(I, coeffs.T).T
if correct:
aman[signal] = aman[signal] - coeffs * med
return coeffs, med
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fix newline

@chervias chervias self-requested a review December 16, 2024 00:01
Copy link
Contributor

@msilvafe msilvafe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now that we've moved what's happening in NoiseFlags into the main Noise process lets delete NoiseFlags. Once tested with the most recent updates happy for you to squash + merge.

@susannaaz susannaaz merged commit beb378d into simonsobs:master Dec 16, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants