Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-28759: Add config for SourceTableDriver #344

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions config/sourceTableDriver.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
import os.path
from lsst.utils import getPackageDir

config.ccdKey = 'ccd'
config.ignoreCcdList = [9, 104, 105, 106, 107, 108, 109, 110, 111]
config.transformSourceTable.functorFile = os.path.join(getPackageDir("obs_subaru"), 'policy', 'SourcePDR2.yaml')
271 changes: 271 additions & 0 deletions policy/SourcePDR2.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,271 @@
funcs:
sourceId: # the index of deepCoadd_obj IS the objectId
functor: Index
coord_ra:
# reference position required by db. Not in DPDD
functor: CoordColumn
args: coord_ra
coord_dec:
# Reference position required by db. Not in DPDD
functor: CoordColumn
args: coord_dec
ccdVisitId:
functor: Column
args: ccdVisitId
# objectId: not avaliable
# ssObjectId: not avaliable
parentSourceId:
functor: Column
args: parent
#htmId20: not avaliable
x:
functor: Column
args: slot_Centroid_x
y:
functor: Column
args: slot_Centroid_y
xErr:
functor: Column
args: slot_Centroid_xErr
yErr:
functor: Column
args: slot_Centroid_yErr
# x_y_Cov: not available
ra:
functor: RAColumn
# raErr: not available yet DM-15180
decl:
functor: DecColumn
# declErr: not available yet DM-15180
# ra_decl_Cov: not available yet
# One calibrated Calib flux is important:
ApFlux:
functor: LocalNanojansky
args:
- slot_CalibFlux_instFlux
- slot_CalibFlux_instFluxErr
- base_LocalPhotoCalib
- base_LocalPhotoCalibErr
ApFluxErr:
functor: LocalNanojanskyErr
args:
- slot_CalibFlux_instFlux
- slot_CalibFlux_instFluxErr
- base_LocalPhotoCalib
- base_LocalPhotoCalibErr
# TODO: When DM-25019 is complete, these should be
# changed to use the local value of the background
# model, rather than the residual of the background
sky:
functor: LocalNanojansky
args:
- base_LocalBackground_instFlux
- base_LocalBackground_instFluxErr
- base_LocalPhotoCalib
- base_LocalPhotoCalibErr
skyErr:
functor: LocalNanojanskyErr
args:
- base_LocalBackground_instFlux
- base_LocalBackground_instFluxErr
- base_LocalPhotoCalib
- base_LocalPhotoCalibErr
PsFlux:
functor: LocalNanojansky
args:
- slot_PsfFlux_instFlux
- slot_PsfFlux_instFluxErr
- base_LocalPhotoCalib
- base_LocalPhotoCalibErr
PsFluxErr:
functor: LocalNanojanskyErr
args:
- slot_PsfFlux_instFlux
- slot_PsfFlux_instFluxErr
- base_LocalPhotoCalib
- base_LocalPhotoCalibErr

# These PS columns makes sense anymore as named:
# psX
# psXSigma
# psY
# psYSigma
# psFlux_psX_Cov
# psFlux_psY_Cov
# psX_Y_Cov
# psLnL
# psChi2
# psN
# psRa
# psRaSigma
# psDecl
# psDeclSigma
# psFlux_psRa_Cov
# psFlux_psDecl_Cov


Ixx:
functor: Column
args: slot_Shape_xx
Iyy:
functor: Column
args: slot_Shape_yy
Ixy:
functor: Column
args: slot_Shape_xy
# DPDD should include Psf Shape
IxxPsf:
functor: Column
args: slot_PsfShape_xx
IyyPsf:
functor: Column
args: slot_PsfShape_yy
IxyPsf:
functor: Column
args: slot_PsfShape_xy
# apNann: Replaced by raw Aperture instFluxes in flags section below
# apMeanSb: Replaced by raw Aperture instFluxes in flags section below
# apMeanSbErr: Replaced by raw Aperture instFluxes in flags section below
extendedness:
functor: Column
args: base_ClassificationExtendedness_value
flags:
- base_LocalPhotoCalib
- base_LocalPhotoCalib_flag
- base_LocalPhotoCalibErr
- base_LocalWcs_flag
- base_LocalWcs_CDMatrix_2_1
- base_LocalWcs_CDMatrix_1_1
- base_LocalWcs_CDMatrix_1_2
- base_LocalWcs_CDMatrix_2_2
- base_Blendedness_abs
- base_Blendedness_flag
- base_Blendedness_flag_noCentroid
- base_Blendedness_flag_noShape
- base_CircularApertureFlux_12_0_flag
- base_CircularApertureFlux_12_0_flag_apertureTruncated
- base_CircularApertureFlux_12_0_flag_sincCoeffsTruncated
- base_CircularApertureFlux_12_0_instFlux
- base_CircularApertureFlux_12_0_instFluxErr
- base_CircularApertureFlux_17_0_flag
- base_CircularApertureFlux_17_0_flag_apertureTruncated
- base_CircularApertureFlux_17_0_instFlux
- base_CircularApertureFlux_17_0_instFluxErr
- base_CircularApertureFlux_25_0_flag
- base_CircularApertureFlux_25_0_flag_apertureTruncated
- base_CircularApertureFlux_25_0_instFlux
- base_CircularApertureFlux_25_0_instFluxErr
- base_CircularApertureFlux_35_0_flag
- base_CircularApertureFlux_35_0_flag_apertureTruncated
- base_CircularApertureFlux_35_0_instFlux
- base_CircularApertureFlux_35_0_instFluxErr
- base_CircularApertureFlux_3_0_flag
- base_CircularApertureFlux_3_0_flag_apertureTruncated
- base_CircularApertureFlux_3_0_flag_sincCoeffsTruncated
- base_CircularApertureFlux_3_0_instFlux
- base_CircularApertureFlux_3_0_instFluxErr
- base_CircularApertureFlux_4_5_flag
- base_CircularApertureFlux_4_5_flag_apertureTruncated
- base_CircularApertureFlux_4_5_flag_sincCoeffsTruncated
- base_CircularApertureFlux_4_5_instFlux
- base_CircularApertureFlux_4_5_instFluxErr
- base_CircularApertureFlux_50_0_flag
- base_CircularApertureFlux_50_0_flag_apertureTruncated
- base_CircularApertureFlux_50_0_instFlux
- base_CircularApertureFlux_50_0_instFluxErr
- base_CircularApertureFlux_6_0_flag
- base_CircularApertureFlux_6_0_flag_apertureTruncated
- base_CircularApertureFlux_6_0_flag_sincCoeffsTruncated
- base_CircularApertureFlux_6_0_instFlux
- base_CircularApertureFlux_6_0_instFluxErr
- base_CircularApertureFlux_70_0_flag
- base_CircularApertureFlux_70_0_flag_apertureTruncated
- base_CircularApertureFlux_70_0_instFlux
- base_CircularApertureFlux_70_0_instFluxErr
- base_CircularApertureFlux_9_0_flag
- base_CircularApertureFlux_9_0_flag_apertureTruncated
- base_CircularApertureFlux_9_0_flag_sincCoeffsTruncated
- base_CircularApertureFlux_9_0_instFlux
- base_CircularApertureFlux_9_0_instFluxErr
- base_ClassificationExtendedness_flag
- base_FootprintArea_value
- base_Jacobian_flag
- base_Jacobian_value
- base_LocalBackground_instFlux
- base_LocalBackground_instFluxErr
- base_LocalBackground_flag
- base_LocalBackground_flag_noGoodPixels
- base_LocalBackground_flag_noPsf
- base_PixelFlags_flag
- base_PixelFlags_flag_bad
- base_PixelFlags_flag_cr
- base_PixelFlags_flag_crCenter
- base_PixelFlags_flag_edge
- base_PixelFlags_flag_interpolated
- base_PixelFlags_flag_interpolatedCenter
- base_PixelFlags_flag_offimage
- base_PixelFlags_flag_saturated
- base_PixelFlags_flag_saturatedCenter
- base_PixelFlags_flag_suspect
- base_PixelFlags_flag_suspectCenter
- base_PsfFlux_apCorr
- base_PsfFlux_apCorrErr
- base_PsfFlux_area
- base_PsfFlux_flag
- base_PsfFlux_flag_apCorr
- base_PsfFlux_flag_edge
- base_PsfFlux_flag_noGoodPixels
- base_SdssCentroid_flag
- base_SdssCentroid_flag_almostNoSecondDerivative
- base_SdssCentroid_flag_badError
- base_SdssCentroid_flag_edge
- base_SdssCentroid_flag_noSecondDerivative
- base_SdssCentroid_flag_notAtMaximum
- base_SdssCentroid_flag_resetToPeak
- base_Variance_flag
- base_Variance_flag_emptyFootprint
- base_Variance_value
- calib_astrometry_used
- calib_detected
- calib_photometry_reserved
- calib_photometry_used
- calib_psf_candidate
- calib_psf_reserved
- calib_psf_used
- deblend_deblendedAsPsf
- deblend_hasStrayFlux
- deblend_masked
- deblend_nChild
- deblend_parentTooBig
- deblend_patchedTemplate
- deblend_rampedTemplate
- deblend_skipped
- deblend_tooManyPeaks
- ext_shapeHSM_HsmPsfMoments_flag
- ext_shapeHSM_HsmPsfMoments_flag_no_pixels
- ext_shapeHSM_HsmPsfMoments_flag_not_contained
- ext_shapeHSM_HsmPsfMoments_flag_parent_source
- ext_shapeHSM_HsmShapeRegauss_flag
- ext_shapeHSM_HsmShapeRegauss_flag_galsim
- ext_shapeHSM_HsmShapeRegauss_flag_no_pixels
- ext_shapeHSM_HsmShapeRegauss_flag_not_contained
- ext_shapeHSM_HsmShapeRegauss_flag_parent_source

flag_rename_rules:
# Taken from db-meas-forced
- ['ext_photometryKron_', '']
- ['base_PixelFlags_flag', 'PixelFlags']
- ['base_Classification', '']
- ['base_Sdss', '']
- ['base_CircularApertureFlux', 'ApFlux']
- ['ext_shapeHSM_', '']
- ['ext_convolved_', '']
- ['undeblended_base', 'undeblended']
- ['undeblended_ext_photometryKron', 'undeblended']
- ['ext_photometryKron_', '']
- ['base_', '']
- ['slot_', '']
- ['calib_', 'Calib_']
- ['deblend_', 'Deblend_']
- ['blendedness', 'Blendedness']