Merge branch 'main' into noirlab-archive

* main: (36 commits)
  Updates to mast_cut
  GAIAPCR-1368 Include PR reference number
  Minimal changes to catalogs docs
  Updated docs
  Updated main page and mast_query page
  Bump the actions group with 2 updates
  changelog
  Be more robust in getting column configuration
  GAIAPCR-1368 new retrieval type RESIDUAL_IMAGE
  fix an error catch
  codestyle
  fix cdms remote tests
  doctest output whitespace
  fix variable name
  remove unnecessary text
  now jplspec / cdms get_molecule behave closer to the same
  factor out parse_molid
  move unique sector logic into helper function
  test coverage for condition when no sectors for target
  add changelog entry
  ...

Author: weaverba137

.github/workflows/ci_crontests.yml

@@ -36,7 +36,7 @@ jobs:
 
     steps:
     - name: Checkout code
-      uses: actions/checkout@1af3b93b6815bc44a9784bd300feb67ff0d1eeb3  # v6.0.0
+      uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8  # v6.0.1
       with:
         fetch-depth: 0
     - name: Set up Python

.github/workflows/ci_devtests.yml

@@ -44,7 +44,7 @@ jobs:
 
     steps:
     - name: Checkout code
-      uses: actions/checkout@1af3b93b6815bc44a9784bd300feb67ff0d1eeb3  # v6.0.0
+      uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8  # v6.0.1
       with:
         fetch-depth: 0
     - name: Set up Python
@@ -57,6 +57,6 @@ jobs:
       run: tox ${{ matrix.toxargs }} -e ${{ matrix.toxenv }} -- ${{ matrix.toxposargs }}
     - name: Upload coverage to codecov
       if: contains(matrix.toxenv,'-cov')
-      uses: codecov/codecov-action@5a1091511ad55cbe89839c7260b706298ca349f7  # v5.5.1
+      uses: codecov/codecov-action@671740ac38dd9b0130fbe1cec585b89eea48d3de  # v5.5.2
       with:
         file: ./coverage.xml

.github/workflows/ci_online_crontests.yml

@@ -38,7 +38,7 @@ jobs:
 
     steps:
     - name: Checkout code
-      uses: actions/checkout@1af3b93b6815bc44a9784bd300feb67ff0d1eeb3  # v6.0.0
+      uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8  # v6.0.1
       with:
         fetch-depth: 0
     - name: Set up Python

.github/workflows/ci_tests.yml

@@ -63,7 +63,7 @@ jobs:
 
     steps:
     - name: Checkout code
-      uses: actions/checkout@1af3b93b6815bc44a9784bd300feb67ff0d1eeb3  # v6.0.0
+      uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8  # v6.0.1
       with:
         fetch-depth: 0
     - name: Set up Python
@@ -76,7 +76,7 @@ jobs:
       run: tox ${{ matrix.toxargs }} -e ${{ matrix.toxenv }} -- ${{ matrix.toxposargs }}
     - name: Upload coverage to codecov
       if: contains(matrix.toxenv,'-cov')
-      uses: codecov/codecov-action@5a1091511ad55cbe89839c7260b706298ca349f7  # v5.5.1
+      uses: codecov/codecov-action@671740ac38dd9b0130fbe1cec585b89eea48d3de  # v5.5.2
       with:
         file: ./coverage.xml
 
@@ -85,7 +85,7 @@ jobs:
     runs-on: ubuntu-latest
     steps:
     - name: Checkout code
-      uses: actions/checkout@1af3b93b6815bc44a9784bd300feb67ff0d1eeb3  # v6.0.0
+      uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8  # v6.0.1
       with:
         fetch-depth: 0
     - name: Set up Python

.github/workflows/codeql-analysis.yml

@@ -27,7 +27,7 @@ jobs:
 
     steps:
     - name: Checkout repository
-      uses: actions/checkout@1af3b93b6815bc44a9784bd300feb67ff0d1eeb3  # v6.0.0
+      uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8  # v6.0.1
 
     # Initializes the CodeQL tools for scanning.
     - name: Initialize CodeQL

CHANGES.rst

@@ -30,6 +30,10 @@ heasarc
 - Add support for uploading tables when using TAP directly through ``query_tap``. [#3403]
 - Add automatic guessing for the data host in ``download_data``. [#3403]
 
+gaia
+^^^^
+
+- New datalink DR4 retrieval type RESIDUAL_IMAGE. [#3489]
 
 esa.hubble
 ^^^^^^^^^^
@@ -52,11 +56,21 @@ mast
 
 - Raise informative error if ``MastMissions`` query radius is too large. [#3447]
 
+- Add ``batch_size`` parameter to ``MastMissions.get_product_list``, ``Observations.get_product_list``,
+  and ``utils.resolve_object`` to allow controlling the number of items sent in each batch request to the server.
+  This can help avoid timeouts or connection errors for large requests. [#3454]
+
+- Separate requests for moving target cutouts in ``Tesscut`` to one per sector. [#3467]
+
+- Improved robustness of PanSTARRS column metadata parsing. This prevents metadata-related query errors. [#3485]
+
 jplspec
 ^^^^^^^
 
+- Refactored to use linelists.core.  Added new ``get_molecule`` method [#3456]
 - Moved to linelists/.  astroquery.jplspec is now deprecated in favor of astroquery.linelists.jplspec [#3455]
 
+
 linelists.jplspec
 ^^^^^^^^^^^^^^^^^
 
@@ -65,7 +79,13 @@ linelists.jplspec
 mpc
 ^^^
 
-- Fix bug in queries for interstellar objects with `MPC.get_observations` and enable queries for "dead" comets [#3474]
+- Fix bug in queries for interstellar objects with ``MPC.get_observations`` and enable queries for "dead" comets [#3474]
+
+linelists
+^^^^^^^^^
+
+- General tools for both CDMS/JPL moved to linelists.core [#3456]
+- Added jplspec, moved from its previous location (astroquery.jplspec to astroquery.linelists.jplspec) [#3455]
 
 noirlab
 ^^^^^^^

astroquery/alma/core.py

@@ -707,8 +707,8 @@ def query_tap(self, query, *, maxrec=None, uploads=None):
     >>> uploads = {'tmptable': '/tmp/tmptable_def.xml'}
     >>> rslt = query_tap(self, query, maxrec=None, uploads=uploads)
 
-        Return
-        ------
+        Returns
+        -------
         result : `~pyvo.dal.TAPResults`
             TAP query result
 

astroquery/esa/euclid/core.py

@@ -269,8 +269,6 @@ def __get_schema_name(self, full_qualified_table_name):
     def launch_job(self, query, *, name=None, dump_to_file=False, output_file=None, output_format="csv", verbose=False,
                    upload_resource=None, upload_table_name=None):
         """
-        Description
-        -----------
         Launches a synchronous job
 
         Parameters
@@ -315,8 +313,6 @@ def launch_job(self, query, *, name=None, dump_to_file=False, output_file=None,
     def launch_job_async(self, query, *, name=None, dump_to_file=False, output_file=None, output_format="csv",
                          verbose=False, background=False, upload_resource=None, upload_table_name=None, autorun=True):
         """
-        Description
-        -----------
         Launches an asynchronous job
 
         Parameters
@@ -370,8 +366,6 @@ def launch_job_async(self, query, *, name=None, dump_to_file=False, output_file=
     def query_object(self, coordinate, *, radius=None, width=None, height=None,
                      async_job=False, verbose=False, columns=None):
         """
-        Description
-        -----------
         Searches for objects around a given position with the default catalog sascat_pvpr01.mer_final_cat_pvpr01
 
         Parameters
@@ -510,8 +504,6 @@ def cone_search(self, coordinate, radius, *,
                     verbose=False,
                     columns=None):
         """
-        Description
-        -----------
         Cone search for a given catalog and sky position, results sorted by distance
 
         Parameters
@@ -605,8 +597,6 @@ def cone_search(self, coordinate, radius, *,
 
     def login(self, *, user=None, password=None, credentials_file=None, verbose=False):
         """
-        Description
-        -----------
         Performs a login
 
         User and password can be used or a file that contains username and password
@@ -649,8 +639,6 @@ def login(self, *, user=None, password=None, credentials_file=None, verbose=Fals
 
     def login_gui(self, verbose=False):
         """
-        Description
-        -----------
         Performs a login using a GUI dialog
 
         Parameters
@@ -690,8 +678,6 @@ def login_gui(self, verbose=False):
 
     def logout(self, verbose=False):
         """
-        Description
-        -----------
         Performs a logout
 
         Parameters
@@ -743,8 +729,6 @@ def is_gz_file(filepath):
 
     def get_status_messages(self, verbose=False):
         """
-        Description
-        -----------
         Retrieve the messages to inform users about
         the status of Euclid TAP
 
@@ -822,8 +806,6 @@ def __extract_file(output_file_full_path, output_dir, files):
     def get_observation_products(self, *, id=None, schema="sedm", product_type=None, product_subtype="STK",
                                  filter="VIS", output_file=None, verbose=False):
         """
-        Description
-        -----------
         Downloads the products for a given EUCLID observation_id (observations) or tile_index (mosaics)
         For big files the download may require a long time
 
@@ -892,9 +874,7 @@ def get_observation_products(self, *, id=None, schema="sedm", product_type=None,
 
     def __get_tile_catalogue_list(self, *, tile_index, product_type, verbose=False):
         """
-         Description
-         -----------
-         Get the list of products of a given EUCLID tile_index (mosaics)
+        Get the list of products of a given EUCLID tile_index (mosaics)
 
         Parameters
         ----------
@@ -1000,8 +980,6 @@ def __get_tile_catalogue_list(self, *, tile_index, product_type, verbose=False):
 
     def get_product_list(self, *, observation_id=None, tile_index=None, product_type, verbose=False):
         """
-        Description
-        -----------
         Get the list of products of a given EUCLID id searching by observation_id or tile_index.
 
         Parameters
@@ -1203,8 +1181,6 @@ def get_product_list(self, *, observation_id=None, tile_index=None, product_type
 
     def get_product(self, *, file_name=None, product_id=None, schema='sedm', output_file=None, verbose=False):
         """
-        Description
-        -----------
         Downloads a product given its file name or product id
 
         Parameters
@@ -1262,8 +1238,6 @@ def get_product(self, *, file_name=None, product_id=None, schema='sedm', output_
     def get_cutout(self, *, file_path=None, instrument=None, id=None, coordinate, radius, output_file=None,
                    verbose=False):
         """
-        Description
-        -----------
         Downloads a cutout given its file path, instrument and obs_id, and the cutout region
 
         Parameters
@@ -1329,8 +1303,6 @@ def get_cutout(self, *, file_path=None, instrument=None, id=None, coordinate, ra
 
     def get_spectrum(self, *, source_id, schema='sedm', retrieval_type="ALL", output_file=None, verbose=False):
         """
-        Description
-        -----------
         Downloads a spectrum with datalink.
 
         The spectrum associated with the source_id is downloaded as a compressed fits file, and the files it contains
@@ -1420,10 +1392,7 @@ def get_spectrum(self, *, source_id, schema='sedm', retrieval_type="ALL", output
 
     def get_datalinks(self, ids, *, linking_parameter='SOURCE_ID', extra_options=None, verbose=False):
         """
-        Description
-        -----------
-        Gets datalinks associated to the provided identifiers.
-        TAP+ only
+        Gets datalinks associated to the provided identifiers (TAP+ only).
 
         Parameters
         ----------

astroquery/gaia/__init__.py

@@ -49,7 +49,8 @@ class Conf(_config.ConfigNamespace):
                                       'EPOCH_FLAGS_NSS',
                                       'EPOCH_PARAMETERS_RVS_SINGLE',
                                       'EPOCH_PARAMETERS_RVS_DOUBLE',
-                                      'EPOCH_FLAGS_VARI']
+                                      'EPOCH_FLAGS_VARI',
+                                      'RESIDUAL_IMAGE']
 
     VALID_LINKING_PARAMETERS = {'SOURCE_ID', 'TRANSIT_ID', 'IMAGE_ID'}
 

astroquery/gaia/core.py

@@ -196,7 +196,9 @@ def load_data(self, ids, *, data_release=None, data_structure='INDIVIDUAL', retr
             'EPOCH_ASTROMETRY_BRIGHT', 'MEAN_SPECTRUM_XP_GRAVLENS', 'EPOCH_FLAGS_NSS', 'EPOCH_PARAMETERS_RVS_SINGLE',
             'EPOCH_PARAMETERS_RVS_DOUBLE', 'EPOCH_FLAGS_VARI']. Note that for 'CROWDED_FIELD_IMAGE', only the format
             'fits' can be used, and its image, in the principal header, will not be available in the returned
-            dictionary. Set 'output_file' to retrieve all data: image + tables.
+            dictionary. Set 'output_file' to retrieve all data: image + tables. Note that for 'RESIDUAL_IMAGE',
+            only the format 'fits' can be used. Since the fits files only contain images, the returned table will be
+            empty. Therefore, set 'output_file' to save the files to get access to their content.
         linking_parameter : str, optional, default SOURCE_ID, valid values: SOURCE_ID, TRANSIT_ID, IMAGE_ID
             By default, all the identifiers are considered as source_id
             SOURCE_ID: the identifiers are considered as source_id