Registry API does not only return the latest version of context products, instead it returns multiple versions

[anilnatha]

Checked for duplicates

No - I haven't checked

🐛 Describe the bug

When I executed a query to return a list of all context products that match the query product_class EQ "Product_Context", I noticed a subset of the returned context products had the same LID. After looking closer, I noticed those affected records had different VIDs.

The affected LIDs are:

urn:esa:psa:context:instrument:vex.virtis
urn:nasa:pds:context:instrument:relab.bcf-ftir2
urn:nasa:pds:context:instrument:relab.bc-ftir1
urn:esa:psa:context:instrument_host:spacecraft.vex
urn:nasa:pds:context:instrument:relab.bd-vnir
urn:nasa:pds:context:facility:laboratory.relab
urn:esa:psa:context:investigation:mission.venus_express
urn:esa:psa:context:instrument:vex.mag
urn:nasa:pds:context:investigation:other_investigation.relab_speclib
urn:esa:psa:context:instrument:juice.gala
urn:esa:psa:context:instrument:juice.jmc
urn:esa:psa:context:instrument:juice.jmag
urn:esa:psa:context:instrument:juice.3gm
urn:esa:psa:context:instrument:juice.pride
urn:esa:psa:context:investigation:mission.juice
urn:esa:psa:context:instrument:juice.janus
urn:esa:psa:context:instrument:juice.uvs
urn:esa:psa:context:instrument_host:spacecraft.juice
urn:esa:psa:context:instrument:juice.haa
urn:esa:psa:context:instrument:juice.navcam
urn:esa:psa:context:instrument:juice.majis
urn:esa:psa:context:instrument:juice.rpwi
urn:esa:psa:context:instrument:juice.rime
urn:esa:psa:context:instrument:juice.swi

🕵️ Expected behavior

I expected the registry API to only return the most recent version of a context product when querying for the full set of context products in the system.

📜 To Reproduce

1. Open a browser or postman
2. Use this URL to execute a query — https://pds.nasa.gov/api/search/1/products?q=(product_class%20EQ%20%22Product_Context%22)&limit=9999
3. Observe the LIDs listed above are attributed to multiple entries in the returned data

🖥 Environment Info

• Version of this software [e.g. vX.Y.Z]
• Operating System: [e.g. MacOSX with Docker Desktop vX.Y]
  ...

📚 Version of Software Used

No response

🩺 Test Data / Additional context

No response

🦄 Related requirements

🦄 #xyz

⚙️ Engineering Details

No response

🎉 Integration & Test

No response

[tloubrieu-jpl]

Thanks @anilnatha for reporting that issue. This happens because the current deployed version of sweeper which identifies the latest version of products does not run on the PSA products shown in your example.
A fixed version of sweeper has been deployed and we should be able to start to run it in the couple weeks.

[anilnatha]

@tloubrieu-jpl thanks for the update. Wanted to add a clarifying detail based on your comment:

This happens because the current deployed version of sweeper which identifies the latest version of products does not run on the PSA products shown in your example

Five of the reported LIDs were nasa:pds, not esa:psa. Will the updated version of sweeper also address those?