Unable to retrieve lineage and query level logs from Redshift Serverless. Connector refers to the Redshift server metadata tables.

[ramitsharma94]

Affected module
Ingestion tasks are failing as I am unable to retrieve lineage and query logs from the redshift serverless.

Describe the bug
Query refers to stl_query table and svl_stored_proc_call, but they don't exist in redshift serverless.

Version:

• OpenMetadata version: 1.8

Additional context
[2025-07-01, 19:14:12 UTC] {status.py:91} WARNING - Encountered exception running step [<metadata.ingestion.source.database.redshift.lineage.RedshiftLineageSource object at 0x7fca12b7ada0>]: [(psycopg2.errors.InsufficientPrivilege) permission denied for relation svl_stored_proc_call

[2025-07-01, 19:13:57 UTC] {test_connections.py:229} INFO - lastUpdatedAt=None status=<StatusType.Running: 'Running'> steps=[TestConnectionStepResult(name='CheckAccess', mandatory=True, passed=True, message=None, errorLog=None), TestConnectionStepResult(name='GetDatabases', mandatory=True, passed=True, message=None, errorLog=None), TestConnectionStepResult(name='GetSchemas', mandatory=True, passed=True, message=None, errorLog=None), TestConnectionStepResult(name='GetTables', mandatory=True, passed=True, message=None, errorLog=None), TestConnectionStepResult(name='GetViews', mandatory=False, passed=True, message=None, errorLog=None), TestConnectionStepResult(name='GetPartitionTableDetails', mandatory=False, passed=True, message=None, errorLog=None), TestConnectionStepResult(name='GetQueries', mandatory=False, passed=False, message='Failed to fetch queries, please validate if user has select privilege for tables pg_catalog.svv_table_info & pg_catalog.stl_query to get query logs.', errorLog="We don't have the right permissions to list queries - (True, False, False)")]

No such tables in redshift serverless.

[ulixius9]

closing by #24771