Connector
Looker
Feature area
Lineage
Describe the bug
When parsing the SQL column names from the LookML views, the Looker connector uses a regex to detect the table column: https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/source/dashboard/looker/metadata.py#L875
However, this regex does not handle quotes (") around the column name, which can be used in Snowflake to handle case issues in the column names or column names with e.g. spaces. For example, the Looker connector is able to parse ${TABLE}.CUSTOMER_ID just fine, but fails to find the column name for ${TABLE}."CUSTOMER_ID" or ${TABLE}."Customer Id".
To Reproduce
Create a LookML view with a sql: {TABLE}."MY_COLUMN" entry.
Expected behavior
The Looker connector should be able to find the column name for quoted (Snowflake) column names.
Connection / ingestion config
Logs
OS
No response
Python version
No response
OpenMetadata version
1.13.3
OpenMetadata Ingestion package version
openmetadata-ingestion==1.13.3
Additional context
No response
Pre-submission checklist
Connector
Looker
Feature area
Lineage
Describe the bug
When parsing the SQL column names from the LookML views, the Looker connector uses a regex to detect the table column: https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/source/dashboard/looker/metadata.py#L875
However, this regex does not handle quotes (
") around the column name, which can be used in Snowflake to handle case issues in the column names or column names with e.g. spaces. For example, the Looker connector is able to parse${TABLE}.CUSTOMER_IDjust fine, but fails to find the column name for${TABLE}."CUSTOMER_ID"or${TABLE}."Customer Id".To Reproduce
Create a LookML view with a
sql: {TABLE}."MY_COLUMN"entry.Expected behavior
The Looker connector should be able to find the column name for quoted (Snowflake) column names.
Connection / ingestion config
Logs
OS
No response
Python version
No response
OpenMetadata version
1.13.3
OpenMetadata Ingestion package version
openmetadata-ingestion==1.13.3
Additional context
No response
Pre-submission checklist