Skip to content

Looker connector: Column level lineage missing for quoted column names #31866

Description

@fredriv

Connector

Looker

Feature area

Lineage

Describe the bug

When parsing the SQL column names from the LookML views, the Looker connector uses a regex to detect the table column: https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/src/metadata/ingestion/source/dashboard/looker/metadata.py#L875

However, this regex does not handle quotes (") around the column name, which can be used in Snowflake to handle case issues in the column names or column names with e.g. spaces. For example, the Looker connector is able to parse ${TABLE}.CUSTOMER_ID just fine, but fails to find the column name for ${TABLE}."CUSTOMER_ID" or ${TABLE}."Customer Id".

To Reproduce

Create a LookML view with a sql: {TABLE}."MY_COLUMN" entry.

Expected behavior

The Looker connector should be able to find the column name for quoted (Snowflake) column names.

Connection / ingestion config

Logs

OS

No response

Python version

No response

OpenMetadata version

1.13.3

OpenMetadata Ingestion package version

openmetadata-ingestion==1.13.3

Additional context

No response

Pre-submission checklist

  • I searched for duplicate issues.
  • I removed credentials, hostnames, emails, and other sensitive data from logs and config.

Metadata

Metadata

Assignees

Type

No type

Projects

Status
No status
Status
Triage 🧐

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions