Skip to content

fix: bigquery snowflake source columns support#5428

Merged
eakmanrq merged 1 commit intomainfrom
eakmanrq/snowflake_bigquery_source_columns_support
Sep 23, 2025
Merged

fix: bigquery snowflake source columns support#5428
eakmanrq merged 1 commit intomainfrom
eakmanrq/snowflake_bigquery_source_columns_support

Conversation

@eakmanrq
Copy link
Collaborator

@eakmanrq eakmanrq commented Sep 23, 2025

Dataframe tests were accidentally disabled in this PR: #5117

This was then fixed in this PR: #5423

Which then exposed this issue. Therefore this PR fixes support for ignored changes for BQ and Snowflake using Pandas.

Confirmed CI checks for Snowflake/BQ pass.

@eakmanrq eakmanrq force-pushed the eakmanrq/snowflake_bigquery_source_columns_support branch from e68fd6c to 47e57a2 Compare September 23, 2025 15:04
@eakmanrq eakmanrq force-pushed the eakmanrq/snowflake_bigquery_source_columns_support branch 4 times, most recently from 928170d to acd87c8 Compare September 23, 2025 16:05
Comment on lines +490 to +496
df = pd.DataFrame(
{
"id": [1, 2, 3],
"ts": ["2025-01-01 00:00:00", "2025-01-01 00:00:00", "2025-01-01 00:00:00"],
"val": [7, 8, 9],
}
)
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The actual values in the dataframe didn't matter before so they just had placeholder values but due to the ordering check they are now updated to match what we claim the structure is in the merge call.

@eakmanrq eakmanrq force-pushed the eakmanrq/snowflake_bigquery_source_columns_support branch from acd87c8 to 9feefcf Compare September 23, 2025 16:35
@eakmanrq eakmanrq force-pushed the eakmanrq/snowflake_bigquery_source_columns_support branch from 9feefcf to 2420feb Compare September 23, 2025 16:36
@eakmanrq eakmanrq merged commit 131a4db into main Sep 23, 2025
35 of 36 checks passed
@eakmanrq eakmanrq deleted the eakmanrq/snowflake_bigquery_source_columns_support branch September 23, 2025 20:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants