仍然有意義與光子使集群上運行這個工作當我收到以下嗎?
這是我跑的代碼:
創建或替換表$ {tbl_name} _dups選擇src。*,由src ROW_NUMBER() /(分區。由src id命令。id) row_num從$ {tbl_name} src內連接(選擇id, count (*) n從$ {tbl_name}組id在n > 1) dup src。id = dups.id;
這就是我所看到的在集群UI: SQL / Dataframe部分
= = = =光子光子解釋並不完全支持查詢,因為:不支持的表達式(s): dynamicpruning # 601 600參考節點:FileScan鋪spark_catalog.default.opensea_events [approved_account # 466, # 467資產,asset_bundle # 468, auction_type # 469, bid_amount # 470, collection_slug # 471, contract_address # 472, created_date # 473, custom_event_name # 474, dev_fee_payment_event # 475, dev_seller_fee_basis_points # 476 l,持續時間# 477,ending_price # 478, event_timestamp # 479, from_account # 481, # 482 l, id is_private # 483, listing_time # 484, owner_account # 485, payment_token # 486, # 487, # 488, starting_price # 489, to_account # 490,……5多個字段)批處理:真的,DataFilters: [isnotnull (id # 482 l), dynamicpruning # 601 600],格式:拚花,地點:PreparedDeltaFileIndex(1路)[dbfs: / mnt / opensea-tbl / asset_events_2], PartitionFilters: [], PushedFilters: [isnotnull (id)], ReadSchema: struct < approved_account:字符串,資產:struct < animation_original_url:字符串,animation_url:字符串,為…
