我想觸發磚工作使用DatabricksSubmitRunDeferrableOperator從氣流,我需要通過配置參數。這是摘自我的代碼(定義是不完整的,隻有關鍵屬性):
從airflow.providers.databricks.operators。磚進口DatabricksSubmitRunDeferrableOperator類PythonWheelOperator (DatabricksSubmitRunDeferrableOperator): def __init__(自我、action_name * * kwargs): DatabricksSubmitRunDeferrableOperator。__init__(自我,databricks_conn_id = dag_config_json [“databricksConnId”], task_id = action_name任務= [{“python_wheel_task”: {“package_name”:“PName”,“entry_point”:“ReviewSuppliers”、“named_parameters”:“{{dict (dag_run.conf)}}},“庫”:[{:“whl dbfs: / FileStore / path-to-whl。whl "})
我得到了錯誤:
airflow.exceptions。AirflowException:響應:b {“error_code”:“MALFORMED_REQUEST”、“消息”:“不能解析請求對象:預期\ ' START_OBJECT \ '不\ ' VALUE_STRING \ \ \ n[來源:(ByteArrayInputStream);線:1,列:187)\ \ n[來源:java.io.ByteArrayInputStream@47fb05c6;線:1,列:187]“}”,狀態代碼:400
我該如何改變線:“named_parameters”:“{{dict (dag_run.conf)}}”正確傳遞這個配置參數?
