取消
顯示的結果
而不是尋找
你的意思是:

Databricks-Connect * * * . io .運行時發生錯誤StreamCorruptedException:無效的類型代碼:00

DBJmet
新的因素

我用databricks-connect訪問遠程集群。一切正常,我可以設置斷點並詢問結果,同樣在努力執行以下代碼:

val testDF = spark.createDataFrame (spark.sparkContext

.emptyRDD(行),StructType (

數組(

StringType StructField (“prop1”),

StringType StructField (“prop2”),

StringType StructField (“prop3”),

)))

logLn(“測試DF數:”+ testDF.count ())

我從Intellij運行。任何幫助或指針會感謝。

更新:

我第一集群目標是11.3。*我有錯誤。我試著測試針對7.3和它像預期的那樣工作。然後我10.4測試,得到了上述錯誤。

全文的錯誤:

. io .StreamCorruptedException:無效的類型代碼:00

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1700)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.readObject (ObjectInputStream.java: 503)

java.io.ObjectInputStream.readObject (ObjectInputStream.java: 461)

scala.collection.immutable.List SerializationProxy.readObject美元(List.scala: 527)

在sun.reflect.NativeMethodAccessorImpl。invoke0(本地方法)

sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java: 62)

sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 43)

java.lang.reflect.Method.invoke (Method.java: 498)

java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java: 1184)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2322)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.readArray (ObjectInputStream.java: 2119)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1657)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.readObject (ObjectInputStream.java: 503)

java.io.ObjectInputStream.readObject (ObjectInputStream.java: 461)

scala.collection.immutable.List SerializationProxy.readObject美元(List.scala: 527)

在sun.reflect.NativeMethodAccessorImpl。invoke0(本地方法)

sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java: 62)

sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 43)

java.lang.reflect.Method.invoke (Method.java: 498)

java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java: 1184)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2322)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.readArray (ObjectInputStream.java: 2119)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1657)

java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java: 2431)

java.io.ObjectInputStream.readSerialData (ObjectInputStream.java: 2355)

java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java: 2213)

java.io.ObjectInputStream.readObject0 (ObjectInputStream.java: 1669)

java.io.ObjectInputStream.readObject (ObjectInputStream.java: 503)

java.io.ObjectInputStream.readObject (ObjectInputStream.java: 461)

在org.apache.spark.sql.util.ProtoSerializer。anonfun deserializeObject美元1美元(ProtoSerializer.scala: 7248)

2回答2

Debayan
尊敬的貢獻者三世
尊敬的貢獻者三世

Vidula_Khanna
主持人
主持人

嗨@James麥特卡爾夫

謝謝你發布你的問題在我們的社區!我們很高興幫助你。

幫助我們為您提供最準確的信息,請您花一些時間來回顧反應和選擇一個最好的回答了你的問題嗎?

這也將有助於其他社區成員可能也有類似的問題在未來。

謝謝你的參與,讓我們知道如果你需要任何進一步的援助!

歡迎來到磚社區:讓學習、網絡和一起慶祝

加入我們的快速增長的數據專業人員和專家的80 k +社區成員,準備發現,幫助和合作而做出有意義的聯係。

點擊在這裏注冊今天,加入!

參與令人興奮的技術討論,加入一個組與你的同事和滿足我們的成員。

Baidu
map