python在分区列结果之间切换

我在Spark scala中使用以下代码来获得分区列。

scala> val part_cols= spark.sql(" describe extended work.quality_stat ").select("col_name").as[String].collect()
part_cols: Array[String] = Array(x_bar, p1, p5, p50, p90, p95, p99, x_id, y_id, # Partition Information, # col_name, x_id, y_id, "", # Detailed Table Information, Database, Table, Owner, Created Time, Last Access, Created By, Type, Provider, Table Properties, Location, Serde Library, InputFormat, OutputFormat, Storage Properties, Partition Provider)

scala> part_cols.takeWhile( x => x.length()!= 0 ).reverse.takeWhile( x => x != "# col_name" )
res20: Array[String] = Array(x_id, y_id)

我需要用Python获得类似的输出。我很难在Python中为数组操作复制相同的代码,以获得[y_id,x_id]。

下面是我试过的。

>>> part_cols=spark.sql(" describe extended work.quality_stat ").select("col_name").collect()

可以使用Python吗。