spark 跑spark sql时cpu利用率特别高怎么办

Question

spark 跑spark sql时cpu利用率特别高怎么办

Answer 1

优化过程中常用到方法查看查询的整个运行计划scala>query.queryExecution查看查询的Unresolved LogicalPlanscala>query.queryExecution.logical查看查询的Analyzed LogicalPlanscala>query.queryExecution.analyzed查看优化后的LogicalPlanscala>query.queryExecution.optimizedPlan查看物理计划scala>query.queryExecution.sparkPlan查看RDD的转换过程scala>query.toDebugString