猿问

如何创建一个类标签来用java构建广播变量spark?

我需要在我的 JAVA 函数中创建一个 borodcast,一个字符串列表的广播

Broadcast<List<String>>broadcastSp = sc.broadcast(Tvalue,classTag<T>evidence);

T 值是 "my_list" ( List<String>),但问题是如何创建第二部分classTag<T>evidence.


噜噜哒
浏览 230回答 2
2回答

慕容森

这是我的功能:public static JavaSparkContext sc;public static Broadcast < List < String >> broadcastP;public static void main(String args[]) throws Exception {&nbsp; &nbsp; sc = new JavaSparkContext("local", "test");&nbsp; &nbsp; .&nbsp; &nbsp; .&nbsp; &nbsp; .&nbsp; &nbsp; private static List < String > fFtItemSets(JavaRDD < String > base_initiale) throws Exception {&nbsp; &nbsp; &nbsp; List < String > kMinusOneSets;&nbsp; &nbsp; &nbsp; List < String > k_sets;&nbsp; &nbsp; &nbsp; int i = 1;&nbsp; &nbsp; &nbsp; k_sets = remplir_ksets_intiale(base_initiale);&nbsp; &nbsp; &nbsp; System.out.println(k_sets);&nbsp; &nbsp; &nbsp; List < String > k_sets1 = k_sets;&nbsp; &nbsp; &nbsp; int NB = k_sets.size();&nbsp; &nbsp; &nbsp; while (NB > 1) {&nbsp; &nbsp; &nbsp; &nbsp; kMinusOneSets = k_sets;&nbsp; &nbsp; &nbsp; &nbsp; k_sets = Jointure(kMinusOneSets);&nbsp; &nbsp; &nbsp; &nbsp; k_sets = Elagage(k_sets, k_sets1, i);&nbsp; &nbsp; &nbsp; &nbsp; System.out.println(k_sets);&nbsp; &nbsp; &nbsp; &nbsp; Broadcast < List < String >> broadcastSp = sc.broadcast(k - sets, List < String > );&nbsp; &nbsp; &nbsp; &nbsp; //main.sc.broadcast(k_sets);&nbsp; &nbsp; &nbsp; &nbsp; System.out.println(broadcastSp.value());&nbsp; &nbsp; &nbsp; &nbsp; k_sets = tr_freq(k_sets, broadcastnSp, base_initiale, i);&nbsp; &nbsp; &nbsp; &nbsp; k_sets1 = k_sets;&nbsp; &nbsp; &nbsp; &nbsp; NB++;&nbsp; &nbsp; &nbsp; &nbsp; i++;&nbsp; &nbsp; &nbsp; }&nbsp; &nbsp; &nbsp; return k_sets;&nbsp; &nbsp; }
随时随地看视频慕课网APP

相关分类

Java
我要回答