Distributed Data Processing

Protected: Leveraging Apache Spark for Distributed Data Processing – Developing and Executing Applications

Leveraging Apache Spark to enable distributed data processing for digital transformation, artificial intelligence, and machine learning tasks -Application development and execution (forced termination, yarn-client mode, yarn-cluster mode, YARN, and YARN) management commands, cluster, python, Clojure, Shell, AWS, Glue, sparkplug, spark-shell, spark-submit, Nodemanager, HDFS, Spark applications, Scala, sbt, plugin.sbt, build.sbt build.sbt, build, sbt-assembly plugin, JAR file)

2022.12.27

IOT技術:IOT TechnologyStream Data Processingweb技術:web technologyアーキテクチャデータベース技術:DataBase Technologyネットワーク技術ハードウェアマルチエージェントシステム時系列データ解析機械学習:Machine Learning

Introduction and configuration of Apache Spark for distributed data processing

Deployment and configuration of Apache Spark to enable distributed data processing for digital transformation, artificial intelligence and machine learning tasks (NodeManager, YARN, spark-master, ResourceManager, spark-worker, HDFS, NameNode, DataNode, spark-client, CDH5.4, haddop, Yum, CentOS) spark-worker, HDFS, NameNode, DataNode, spark-client, CDH5.4, haddop, Yum, CentOS)

2022.12.13

IOT技術:IOT TechnologyStream Data Processingweb技術:web technologyアーキテクチャコンピューター時系列データ解析

Protected: Apache Spark’s processing model for distributed data processing

Used for digital transformation artificial intelligence and machine learning tasks Apache Spark's processing model (Executor, Task, Scheduler, Driver Program, Master Node, Worker Node, Spark Standalone, Mesos, Hadoop, HFDS, YARN, Partitions, RDD, Transformations, Actions, Resillient Distributed Dataset)

2022.11.14

IOT技術:IOT TechnologypythonRStream Data Processingweb技術:web technologyデータベース技術:DataBase Technologyユーザーインターフェース/データビジュアライゼーション時系列データ解析非同期/並行処理:Asynchronous/parallel processing