Skip to main content
Skip accessibility options
Text size
Line height
Text spacing
Help
CCS5202 Big Data Technology (Master in Digital Intelligent)

Blocks

Skip Navigation

Navigation

  • Home

    • Site pages

      • My courses

      • ForumSite announcements

      • PageLets Create a PutraMOOC Course

      • FolderPutraMOOC Logo

      • FileMicro-Credentials UPM

      • PageGetting Started

      • PageBecome A Teacher

      • PageBlog PutraMOOC

      • PageBlog MC

      • PageNew User Tutorial

      • PageResources

      • PagePRIVACY AND SECURITY STATEMENT

      • PagePutraMOOC

      • PageMicro-credentials UPM

      • PagePutra-eX

      • PageMicro-Credentials open for all

      • PageMC Page

    • My courses

    • Courses

      • Micro-credentials

        • Academic

        • Mandiri

          • ENTOMOLOGY AND PATHOLOGY

          • DRONES OPERATION AND GEOSPATIAL MAPPING

          • ARBORICULTURE AND URBAN FOREST MANAGEMENT

          • CYBER SECURITY AWARENESS MODULE ON INTERNATIONAL S...

          • PRESCRIBING INTRAVENOUS FLUIDS: PRACTICAL HOUSE OF...

          • PENDAYAUPAYAAN KEWANGAN PERIBADI

        • Coming Soon

          • PKK5209 Principle of Human Nutrition

          • Pertanian Regeneratif

          • Proses Reka Bentuk Inovasi dan Pengkomersialan

          • Kursus Penterjemahan AM

          • Teori Penyelesaian Masalah Inventif (TRIZ) dalam R...

          • EMG5102 Pengurusan Sisa Pepejal dan Toksik

          • MGM3123 Pengurusan Sumber Manusia

          • ECN1010 Pengenalan kepada Ekonomi

          • LEADCOMM - Leadership for Community Impact

          • Asas Pendorongan Pesawat

          • Foundations of Sustainable Forest Management

          • MZK3020 Teori Muzik Asas

          • Pembangunan Instrumen Soal Selidik

          • Managing Disputes in BIM Projects

          • Tree Risk Assessment & Management

          • BBL3101 A Survey of Prose Forms and Poetry / Intro...

          • Process Safety Management

          • (COMING SOON) ASAS KESIHATAN KUDA

          • Post Graduate Certification in Leadership Developm...

          • LPE2505: ACADEMIC WRITING (PENULISAN AKADEMIK) 2

          • LPM2108: BAHASA MELAYU KOMUNIKASI

          • (COMING SOON) MGM3180: ENTREPRENEURSHIP

          • (COMING SOON) SKP3123: INTERNALIZATION OF ETHICS A...

          • Kecerdasan Buatan Dalam Penyelidikan

          • Halal Molecular Authentication and Laboratory Repo...

          • ARX4102 Pemodelan Bangunan Berinformasi (Building ...

        • STACKABLE DEGREE

          • MASTER IN DATA SCIENCE

          • MASTER IN DATA INTELLIGENCE

            • CSS5090 Research Methods

            • CCS5202 Big Data Technology (Master in Digital Int...

              • Welcome to Big Data Technology Micro-credential co...

              • Micro-certificate 1: Foundations of Scalable Big ...

              • Micro-certificate 2: High-Performance Big Data Pla...

                • Digital Badge 1: Spark Technology

                  • Interactive ContentSpark Technology (infographics)

                  • FileReal-time Data Processing (slides)

                  • AssignmentSpark Technology Assessment

                • Digital Badge 2: Cloud-Based Big Data Management T...

                • Digital Badge 3: Big Data Visualisation Technology

                • Digital Badge 4: Big Data Analytics Technology

              • Micro-certificate 3: Data-Driven Applications, Dig...

            • CSS5205 Artificial Intelligence of Things (AIoT)

        • ACADEMIC

          • LPM2100/LPM2108: BAHASA MELAYU KOMUNIKASI

          • LPE2403: ACADEMIC INTERACTION AND PRESENTATION (IN...

          • LPE2503: ACADEMIC WRITING (PENULISAN AKADEMIK)

          • FEM2401: MALAYSIAN POLITICS AND SOCIETY

          • SKP2101: KENEGARAAN MALAYSIA

          • SKP3112: FALSAFAH DAN ISU SEMASA

          • SKP3122: PENGHAYATAN ETIKA & PERADABAN

          • Coming Soon

      • PutraMOOC Courses

        • Literature and Social Science

        • Applied Science

        • Medical and Health

        • Engineering

        • Pure Science

        • Food Science

      • Micro-credentials Courses

  • Help

Real-time Data Processing (slides)

Completion requirements

Apache Spark is a robust open-source framework engineered to facilitate large-scale data processing through a distributed computing model. By utilizing in-memory computation, the system achieves significantly faster speeds than traditional disk-based methods, making it ideal for real-time analytics and complex machine learning tasks. The platform’s architecture relies on a driver program and executor nodes to manage tasks across vast clusters, ensuring both scalability and fault tolerance. Its diverse ecosystem includes specialized components for SQL queries, stream processing, and graph analysis, supporting multiple programming languages like Python and Scala. 

Click Real-time Data Process - Apache_Spark_Architecture.pdf link to view the file.
PreviousSpark Technology (infographics)
NextSpark Technology Assessment

© 2025 - 2026 Centre for Academic Development & Leadership Excellence . Universiti Putra Malaysia - All Rights Reserved

  • msBahasa Melayu