Back to Find Units Page

Unit of Study COMP6004 - Big Data Analysis and Tools (2021)

Show me unit information for year

Unit Snapshot

  • Enrolment information

    N/A

Unit description

Equips students with the tools to build contemporary Big Data processing and analysis systems. Students learn how to create and develop each task in the machine learning pipeline from acquiring and cleaning data to analysing and visualising insights obtained from datasets including natural language datasets.

Unit content

Topic 1: Introduction to Big Data

Topic 2: Big Data pre-processing

Topic 3: Big Data technologies: Hadoop, Scala and Spark

Topic 4: Using Spark through Python

Topic 5: Dimension reduction

Topic 6: Data visualisation

Topic 7: Managing time-series data

Topic 8: Advanced Tensor Flow, NumPy and Pandas functionalities

Topic 9: Introduction to natural language processing and text mining

Topic 10: Processing raw text

Topic 11: Classifying text

Topic 12: Recent advances in Big Data processing.

Availabilities

Location Domestic International
Gold Coast
Session2
Session2
Melbourne N/A
Session1,2
Online
Session1,2
Session1,2
Perth N/A
Session1,2
Sydney N/A
Session1,2

Learning outcomes

Unit Learning Outcomes express learning achievement in terms of what a student should know, understand and be able to do on completion of a unit. These outcomes are aligned with the graduate attributes. The unit learning outcomes and graduate attributes are also the basis of evaluating prior learning.

On completion of this unit, students should be able to:

identify, manipulate and apply Big Data storage and processing technologies

acquire and clean large data sets

extract features and model large data sets

design algorithms and architectures for processing large data sets to extract patterns and information

develop natural language processing algorithms for text mining

Prescribed learning resources

Prescribed Texts
  • No prescribed texts.

Prescribed Texts
  • No prescribed texts.

Prescribed Learning Resources may change in future Teaching Periods.