Cognite Product Academy → 3. API&SDK

Introduction to the Cognite Spark Datasource (303)


Description
An introduction to Cognite Spark DataSource as an enabler for using Cognite Data Fusion, Spark and Databricks together.

Estimated time for completion: 3 hours
Content
  • Purpose and overview
  • The Purpose of the Course
  • Introduction - Spark, Databricks and Cognite Spark Datasource
  • Course Content
  • Theory: Spark and Databricks
  • What is Spark and Why Would You Need It?
  • What is Databricks, and Why Would You Need It?
  • Access and set up
  • Obtaining OID API-Key
  • Access to Databricks
  • Importing Notebook
  • Set Up Secret Scope
  • Practical example - Using Cognite Spark Datasource
  • How to Learn From The Practical Example
  • Part 1: Assets, Events and Time Series Metadata
  • Introduction
  • DataFrames
  • Displaying Data
  • Caching data
  • Time Series Metadata
  • Aggregations
  • Filtering
  • Column Objects
  • Joins
  • Part 2: Data Points and Files
  • Data Points
  • Plotting Data
  • Joins With Data Points
  • Files Metadata
  • Course feedback
  • Feedback
Completion rules
  • You must complete the units "The Purpose of the Course, Introduction - Spark, Databricks and Cognite Spark Datasource, Course Content, How to Learn From The Practical Example, Introduction, DataFrames, Displaying Data, Caching data, Time Series Metadata, Aggregations, Filtering, Column Objects, Joins, Data Points, Plotting Data, Joins With Data Points, Files Metadata, Feedback"
  • Leads to a certification with a duration: 3 months