toc

Author: cassiobolba

Snowflake/readme.md

@@ -1,5 +1,167 @@
 # Snowflake
 
+- [Getting Started](#getting-started)
+ * [Criar Account](#criar-account)
+ * [Acessar a instancia](#acessar-a-instancia)
+ * [Snowsight - UI](#snowsight---ui)
+ * [Architecture Basics](#architecture-basics)
+ * [Set up Warehouse - UI](#set-up-warehouse---ui)
+ + [Create WH with SQL](#create-wh-with-sql)
+ * [Scaling Policy](#scaling-policy)
+ * [Databases](#databases)
+ * [Load Data](#load-data)
+- [Snowflake Architecture](#snowflake-architecture)
+ * [Data Warehouse](#data-warehouse)
+ * [Cloud Computing](#cloud-computing)
+ * [Snowflake Editions](#snowflake-editions)
+ + [Standard](#standard)
+ + [Enterprise](#enterprise)
+ + [Busdiness Critical](#busdiness-critical)
+ + [Virtual Private](#virtual-private)
+ * [Pricing](#pricing)
+ + [Storage](#storage)
+ + [Compute](#compute)
+ + [Storage](#storage-1)
+ + [Recomendation](#recomendation)
+ * [Monitor Usage](#monitor-usage)
+ * [Roles](#roles)
+- [Loading Data](#loading-data)
+ * [Loading Methods](#loading-methods)
+ * [Stages](#stages)
+ * [Creating a Stage](#creating-a-stage)
+ * [COPY command](#copy-command)
+ * [Transforming with COPY](#transforming-with-copy)
+ * [COPY ON_ERROR](#copy-on-error)
+ * [FILE_FORMAT object](#file-format-object)
+- [COPY options](#copy-options)
+ * [Understanding copy options](#understanding-copy-options)
+ * [VALIDATION_MODE](#validation-mode)
+ * [Working with rejected values](#working-with-rejected-values)
+ + [Dealing with errors](#dealing-with-errors)
+ * [Other COPY Options](#other-copy-options)
+ * [Check COPY history](#check-copy-history)
+- [Load Unstructured Data](#load-unstructured-data)
+ * [Unstructure data example](#unstructure-data-example)
+ * [Creating Stage and Loading Raw](#creating-stage-and-loading-raw)
+ * [Parse JSON](#parse-json)
+ * [Parsing Nested Data](#parsing-nested-data)
+ * [Dealing with Hierarchy](#dealing-with-hierarchy)
+ * [Insert Final Data](#insert-final-data)
+ * [Querying PARQUET file](#querying-parquet-file)
+ * [Loading PARQUET data](#loading-parquet-data)
+- [PERFORMANCE OPTIMIZATION](#performance-optimization)
+ * [Performance in Snowflake](#performance-in-snowflake)
+ * [Dedicated Warehouses](#dedicated-warehouses)
+ * [Implement Dedicated WH](#implement-dedicated-wh)
+ * [Scalling Up / Down](#scalling-up---down)
+ * [Scaling Out](#scaling-out)
+ * [Caching](#caching)
+ + [Maximizing Cache](#maximizing-cache)
+ * [Clustering](#clustering)
+ + [When and how to cluster](#when-and-how-to-cluster)
+ + [CLUSTER DEMO](#cluster-demo)
+- [Loading from Cloud Provider](#loading-from-cloud-provider)
+ * [Loading the data](#loading-the-data)
+- [Snowpipe](#snowpipe)
+ * [What is it?](#what-is-it-)
+ * [Steps to Create](#steps-to-create)
+ * [Creating the Stage](#creating-the-stage)
+ * [Creating the PIPE](#creating-the-pipe)
+ * [Creating Notification](#creating-notification)
+ * [Error Handling](#error-handling)
+ * [Managing Pipes](#managing-pipes)
+- [TIME TRAVEL](#time-travel)
+ * [Time travel Functions](#time-travel-functions)
+ * [Restoring the data](#restoring-the-data)
+ * [Undrop Table / Schema / Database](#undrop-table---schema---database)
+ * [Retention Period](#retention-period)
+ * [Time Travel Cost](#time-travel-cost)
+- [FAIL SAFE](#fail-safe)
+ * [What is Fail Safe](#what-is-fail-safe)
+ * [Continuous Data Protection Lifecycle](#continuous-data-protection-lifecycle)
+ * [Fail Safe Storage](#fail-safe-storage)
+- [TABLE TYPES](#table-types)
+ * [The types](#the-types)
+ * [Permanent Tables](#permanent-tables)
+ * [Transient Tables](#transient-tables)
+ * [Temporary Tables](#temporary-tables)
+- [ZERO-COPY CLONING](#zero-copy-cloning)
+ * [What is Zero-Copy Cloning?](#what-is-zero-copy-cloning-)
+ * [Cloning Tables](#cloning-tables)
+ * [Cloning Schemas & Databases](#cloning-schemas---databases)
+ * [Cloning with Time Travel](#cloning-with-time-travel)
+ * [Swapping Tables](#swapping-tables)
+- [DATA SHARING](#data-sharing)
+ * [What is Data Sharing](#what-is-data-sharing)
+ * [Data share via SQL](#data-share-via-sql)
+ * [Data share via UI](#data-share-via-ui)
+ * [Share with non SF user](#share-with-non-sf-user)
+ * [Crate a Reader Account - Managed Account](#crate-a-reader-account---managed-account)
+ * [Create a DB from Share](#create-a-db-from-share)
+ * [Create Users to share](#create-users-to-share)
+ * [Sharing DB and Schema](#sharing-db-and-schema)
+ * [Secure vs Normal view](#secure-vs-normal-view)
+ * [Share a Secure View](#share-a-secure-view)
+- [DATA SAMPLING](#data-sampling)
+ * [Why we need Data Sampling?](#why-we-need-data-sampling-)
+ * [Sampling Methods](#sampling-methods)
+ * [Sampling the data](#sampling-the-data)
+- [SCHEDULING TASKS](#scheduling-tasks)
+ * [Understangin tasks](#understangin-tasks)
+ * [Creating tasks](#creating-tasks)
+ * [Using Cron](#using-cron)
+ * [Trees of tasks](#trees-of-tasks)
+ * [Creating Tree of tasks](#creating-tree-of-tasks)
+ * [Calling a Stored Procedure](#calling-a-stored-procedure)
+ * [Task History and Error Handling](#task-history-and-error-handling)
+ * [Task with Conditions](#task-with-conditions)
+- [STREAMS](#streams)
+ * [What are Streams](#what-are-streams)
+ * [Insert Operation](#insert-operation)
+ * [Update Operation](#update-operation)
+ * [Delete Operation](#delete-operation)
+ * [Process All Data Changes](#process-all-data-changes)
+ * [Combo: Streams + Tasks](#combo--streams---tasks)
+ * [Types of Streams](#types-of-streams)
+ * [Changes Clause](#changes-clause)
+- [MATERIALIZED VIEWS](#materialized-views)
+ * [What are Materialized views ?](#what-are-materialized-views--)
+ * [Using Materialized view](#using-materialized-view)
+ * [Refresh MA](#refresh-ma)
+ * [Costs](#costs)
+ * [When to use MV](#when-to-use-mv)
+ * [MV Liimitations](#mv-liimitations)
+- [DYNAMIC DATA MASKING](#dynamic-data-masking)
+ * [What is Data Masking](#what-is-data-masking)
+ * [Creating a Masking Policy](#creating-a-masking-policy)
+ * [Unset and Replace Policy](#unset-and-replace-policy)
+ * [Alter an Existing Policy](#alter-an-existing-policy)
+ * [Masking Examples](#masking-examples)
+- [ACCESS MANAGEMENT](#access-management)
+ * [What is Access Management](#what-is-access-management)
+ + [Key Concepts](#key-concepts)
+ * [Snowflake Roles Overview](#snowflake-roles-overview)
+ * [ACCOUNTADMIN](#accountadmin)
+ * [ACCOUNTADMIN in practice](#accountadmin-in-practice)
+ * [SECUTIRYADMIN](#secutiryadmin)
+ * [SECUTIRYADMIN in Practice](#secutiryadmin-in-practice)
+ * [SYSADMIN](#sysadmin)
+ * [SYSADMIN in Practice](#sysadmin-in-practice)
+ * [Custom Roles](#custom-roles)
+ * [Custom Roles in Practice](#custom-roles-in-practice)
+ * [USERADMIN](#useradmin)
+ * [USERADMNI in Practice](#useradmni-in-practice)
+ * [PUBLIC](#public)
+- [PARTNER CONNECT](#partner-connect)
+- [BEST PRACTICES](#best-practices)
+ * [Most common Best Practices](#most-common-best-practices)
+ * [Virtual Warehouses](#virtual-warehouses)
+ * [Table Design](#table-design)
+ * [Monitoring](#monitoring)
+ * [Retention Period](#retention-period-1)
+
+<small><i><a href='http://ecotrust-canada.github.io/markdown-toc/'>Table of contents generated with markdown-toc</a></i></small>
+
 # Getting Started 
 
 ## Criar Account
@@ -782,6 +944,7 @@ SELECT * FROM rejected_values;
  - each table has one table_id and we can compare other tables 
 
 # Load Unstructured Data
+
 ## Unstructure data example
 in the example below we have dictionary, nested dictionary (job), array of dictionaries, array of values
 ```json
@@ -816,6 +979,7 @@ in the example below we have dictionary, nested dictionary (job), array of dicti
  ]
 },
 ```
+
 recomended process to deal with unstructured data:
 - create stage
 - load raw data (as variant)
@@ -1664,6 +1828,7 @@ SELECT * FROM OUR_FIRST_DB.public.test
 
 SELECT * FROM OUR_FIRST_DB.public.test before (statement => '019b9ee5-0500-8473-0043-4d8300073062')
 ```
+
 ## Restoring the data
 - setup every data as previous 
 - do two mistakes, one at each times to have 2 query id