Data Hub

Overview

Data Wrangling

• Apache Nifi
  • Apache NiFi Multitenancy Model
  • Apache NiFi and AAC Integration
• Nuclio
  • FaaS
  • Use cases
  • Nuclio dashboard and cli
  • External access
  • Workflows
  • Digital hub integration
  • Installation

Data Management

• Resource Manager
  • Design
  • Architecture
  • Scopes
  • Security
  • Authentication and Authorization
  • Providers
  • Consumers
  • Tags
  • API
  • User Interface
    • Login
    • Resource management
    • Resource detail
    • Resource creation
    • Consumer management
    • Consumer creation
  • Building from source
  • Installation
• Dremio
  • Data Sources
  • Data Exploration
  • Cloud Ready
  • Screenshots from the Website
  • Installation
  • Platform Fork
  • Configuration for OAuth2.0
    • 1. Configuring a client application on AAC
    • 2. Configuring Dremio
  • Building from Source
  • Additional Changes in the Fork
    • Source Management
    • Arrow Flight and ODBC/JDBC Services
  • Connecting WSO2 DSS to Dremio via JDBC
    • DSS Datasource Configuration
  • Dremio APIs
• SQLPad
  • Screenshots
  • Installation
  • Platform fork
  • Building from source
  • ODBC

Data Storages

• Minio
  • Minio Browser
  • Screenshots
  • Installation
  • Digital Hub integration
• PostgreSQL
  • PostGIS
  • DigitalHub integration

Data Processing and Analysis

• Jupyter Notebook
  • License
  • Screenshots
  • Installation
  • JupyterHub
• Apache Spark
• Presto
  • Digital Hub integration
  • Screenshots

Data Interfaces

• Data Services Server (WSO2)
  • Data Services Server Installation
    • Description of Custom Authentication Config Parameters
  • Data Services Server Usage
    • OData requests
    • REST Requests
    • Securing Private Data Services
  • REST API for dataservices CRUD
    • 1. REST API Usage
      • 1.1. Save dataservice
      • 1.2. Get dataservice configuration
      • 1.3. Get list of dataservices
      • 1.4. Delete dataservice
      • Technical implementation
  • Deployment Guidelines in Production
    • 1. Re-generate the keystore:
      • 1.1 Example for generating a new keystore:
      • 1.2 Example for importing a new certificate:
    • 3. Update the following files with the new keyStore name and domain alias:
    • 3. Setting Up Secure Vault Configuration (OPTIONAL)
    • 4. Adding a Custom Proxy Path
      • 4.1. Install and configure a reverse proxy
      • 4.2. Configure DSS with proxy context path
        • 4.2.1 Edit <PRODUCT_HOME>/repository/conf/carbon.xml
        • 4.2.2 Edit <PRODUCT_HOME>/repository/conf/tomcat/catalina-server.xml
        • 4.2.3 Edit <PRODUCT_HOME>/repository/conf/security/Owasp.CsrfGuard.Carbon.properties
        • 4.2.4 Remember to update the file authenticators.xml according to the new proxy config:
• GeoServer
  • Installation
  • Services
  • Data Management
    • Data Settings
      • Workspace
      • Layers
      • Stores
      • Layer Groups
  • DigitalHub integration
    • 1. Configure the AAC authentication provider
    • 2. Configure the GeoServer OAuth2 filter
• Comprehensive Knowledge Archive Network (CKAN)
  • CKAN Integration
    • CKAN DigitalHub OAuth2.0 Plugin Installation
• Goodtables
  • Goodtables-py
  • Continuous validation service
  • Validation API
  • User interface

Data Access

• Ghostunnel
  • 1. Server proxy
  • 2. Client proxy
• Smallstep CA & cli
  • 1. Server configuration
  • 2. Client execution