test word doc

Kylo Data Lake Operations Guide

V1.0

October 3, 2016

Copyright

Table of contents

Purpose5

Scope5

Abbreviations and Definitions5

System Overview5

System architecture overview 5

Functional system overview 6

Data processing framework 6

Microservices 7

Ingestion framework 7

Processing Framework 8

Access Framework 9

Introduction 9

Common Definitions 9

User Interface 10

Overview Page 10

Key Performance Indicators 12

Feed Summary 14

Active Jobs 14

Understanding Job Status 15

Job Status 15

Job Exit Codes 15

Controlling Jobs 15

Feed History Page 16

Job History Page 17

Job Detail Drill-Down 18

Job Status Info 18

Job Parameters 20

Job Context Data 21

Step Context Data 21

Scheduler Page 21

Changing an SLA 22

Filtering Job History 24

Data Table Operations 24

Sorting Content 24

Filtering Tables 25

Charts and Pivot Tables 25

Software Components 27

Installation 28

Application Configuration 28

Application Properties 28

Startup and Shutdown 32

Log Files 32

Additional Configuration 33

Configuring JVM Memory 33

Service Status Configuration 33

Viewing Service Details 33

Example Service Configuration 34

Migrating templates and feeds 35

Exporting registered templates 35

Importing registered templates 36

Exporting feeds 38

Importing feeds 38

Altering feed configurations 40

Updating sensitive properties in NiFi 41

Continuous Integration / Continuous Deployment (CICD) 41

Migrating Kylo and NiFi extensions 42

Operational Considerations 42

Disaster Recovery (DR) 43

Kylo metadata 43

NiFi data 43