Homework: Difference between revisions

From John's wiki
Jump to navigation Jump to search
No edit summary
 
(14 intermediate revisions by the same user not shown)
Line 82: Line 82:
|-
|-
| APM          || Application Performance Monitoring
| APM          || Application Performance Monitoring
|-
| RCA          || Root Cause Analysis
|-
|-
| SIEM        || Security Information and Event Management
| SIEM        || Security Information and Event Management
|}
|}
= Tasks =


== TODO ==
== TODO ==
Stuff to do. Priorities on top.


Do all this in your test environment so you don't need to worry about firewalls and user auth:
Do all this in your test environment so you don't need to worry about firewalls and user auth:


# gandalf: Spin up a VM for logging - install graylog as per instructions.  Point some rsyslog stuff towards it.  Review the tutorials.
* read the [https://www.zabbix.com/documentation/current/start Zabbix documentation]
# ripley: Spin up a VM with Prometheus and Grafana - install node-exporter on one of your other boxes, and point that towards your Prometheus server.   
* [https://linuxhandbook.com/grafana-setup/ How to Install and Configure Grafana] (also [https://grafana.com/docs/grafana/latest/installation/ Install Grafana])
# faith: Spin up a VM for Elasticsearch + Logstash + Kibana and set up Metricbeat on one of your other boxes, and point that towards your Elasticsearch server.
* gandalf: Spin up a VM for logging - install graylog as per instructions.  Point some rsyslog stuff towards it.  Review the tutorials.
* ripley: Spin up a VM with Prometheus and Grafana - install node-exporter on one of your other boxes, and point that towards your Prometheus server.   
* faith: Spin up a VM for Elasticsearch + Logstash + Kibana and set up Metricbeat on one of your other boxes, and point that towards your Elasticsearch server.
 
== Done ==
 
Stuff that's done. Latest on top.
 
* 2020-03-29 jj5 - I completed [https://www.zabbix.com/download?zabbix=4.4&os_distribution=ubuntu&os_version=18.04_bionic&db=mysql&ws=apache Install and configure Zabbix server for your platform]
* 2020-03-28 jj5 - I completed [https://www.elastic.co/guide/en/beats/metricbeat/7.6/metricbeat-getting-started.html Get started with Metricbeat]
* 2020-03-28 jj5 - I found [https://www.elastic.co/guide/en/elastic-stack-get-started/7.6/get-started-elastic-stack.html Getting started with the Elastic Stack]
* 2020-03-28 jj5 - I completed [https://www.elastic.co/guide/en/kibana/current/deb.html Install Kibana with Debian Package]
* 2020-03-28 jj5 - I completed [https://linuxize.com/post/how-to-install-elasticsearch-on-ubuntu-18-04/ How to Install Elasticsearch on Ubuntu 18.04]
* 2020-03-28 jj5 - created '[[#knowledge-test|knowledge-test]]' (sm-log-1) and did a basic base config with Salt Stack: see [https://www.progclub.org/pipermail/programming/2019-June/004272.html instructions from Jedd]


= Virtual machines =
= Virtual machines =
Line 102: Line 121:
{|class="wikitable"
{|class="wikitable"
! Setting          !! Value
! Setting          !! Value
|-
| Sysid            || 141
|-
|-
| System          || sm-log-1
| System          || sm-log-1
|-
| Sysid            || 141
|-
|-
| Host            || gandalf-test
| Host            || gandalf-test
Line 150: Line 169:
{|class="wikitable"
{|class="wikitable"
! Setting          !! Value
! Setting          !! Value
|-
| Sysid            || 141
|-
|-
| System          || sm-log-1
| System          || sm-log-1
|-
| Sysid            || 141
|-
|-
| Host            || knowledge-test
| Host            || knowledge-test
Line 181: Line 200:
| Ethernet Adapter || enp3s0f0
| Ethernet Adapter || enp3s0f0
|-
|-
| IP Address      || 10.1.3.141/16
| IP Address      || 10.1.2.141/16
|-
|-
| Gateway          || 10.1.1.1
| Gateway          || 10.1.2.1
|-
|-
| DNS              || 10.1.1.113
| DNS              || 10.1.1.113
|}
|}

Latest revision as of 20:22, 29 March 2020

This homework project is for John to develop a network monitoring capability under the tutelage of his Sensei, Jedd.

Messages from Jedd

Component summary

Software Note Function
Prometheus
Loki by the Grafana guys
Grafana
Elasticsearch
metricbeat
Graylog
Zabbix
PostgreSQL say with TimescaleDB
Logstash
Kibana
NetFlow (elastiflow)
NetData

Further reading

Buzzwords

Terms Jedd is liable to drop on you:

Term Meaning
APM Application Performance Monitoring
RCA Root Cause Analysis
SIEM Security Information and Event Management

Tasks

TODO

Stuff to do. Priorities on top.

Do all this in your test environment so you don't need to worry about firewalls and user auth:

  • read the Zabbix documentation
  • How to Install and Configure Grafana (also Install Grafana)
  • gandalf: Spin up a VM for logging - install graylog as per instructions. Point some rsyslog stuff towards it. Review the tutorials.
  • ripley: Spin up a VM with Prometheus and Grafana - install node-exporter on one of your other boxes, and point that towards your Prometheus server.
  • faith: Spin up a VM for Elasticsearch + Logstash + Kibana and set up Metricbeat on one of your other boxes, and point that towards your Elasticsearch server.

Done

Stuff that's done. Latest on top.

Virtual machines

gandalf-test

These notes are obsolete, see knowledge-test instead.

Setting Value
Sysid 141
System sm-log-1
Host gandalf-test
Deployment test
Provider vbox
Salt ID 141-sm-log-1-gandalf-test-vbox
Machine Folder /srv/vbox/fast
Type Linux
Version Ubuntu (64-bit)
Memory Size 3072 MB
Processor(s) 2 CUPs
Root Volume Size 30 GB
Root Volume Path /srv/vbox/fast/gandalf-test/gandalf-test.vdi
LVM PV 1 Size 500 GB
LVM PV 1 Path /srv/vbox/slow/gandalf-test/gandalf-test-pv-1-500.vdi
Attached to Bridged Adapter
Ethernet Adapter enp3s0f0
IP Address 10.1.3.141/16
Gateway 10.1.1.1
DNS 10.1.1.113

knowledge-test

Box: single box: 2 core, 6GB RAM, 100GB disk

Setting Value
Sysid 141
System sm-log-1
Host knowledge-test
Deployment test
Provider vbox
Salt ID 141-sm-log-1-knowledge-test-vbox
Machine Folder /srv/vbox/fast
Type Linux
Version Ubuntu (64-bit)
Memory Size 6 GB
Processor(s) 2 CUPs
Root Volume Size 100 GB
Root Volume Path /srv/vbox/fast/knowledge-test/knowledge-test.vdi
Attached to Bridged Adapter
Ethernet Adapter enp3s0f0
IP Address 10.1.2.141/16
Gateway 10.1.2.1
DNS 10.1.1.113