- Drop GPG signature (no longer used)
- Drop spec compatibility with old distro versions
- Drop netdata-automake-no-dist-xz.patch
- Refresh netdata-smartd-log-path.patch
- Update to v1.12.1
Fixes:
* Fix SIGSEGV at startup: Don't free vars of charts that do not
exist #5455
* Prevent invalid Linux power supply alarms during startup #5447
* Correct duplicate flag enum in health.h #5441
* Remove extra 'v' for netdata version from Server response
header #5440 and spec URL #5427
* apcupsd - Treat ONBATT status the same as ONLINE #5435
* Fix #5430 - LogService._get_raw_data under python3 fails on
undecodable data #5431
* Correct version check in UI #5429
* Fix ERROR 405: Cannot download charts index from server -
cpuidle handle newlines in names #5425
* Fix clock_gettime() failures with the CLOCK_BOOTTIME argument
#5415
* Use netnsid for detecting cgroup networks; #5413
* Python module sensors fix #5406 (ilyam8)
* Fix ceph.chart.py for Python3 #5396 (GaetanF)
* Fix warning condition for mem.available #5353
* cups.plugin: Support older versions #5350
Improvements:
* Add driver-type option to the freeipmi plugin #5384
* Add support of tera-byte size for Linux bcache. #5373
* Split nfacct plugin into separate process #5361
* Add cgroup cpu and memory limits and alarms #5172
* Add message queue statistics #5115
- Update to v1.12.0
Key improvements:
* Introducing netdata.cloud, the free netdata service for all
netdata users
* High performance plugins with go.d.plugin (data collection
orchestrator written in Go)
* 7 new data collectors and 11 rewrites of existing data
collectors for improved performance
* A new management API for all netdata servers
* Bind different functions of the netdata APIs to different ports
Management API:
Netdata now has a management API. We plan to provide a full set
of configuration commands using this API.
In this release, the management API supports disabling or
silencing alarms during maintenance periods.
For more information about the management API, check
https://docs.netdata.cloud/web/api/health/#health-management-api
Anonymous statistics:
Anonymous usage information can be collected and sent to Google
Analytics. This functionality is disabled by default in openSUSE.
Remove /etc/netdata/.opt-out-from-anonymous-statistics to enable.
The statistics calculated from this information will be used for:
1. Quality assurance, to help us understand if netdata behaves as
expected and help us identify repeating issues for certain
distributions or environment.
2. Usage statistics, to help us focus on the parts of netdata
that are used the most, or help us identify the extend our
development decisions influence the community.
Information is sent to Netdata via two different channels:
* Google Tag Manager is used when an agent's dashboard is
accessed.
* The script anonymous-statistics.sh is executed by the Netdata
daemon, when Netdata starts, stops cleanly, or fails.
Both methods are controlled via the same opt-out mechanism.
For more information, check
https://docs.netdata.cloud/docs/anonymous-statistics/
Data collection:
This release introduces a new Go plugin orchestrator.
This plugin has its own github repo
(https://github.com/netdata/go-orchestrator). It is open-source,
using the same license and we welcome contributions.
The orchestrator can also be used to build custom data collection
plugins written in Go. We have used the orchestrator to write
many new Go plugins in our go.d plugin github repo.
For more information, check
https://github.com/netdata/go-orchestrator#go-orchestrator-wip
New data collectors:
* Activemq (Go)
* Consul (Go)
* Lighttpd2 (Go)
* Solr (Go)
* Springboot2 (Go)
* mdstat - nonredundant arrays (C)
* CUPS printing system (C)
High performance versions of older data collectors:
* apache (Go)
* dns_query (Go)
* Freeradius (Go)
* Httpcheck (Go)
* Lighttpd (Go)
* Portcheck (Go)
* Nginx (Go)
* cpufreq (C)
* cpuidle (C)
* mdstat (C)
* power supply (C)
Other improved data collectors:
* Fix the python plugin clock (collectors falling behind).
* adaptec_raid: add to python.d.conf.
* apcupsd: Detect if UPS is online.
* apps: Fix process statistics collection for FreeBSD.
* apps: Properly lookup docker container name when running in ECS
* fail2ban: Add 'Restore Ban' action.
* go_expavar: Don't check for duplicate expvars.
* hddtemp: Don't use disk model as dim name.
* megacli: add to python.d.conf.
* nvidia_smi: handle N/A values.
* postgres: Fix integer out of range error on Postgres 11,
fix locks count.
* proc: Don't show zero charts for ZFS filesystem.
* proc; Fix cached memory calculation.
* sensors: Don't ignore 0 RPM fans on start.
* smartd_log: check() unhandled exception: list index out of
range.
* SNMP: Gracefully ignore the offset if the value is not a number
Health Monitoring:
* Add Prowl notifications for iOS users.
* Show count of active alarms per state in email notifications.
* Show evaluated expression and expression variable values in
email notifications.
* Improve support for slack recipients (channels/users).
* Custom notifications: Fix bug with alarm role recipients.
Dashboards:
* Server filtering in my-netdata menu when signed in to
netdata.cloud
* All units are now IEC-compliant abbreviations (KiB, MiB etc.).
* GUI: Make entire row clickable in the registry menu showing
the list of servers.
Backends:
* Do not report stale metrics to prometheus.
Other:
* Treat DT_UNKNOWN files as regular files.
* API: Stricter rules for URL separators.
- Update to v1.11.1
Improved internal database:
Overflown incremental values (counters) do not show a zero point
at the charts. Netdata detects the width (8bit, 16bit, 32bit,
64bit) of each counter and properly calculates the delta when
the counter overflows.
The internal database format has been extended to support values
above 64bit.
New data collection plugins:
* openldap, to collect performance statistics from OpenLDAP
servers.
* tor, to collect traffic statistics from Tor.
* nvidia_smi to monitor NVIDIA GPUs.
Improved data collection plugins:
* BUG FIX: network interface names with colon (:) in them were
incorrectly parsed and resulted in faulty data collection
values.
* BUG FIX: smartd_log has been refactored, has better python v2
compatibility, and now supports SCSI smart attributes
* cpufreq has been re-written in C - since this module if common,
we decided to convert to an internal plugin to lower the
pressure on the python ones. There are a few more that will be
transitioned to C in the next release.
* BUG FIX: sensors got some compatibility fixes and improved
handling for lm-sensors errors.
Health monitoring:
* BUG FIX: max network interface speed data collection was
faulty, which resulted in false-positive alarms on systems with
multiple interfaces using different speeds (the speed of the
first network interface was used for all network interfaces).
Now the interface speed is shown as a badge.
* alerta.io notifications got a few improvements
* BUG FIX: conntrack_max alarm has been restored (was not working
due to an invalid variable name referenced)
Registry (my-netdata menu):
* It has been refactored a bit to reveal the URLs known for each
node and now it supports deleting individual URLs.
- Update to 1.11.0
* Stock config files are now in /usr/lib/netdata; use the
/etc/netdata/edit-config script to copy and edit them.
* The query engine of netdata has been re-written to support
query plugins. We have already added the following algorithms
that are available for alarm, charts and badges:
+ stddev, for calculating the standard deviation on any
time-frame.
+ ses or ema or ewma, for calculating the exponential weighted
moving average, or single/simple exponential smoothing on
any time-frame.
+ des, for calculating the double exponential smoothing on any
time-frame.
+ cv or rsd, for calculating the coefficient of variation for
any time-frame.
Fixed security issues:
* CVE-2018-18836 Fixed JSON Header Injection (an attacker could
send \n encoded in the request to inject a JSON fragment into
the response).
* CVE-2018-18837 Fixed HTTP Header Injection (an attacker could
send \n encoded in the request to inject an HTTP header into
the response).
* CVE-2018-18838 Fixed LOG Injection (an attacker could send \n
encoded in the request to inject a log line at access.log).
* CVE-2018-18839 Not fixed Full Path Disclosure, since these are
intended (netdata reports the absolute filename of web files,
alarm config files and alarm handlers).
* Fixed Privilege Escalation by manipulating apps.plugin or
cgroup-network error handling.
* Fixed LOG injection (by sending URLs with \n in them).
New data collection modules:
* rethinkdbs for monitoring RethinkDB performance
* proxysql for monitoring ProxySQL performance
* litespeed for monitoring LiteSpeed web server performance.
* uwsgi for monitoring uWSGI performance
* unbound for monitoring the performance of Unbound DNS servers.
* powerdns for monitoring the performance of PowerDNS servers.
* dockerd for monitoring the health of dockerd
* puppet for monitoring Puppet Server and Puppet DB.
* logind for monitoring the number of active users.
* adaptec_raid and megacli for monitoring the relevant raid
controller
* spigotmc for monitoring minecraft server statistics
* boinc for monitoring Berkeley Open Infrastructure Network
Computing clients.
* w1sensor for monitoring multiple 1-Wire temperature sensors.
* monit for collecting process, host, filesystem, etc checks
from monit.
* linux_power_supplies for monitoring Linux Power Supplies
attributes
Data collection orchestrators changes:
* node.d.plugin does not use the js command any more.
* python.d.plugin now uses monotonic clocks. There was a
discrepancy in clocks used in netdata that resulted in a shift
in time of python module after some time (it was missing 1 sec
per day).
* added MySQLService for quickly adding plugins using mysql
queries.
* URLService now supports self-signed certificates and supports
custom client certificates.
* all python.d.plugin modules that require sudo to collect
metrics, are now disabled by default, to avoid security alarms
on installations that do not need them.
Improved data collection modules:
* apps.plugin now detects changes in process file descriptors,
also fixed a couple of memory leaks. Its default configuration
has been enriched significantly, especially for IoT.
* freeipmi.plugin now supports option ignore-status to ignore
the status reported by given sensors.
* statsd.plugin (for collecting custom APM metrics)
+ The charting thread has been optimized for lowering its CPU
consumption when several millions of metrics are collected.
+ sets now report zeros instead of gaps when no data are
collected
+ histograms and timers have been optimized for lowering their
CPU consumption to support several thousands of such metrics
are collected.
+ histograms had wrong sampling rate calculations.
+ gauges now ignore sampling rate when no sign is included in
the value.
+ the minimum sampling rate supported is now 0.001.
+ netdata statsd is now drop-in replacement for datadog statsd
(although statsd tags are currently ignored by netdata).
* proc.plugin (Linux, system monitoring)
+ Unused interrupts and softirqs are not used in charts
(this saves quite some processing power and memory on systems
with dozens of CPU cores).
+ fixed /proc/net/snmp parsing of IcmpMsg lines that failed on
a few systems.
+ Veritas Volume Manager disks are now recognized and named
accordingly.
+ Now netdata collects TcpExtTCPReqQFullDrop and re-organizes
metrics in charts to properly monitor the TCP SYN queue and
the TCP Accept queue of the kernel.
+ Many charts that were previously reported as IPv4, were
actually reflecting metrics for both IPv4 and IPv6.
They have been renamed to ip.*.
+ netdata now monitors SCTP.
+ Fixed BTRFS over BCACHE sector size detection.
+ BCACHE data collection is now faster.
+ /proc/interrupts and /proc/softirqs parsing fixes.
* diskspace.plugin (Linux, disk space usage monitoring)
+ It does not stat() excluded mount points any more (it was
interfering with kerberos authenticated mount points).
+ several filesystems are now by default excluded from
disk-space monitoring, to avoid breaking suspend on
workstations.
* python.d.plugin PYTHON modules (applications monitoring)
+ web_log module now supports virtual hosts, reports http/https
metrics, support squid logs
+ nginx_plus module now handles non-continuous peer IDs
+ ipfs module is optimized, the use of its Pin API is now
disabled by default and can enabled with a netdata module
option (using the IPFS Pin API increases the load on the
IPFS server).
+ fail2ban module now supports IPv6 too.
+ ceph module now checks permissions and properly reports
issues
+ elasticsearch module got better error handling
+ nginx_plus module now uses upstream ip:port instead of
transient id to identify dimensions.
+ redis, now it supports Pika, collects evited keys, fixes
authentication issues reported and improves exception
handling.
+ beanstalk, bug fix for yaml config loading.
+ mysql, the % of active connections is now monitored,
query types are also charted.
+ varnish, now it supports versions above 5.0.0
+ couchdb
+ phpfpm, now supports IPv6 too.
+ apache, now supports IPv6 too.
+ icecast
+ mongodb, added support for connect URIs
+ postgress
+ elasticsearch, now it supports versions above 6.3.0,
fixed JSON parse errors
+ mdstat , now collects mismatch_cnt
+ openvpn_log
* node.d.plugin NODE.JS modules
+ snmp was incorrectly parsing a new OID names as float.
* charts.d.plugin BASH modules
+ nut now supports naming UPSes.
Health monitoring:
* Added variable $system.cpu.processors.
* Added alarms for detecting abnormally high load average.
* TCP SYN and TCP accept queue alarms, replacing the old softnet
dropped alarm that was too generic and reported many false
positives.
* system alarms are now enabled on FreeBSD.
* netdata now reads NIC speed and sets alarms on each interface
to detect congestion.
* Network alarms are now relaxed to avoid false positives.
* New bcache alarms.
* New mdstat alarms.
* New apcupsd alarms.
* New mysql alarms.
* New notification methods:
+ rocket.chat
+ Microsoft Teams
+ syslog
+ fleep.io
+ Amazon SNS
Backends:
* Host tags are now sent to Graphite
* Host variables are now sent to Prometheus
Streaming:
* Each netdata slave and proxy now filter the charts that are
streamed. This allows exposing netdata masters to third parties
by limiting the number of charts available at the master.
* Fixed a bug in streaming slaves that randomly prevented them
to resume streaming after network errors.
* Fixed a bug that on slaves that sent duplicated chart names
under certain conditions.
* Fixed a bug that caused slaves to consume 100% CPU (due to a
misplaced lock) when multiple threads were adding dimensions
on the same chart.
* The receiving nodes of streaming (netdata masters and proxies)
can now rate-limit the rate of inbound streaming requests
received.
* Re-worked time synchronization between netdata slaves and
masters.
API:
* Badges that report time, now show "undefined" instead of
"never".
Dashboard:
* Added UTC timezone to the list of available time-zones.
* The dashboard was sending some non-HTTP compliant characters
at the URLs that made netdata dashboards break when used under
certain proxies.