Skip to content

Latest commit

 

History

History
549 lines (394 loc) · 32.9 KB

stackstate-changelog.md

File metadata and controls

549 lines (394 loc) · 32.9 KB

StackState Agent v2 releases

Next

Bugfix

  • Fixed NPE when handling certain containers from containerd

Improvements

  • Automatically use IMDSv2 to read EC2 instance metadata
  • Prevent Kubernetes topology check to send relations with non-existent components STAC-13859
  • Change BackOff Kubernetes event from Activities to Alert STAC-18603
  • Added a PVC component with a relation from PVC to PV STAC-18803
  • Updated the relations from Pod to PV to be Pod to PVC STAC-18803
  • Updated the relations from Container to PV to be Container to PVC STAC-18803

2.19.1 (2022-11-23)

Improvements

  • Increase Docker metrics coverage
  • Release of Swarm Agent

2.19.0 (2022-11-21)

Features

  • Add support to Kubernetes 1.22 (Ingress (networking.k8s.io/v1) and CronJob (batch/v1)) STAC-15344

Bugfix

  • Fixed issue when an Ingress does not have any HTTP rule STAC-17811
  • Fixed bug with DownwardAPI volumes on Kubernetes Topology collector STAC-14851

Improvements

  • Upstream upgrade to 7.33.1 tag STAC-16866
  • Upgraded process-agent version from 4.0.7 to 4.0.10 which includes:
    • Reduce unimportant warning logs STAC-17982
    • Fix cgroup metrics collection for containers STAC-18119

2.18.0 (2022-10-07)

Features

Bugfix

  • Fixed an issue where the docker check would not start in a Linux environment. STAC-16788

Improvements

  • Added Support for Transactional State STAC-13620
  • Added Support for Stateful Persistent State STAC-16579
  • Categorized a bunch of event reasons STAC-16668
  • Disabled validation of cluster name (leaving this concern for Helm chart and Stackpack) STAC-16382

2.17.2 (2022-08-04)

Bugfix

  • Fixed error messages and check hanging when disabling collection of certain types of resources STAC-16347
  • Fixed CloudTrail history retrieval fallback when there is no CloudTrail S3 bucket available. STAC-17058

2.17.1 (2022-07-11)

Improvements

  • Added processing AWS Security Group Ingress changes triggered by EventBridge event. STAC-17006

2.17.0 (2022-07-01)

Features

  • Support for using agents persistent cache STAC-16162
  • Added topology element deletion STAC-14816
  • Added Dynatrace support for synthetic checks STAC-14511
  • Discover relations from service to static pods (specifically, kubernetes service to kube-apiserver pods) STAC-16815
  • Added support for Container Storage Interface (CSI) volume sources STAC-15464
  • Open Telemetry
    • Added manual instrumentation support STAC-16407
    • Added interpreter support for stackstate-instrumentation STAC-16407

Improvements

  • Added collection level setting info STAC-14671
  • Upgraded process agent version from 4.0.2 to 4.0.7 which includes:

Bugfix

  • If Kubernetes topology Secrets collector fails, it will log (INFO level) only once STAC-14834
  • Add SuccessfulCreate, SuccessfulDelete and Completed to list of known events STAC-15506

2.16.1 (2022-03-21)

Bugfix

  • Remove HTTP Header X-Stackstate-Trace-Count for OTEL STAC-16030
  • Remove stale data from metrics collection in process-agent STAC-15758

Improvements

  • Memory improvements for connection mapping and tracing in process-agent. STAC-15999

2.16.0 (2022-03-11)

Features

  • Container collector for Docker, ContainerD and CRI runtimes. STAC-14483
  • Kubernetes objects topology
  • Open Telemetry
    • Added Trace Agent /open-telemetry endpoint
    • Added Open Telemetry protobuf
    • Added interpreter for open telemetry instrumentation routes
      • Added interpreter for aws-sdk instrumentation lambda, s3, step function, sqs, and sns
      • Added interpreter for http instrumentation
    • Added unit testing for Open Telemetry

Bugfix

  • Process agent now acknowledges STS_SKIP_SSL_VALIDATION environment variable. (STAC-15225)
  • Fixed agent's configuration example. (STAC-15693)
  • Fix missing HTTP response time charts (from process-agent version 4.0.1) STAC-15754
  • Big ConfigMap's are being cut to STS_CONFIGMAP_MAX_DATASIZE (default 100 KiB) before sending to StackState for better readability and performance. STAC-15323

Improvements

  • Set process agent check intervals to be default 30 seconds, added ENV variable overrides for process agent check intervals. (STAC-15661)

2.15.0 (2021-12-20)

Features

  • Raw Metrics API Endpoint
    • Add support for Raw Metrics in line with the current v2/v3 api format. (STAC-12434)
    • Convert v2/v3 api format into the v1 raw metric intake format, Allows compatibility with v1 (STAC-12434)

Improvement

  • Dependencies updates:
    • Upgraded source image for docker agent image from debian:buster-slim to ubuntu:20.04.
    • Upgraded the python3 version to 3.8.10 from 3.8.1.
    • Upgraded the pip version from 20.3 to 20.3.3.
    • Upgraded python lib versions for below module:
      • pyyaml - 5.3.1 to 5.4.1
      • requests - 2.24.0 to 2.25.0
      • urllib3 - 1.26.5

Bugfix

2.14.0 (2021-10-21)

Features

2.13.0 (2021-08-05)

Features

Bugfix

  • StackState Process Agent:
    • Fixed bytes sent/received metrics for network connections going enormously high sometimes. (STAC-13637)

2.12.0 (2021-07-09)

Features

  • Collect HTTP/1.x request rate and response time metrics for connection discovered by the StackState process agent. (STAC-11668)

Improvements

Bugfix

  • StackState process agent:
    • Namespaces are not always reported for containers/processes running in k8s. (STAC-11588)
    • Increase network connection tracking limits and make them configurable (STAC-13362)
    • Pods merge with the same ip address while using argo (STAC-13322)

2.11.0 (2021-04-20)

Features

  • DynaTrace Integration

    • Gather Dynatrace events to determine the health state of Dynatrace components in StackState (STAC-10795)

  • Docker Swarm Integration (STAC-12057)

    • Produce topology for docker swarm services and their tasks.
    • Send metric for Desired and Active replicas of a swarm service.

Improvements

Bugfix

  • Disk Integration:
    • Fixed the excluded filesystems and excluded disks failing to use the conf file. (STAC-12359)
  • Integrations:
    • Kubelet check should not fail for Kubernetes 1.18+ (due to deprecated /spec API endpoint) (STAC-12307)
    • Remove the tag for process components with high I/O or CPU. (STAC-12306)
  • VSphere Integration:
    • Fix out-of-box VSphere check settings to support the Vsphere StackPack. (STAC-12360)
  • Kubelet check should not fail for Kubernetes 1.18+ (due to deprecated /spec API endpoint) (STAC-12307)
  • Remove the tag for process components with high I/O or CPU. (STAC-12306)
  • Windows build: (STAC-12699)
    • Added a missing path for windmc
    • Added a missing path for MVS
    • Force virtual env to always install dep
  • AWS X-Ray Integration: (STAC-12750)
    • Fixed out-of-box AWS X-ray check instance

2.10.0 (2021-02-25)

Features

  • Docker Integration
    • The Docker integration is enabled by default for linux and dockerized installations which will produce docker-specific telemetry. (STAC-11903)
      • StackState will create a DEVIATING health state for spurious restarts on a container.
  • Disk Integration
    • The Disk integration is enabled by default which will produce topology and telemetry related to disk usage of the agent host. (STAC-11902)
      • StackState will create a DEVIATING health state on a host when disk space reaches 80% and CRITICAL at 100%.

Improvements

  • Integrations:
    • Added support to configure Process Agent using sts_url (STAC-11215)
    • Provide default url for install script (STAC-11215)
  • Nagios Integration:
    • Added event stream for passive service state events (STAC-11119)
    • Added event stream for service notification events (STAC-11119)
    • Added event stream for service flapping events (STAC-11119)
    • Added event stream check for host flapping alerts (STAC-11119)
  • vSphere:
  • Zabbix:
  • Kubernetes Integration
    • Show Kubernetes secret resources as components in StackState (STAC-12034)
    • Show Kubernetes namespaces as components in StackState (STAC-11382)
    • Show ExternalName of Kubernetes services as components in StackState (STAC-11523)

Bugfix

  • Integrations:
    • Agent Integrations are not tagged with Check instance tags (STAC-11453)
    • Don't create Job - Pod relations from Pods that finished running (STAC-11490)
    • Process Agent restart bug fixed for older kernel versions
  • Nagios:

2.9.0 (2020-12-18)

Features

  • DynaTrace Topology Integration:
    • Create the topology in StackState from Dynatrace smartscape topology (STAC-10499)
  • Added support for integrations to send events that can be linked to topology in StackState using Event Context (STAC-10660)
  • ServiceNow Integration:
    • ServiceNow Change Request are monitored in StackState with all updates to the Change Request state reflected as external events in StackState, such that potential failures can be related to a change in ServiceNow (STAC-10665)
    • Added support for filtering ServiceNow CI's using a custom sysparm_query (STAC-11357)
    • Support for custom cmdb_ci field that acts as Configuration Item identifier (STAC-11517)
  • Integrations:
    • Added local persistent state that can be used by integrations to persist a JSON object per check instance to disk (STAC-11296)
    • Support dynamic identifier building from check configuration using identifier_mappings (STAC-11144)
  • Kubernetes Integration:
    • Map Kubernetes events to Kubernetes components in StackState as events (STAC-11322)
    • Add extra topology component for ExternalName K8s services, that can merge with the actual service in use (STAC-11523)
    • Add namespace as components (STAC-11326) and create relations to Agent for Kubernetes different resource types(Stateful, DaemonSet and etc) (STAC-11387)

Improvements

  • ServiceNow Integration:
    • Added support for batch queries. This can be set with new parameter batch_size in check configuration file (STAC-10855)
  • Integrations:
    • Kubernetes, Kubelet, Kubernetes State and OpenMetrics integrations are monitored by StackState (STAC-11453)
    • Check API supports auto snapshots when setting with_snapshots to True in the TopologyInstance (STAC-10885)
    • Sanitize events and topology data in the base check, encoding unicode to string, before propagating data upstream (STAC-11298)
    • Added functionality to the Identifiers utility to provide lower-cased identifiers for all StackState-related identifiers (STAC-11541)
  • Trace agent:
    • Interpret Traefik traces so that the Traefik component is not the parent of a service-instance (STAC-10847)

Bugfix

  • VSphere Integration:
    • Reconnect on an authentication session timeout (STAC-11097)
    • Metric collection for components in Vsphere are now limited to the configured config.vpxd.stats.maxQueryMetrics value (STAC-11313)
  • Integrations:
    • Fixed python2 utf-8 string encoding in data produced by all integrations (STAC-11294)
    • Fixed spurious updates of Agent Integrations components in StackState (STAC-11453)
    • Fixed a memory leak in the integrations caused by yaml.safe_load when loading large objects (STAC-11363)
  • Nagios Integration:
    • Fixes service name not visible in check details (STAC-11119)
  • Remove reference of datadog in the log for core ntp check (STAC-11017)
  • Network Tracer:
    • Fix loopback address detection (STAC-8617)
    • Treat inability to start network tracing as a breaking error (STAC-11445)
  • Kubernetes Integration:
    • Make HostPath volumes be treated as volumes rather than persistent volumes (STAC-11515)

2.8.0 (2020-09-27)

Features

  • Nagios integration: adds support for Nagios ITRS OP5 (STAC-8598)
  • SAP integration: support tags, domain and environment coming from instance config (STAC-10659)
  • Zabbix integration: support for maintenance mode (STAC-10430)
  • SAP integration: Simplify and remove querying SAPHostAgent (Dennis Loos - CTAC)
  • Agent integrations (STAC-9816)
    • Adds the AgentIntegrationInstance which is a type of TopologyInstance that is synchronized by the Agent StackPack.
    • Allows mapping streams and health checks onto Agent Integration components.
    • Publish Agent Integration components for all running integrations in an agent on which the service checks produced by the integration is mapped and monitored.
    • Added the utility function that allow you to create identifiers in the format that is used in StackState for merging topology.
  • Ensure that cluster name tag is present when running on kubernetes (STAC-10046)

Bugfix

  • Nagios integration: adds missing data to events generated from Nagios log (STAC-10614)

2.7.0 (2020-07-27)

Features

  • Adds OpenMetrics integration (STAC-9940)
  • ServiceNow reports and filters certain resource types and relations on the basis of configuration defined. Identifiers added for merging with other integrations. ServiceNow Integration reports all resource types by default. (STAC-9512)
  • Migrated Nagios Integration to Agent V2. Nagios check gathers topology and metrics from your Nagios instance. (STAC-8556)

Bugfix

  • vSphere integration should continue even if metadata is not present or throws an exception. (STAC-9373)

2.6.0 (2020-07-02)

Features

  • ServiceNow check add which provides support to visualize the Configuration Items from your ServiceNow instance. (STAC-8557)

Improvements

  • Short-lived processes (by default, observed for fewer than 60sec) are filtered and not reported to StackState. (STAC-6356)
  • Network connections made by filtered processes (short-lived / blacklisted) are filtered and not reported to StackState. (STAC-6286)
  • Short-lived network relations (network connections that are not reported more than once within a configured time window) are filtered and not reported to StackState. (STAC-9182)

Bug Fixes

  • IP based Identifiers for pods are prefixed with the namespace and pod name if HostIP is used on Kubernetes. (STAC-9451)
  • Added kubernetes namespace to external ID's for all Kubernetes topology components. (STAC-9375)
  • Fix the data type for extra metadata collection in VSphere integration. (STAC-9329)

2.5.1 (2020-05-10)

Improvements

  • Added configuration flag to skip hostname validation (STAC-7652).

2.5.0 (2020-04-30)

Features

Bugs

2.4.0 (2020-04-23)

Features

  • StaticTopology check (STAC-8524) provides support to visualize the topology ingested through CSV files.

    • Gathers Topology from CSV files and allows visualization of your ingested components and relations.

  • Enable Client Certificate Authentication for SAP integration check (STAC-8396).

2.3.1 (2020-04-03)

Bugs

2.3.0 (2020-03-26)

Features

  • Zabbix check (STAC-7601) provides support to visualize the hosts systems monitored by Zabbix.
    • Gathers Topology from your Zabbix instance and allows visualization of your monitored systems components.
    • Provides events mapped to those monitored systems from Zabbix.
    • Disabling a trigger should clear health state (STAC-8176).
    • Acknowledging a problem in Zabbix should clear state (STAC-8177) .

Bugs

  • Trace-agent logs can be found in C:\ProgramData\StackState\logs now. (STAC-8177)

2.2.1 (2020-03-18)

Bugs

  • Fix out of memory issue for vsphere check due to unicode data in topology (STAC-8113)

2.2.0 (2020-03-09)

Features

  • SCOM check (STAC-7551) provides support to visualize the systems monitored by SCOM.

    • Gathers Topology from your SCOM management pack and allows visualization of your monitored systems components and the relations between them.
    • Monitoring of your SCOM (as well as systems monitored by SCOM), including health statuses of all your components.

  • Vsphere Check (STAC-7516) used to create a near real time synchronization with VMWare VSphere VCenter.

    • Gathers Topology from your Vsphere instance and allows visualization of your monitored systems components and the relations between them.

Improvements

  • Metrics produced by the Kubernetes Agent Checks now produce a cluster name tag as part of the metric. (STAC-8095)

2.1.0 (2020-02-11)

Features

  • AWS X-Ray check (STAC-6347)

    • This check provides real time gathering of AWS X-Ray traces that allows mapping the relations between X-Ray services, and ultimately AWS resources provided from AWS StackPack.
    • It provides performance metrics, as well as local anomaly detection on all performance metrics based on AWS X-Ray traces

  • SAP check (STAC-7515)

    • This check provide host instance metrics:

      • available memory metric
      • DIA free worker processes
      • BTC free worker processes

    • Ensure SAP host instances merge with vsphere VMs

    • Add stackpack:sap label to the StackPack

Improvements

  • Added kubernetes cluster name, namespace and pod name as a tag to all kubernetes container and process topology.
  • Improved the process blacklisting to ensure that only processes that are of interest to the user is reported to StackState.

2.0.8 (2019-12-20)

Features

2.0.7 (2019-12-17)

Improvements

  • Enrich kubernetes topology information with the namespace as a label on all StackState components (STAC-7084)
  • Cluster agent publishes phase information for Pods and adds another identifier to services that allows merging with trace services (STAC-6605)

Bugs

  • Fix service identifiers that have no endpoint defined (STAC-7125)
  • Do not include pod endpoint as identifier for the services (STAC-7248)

2.0.6 (2019-11-28)

Features

  • Allow linux and windows install scripts to work offline and install a local downloaded package of the StackState Agent (STAC-5977)
  • Support encryption for secrets in agent configurations using user-provided executable (STAC-6113)
  • Extend cluster agent to gather high level components (controllers, jobs, volumes, ingresses) (STAC-5372)

Improvements

  • Enrich kubernetes topology information to enable telemetry mapping (STAC-5373)

2.0.5 (2019-10-10)

Features

  • Node agent reports cluster name in the connection namespace if present (STAC-5376)

    This feature allows the DNAT endpoint (which is observed looking at connections flowing through it) to be merged with the service gathered by the cluster agent.

  • Make cluster agent gather OpenShift topology (STAC-5847)

  • Enable new cluster agent to gather Kubernetes topology (STAC-5008)

Improvements

  • Performance improvements for the stackstate agent (STAC-5968)
  • Fixed agent and trace agent branding (STAC-5945)

2.0.4 (2019-08-26)

Features

  • Add topology to python base check (STAC-4964)
  • Add new stackstate-agent-integrations (STAC-4964)
  • Add python bindings and handling of topology (STAC-4869)
  • Enable new trace agent and propagate starttime, pid and hostname tags (STAC-4878)

Bugs

2.0.3 (2019-05-28)

Features

  • Filter reported processes (STAC-3401)

    This feature changed and extended the agent configuration.

    Under the process_config section we removed blacklist_patterns and introduced the following:

    process_blacklist:
  # A list of regex patterns that will exclude a process arguments if matched.
  patterns:
    - ...
  # Inclusions rules for blacklisted processes which reports high usage.
  inclusions:
    amount_top_cpu_pct_usage: 3
    cpu_pct_usage_threshold: 20
    amount_top_io_read_usage: 3
    amount_top_io_write_usage: 3
    amount_top_mem_usage: 3
    mem_usage_threshold: 35

    Those configurations can be provided through environment variables as well:

Parameter Default Description
STS_PROCESS_BLACKLIST_PATTERNS see github A list of regex patterns that will exclude a process if matched
STS_PROCESS_BLACKLIST_INCLUSIONS_TOP_CPU 0 Number of processes to report that have a high CPU usage
STS_PROCESS_BLACKLIST_INCLUSIONS_TOP_IO_READ 0 Number of processes to report that have a high IO read usage
STS_PROCESS_BLACKLIST_INCLUSIONS_TOP_IO_WRITE 0 Number of processes to report that have a high IO write usage
STS_PROCESS_BLACKLIST_INCLUSIONS_TOP_MEM 0 Number of processes to report that have a high Memory usage
STS_PROCESS_BLACKLIST_INCLUSIONS_CPU_THRESHOLD Threshold that enables the reporting of high CPU usage processes
STS_PROCESS_BLACKLIST_INCLUSIONS_MEM_THRESHOLD Threshold that enables the reporting of high Memory usage processes

  • Report localhost connections within the same network namespace (STAC-2891)

    This feature adds support to identify localhost connections within docker containers within the same network namespace.

    The network namespace of the reported connection can be observed in StackState on the connection between the components.

  • Upstream upgrade to 6.10.2 (STAC-3220)

2.0.2 (2019-03-28)

Improvements