Skip to content

Latest commit

 

History

History
588 lines (566 loc) · 55.7 KB

CHANGELOG.md

File metadata and controls

588 lines (566 loc) · 55.7 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog.

unreleased

Added

  • Traffic Ops: #3577 - Added a query param (server host_name or ID) for servercheck API
  • Traffic Portal: #5318 - Rename server columns for IPv4 address fields.
  • Traffic Portal: #5361 - Added the ability to change the name of a topology.
  • Traffic Portal: #5340 - Added the ability to resend a user registration from user screen.
  • Traffic Portal: #5394 - Converts the tenant table to a tenant tree for usability
  • Traffic Portal: #5317 - Clicking IP addresses in the servers table no longer navigates to server details page.
  • Traffic Portal: Adds the ability for operations/admin users to create a CDN-level notification.
  • Traffic Portal: upgraded delivery service UI tables to use more powerful/performant ag-grid component
  • Traffic Ops: added a feature so that the user can specify maxRequestHeaderBytes on a per delivery service basis
  • Traffic Router: log warnings when requests to Traffic Monitor return a 503 status code
  • Traffic Router: added new 'dnssec.rrsig.cache.enabled' profile parameter to enable new DNSSEC RRSIG caching functionality. Enabling this greatly reduces CPU usage during the DNSSEC signing process.
  • #5316 - Add router host names and ports on a per interface basis, rather than a per server basis.
  • #5344 - Add a page that addresses migrating from Traffic Ops API v1 for each endpoint
  • #5296 - Fixed a bug where users couldn't update any regex in Traffic Ops/ Traffic Portal
  • Added API endpoints for ACME accounts
  • Traffic Ops: Adds API endpoints to fetch (GET), create (POST) or delete (DELETE) a cdn notification. Create and delete are limited to users with operations or admin role.
  • Traffic Ops: Added validation to ensure that the cachegroups of a delivery services' assigned ORG servers are present in the topology
  • Traffic Ops: Added validation to ensure that the weight parameter of parent.config is a float
  • Traffic Ops Client: New Login function with more options, including falling back to previous minor versions. See traffic_ops/v3-client documentation for details.
  • Added license files to the RPMs
  • Added ACME certificate renewals and ACME account registration using external account binding
  • Added functionality to automatically renew ACME certificates.
  • Added an endpoint for statuses on asynchronous jobs and applied it to the ACME renewal endpoint.

Fixed

  • #5558 - Fixed TM UI and /api/cache-statuses to report aggregate bandwidth_kbps correctly.
  • #5288 - Fixed the ability to create and update a server with MTU value >= 1280.
  • #5445 - When updating a registered user, ignore updates on registration_sent field.
  • #5335 - Don't create a change log entry if the delivery service primary origin hasn't changed
  • #5333 - Don't create a change log entry for any delivery service consistent hash query params updates
  • #5341 - For a DS with existing SSLKeys, fixed HTTP status code from 403 to 400 when updating CDN and Routing Name (in TO) and made CDN and Routing Name fields immutable (in TP).
  • #5192 - Fixed TO log warnings when generating snapshots for topology-based delivery services.
  • #5284 - Fixed error message when creating a server with non-existent profile
  • #5287 - Fixed error message when creating a Cache Group with no typeId
  • #5382 - Fixed API documentation and TP helptext for "Max DNS Answers" field with respect to DNS, HTTP, Steering Delivery Service
  • #5396 - Return the correct error type if user tries to update the root tenant
  • #5378 - Updating a non existent DS should return a 404, instead of a 500
  • Fixed a NullPointerException in TR when a client passes a null SNI hostname in a TLS request
  • Fixed a potential Traffic Router race condition that could cause erroneous 503s for CLIENT_STEERING delivery services when loading new steering changes
  • Fixed a logging bug in Traffic Monitor where it wouldn't log errors in certain cases where a backup file could be used instead. Also, Traffic Monitor now rejects monitoring snapshots that have no delivery services.
  • #5195 - Correctly show CDN ID in Changelog during Snap
  • #5438 - Correctly specify nodejs version requirements in traffic_portal.spec
  • Fixed Traffic Router logging unnecessary warnings for IPv6-only caches
  • #5294 - TP ag grid tables now properly persist column filters on page refresh.
  • #5295 - TP types/servers table now clears all filters instead of just column filters
  • #5407 - Make sure that you cannot add two servers with identical content
  • #2881 - Some API endpoints have incorrect Content-Types
  • #5311 - Better TO log messages when failures calling TM CacheStats
  • #5363 - Postgresql version changeable by env variable
  • #5364 - Cascade server deletes to delete corresponding IP addresses and interfaces
  • #5390 - Improve the way TO deals with delivery service server assignments
  • #5339 - Ensure Changelog entries for SSL key changes
  • #5405 - Prevent Tenant update from choosing child as new parent
  • #5461 - Fixed steering endpoint to be ordered consistently
  • #5395 - Added validation to prevent changing the Type any Cache Group that is in use by a Topology
  • #5384 - New grids will now properly remember the current page number.
  • Fix for public schema in 2020062923101648_add_deleted_tables.sql
  • Fixed and issue with 2020082700000000_server_id_primary_key.sql trying to create multiple primary keys when there are multiple schemas.
  • Moved move_lets_encrypt_to_acme.sql, add_max_request_header_size_delivery_service.sql, and server_interface_ip_address_cascade.sql past last migration in 5.0.0
  • #5505 - Make parent_reval_pending for servers in a Flexible Topology CDN-specific on GET /servers/{name}/update_status

Changed

  • Refactored the Traffic Ops Go client internals so that all public methods have a consistent behavior/implementation
  • Pinned external actions used by Documentation Build and TR Unit Tests workflows to commit SHA-1 and the Docker image used by the Weasel workflow to a SHA-256 digest
  • Updated the Traffic Ops Python client to 3.0
  • Updated Flot libraries to supported versions
  • apache/trafficcontrol is now a Go module
  • Set Traffic Router to only accept TLSv1.1, TLSv1.2, and TLSv1.3 protocols by default in server.xml
  • Updated Apache Tomcat from 8.5.57 to 9.0.43
  • Updated Apache Tomcat Native from 1.2.16 to 1.2.23

Removed

  • The Perl implementation of Traffic Ops has been stripped out, along with the Go implementation's "fall-back to Perl" behavior.

5.0.0 - 2020-10-20

Added

  • Traffic Ops Ort: Disabled ntpd verification (ntpd is deprecated in CentOS)
  • Traffic Ops Ort: Adds a transliteration of the traffic_ops_ort.pl perl script to the go language. See traffic_ops_ort/t3c/README.md.
  • Traffic Ops API v3
  • Added an optional readiness check service to cdn-in-a-box that exits successfully when it is able to get a 200 OK from all delivery services
  • Added health checks to Traffic Ops and Traffic Monitor in cdn-in-a-box
  • Flexible Topologies
    • Traffic Ops: Added an API 3.0 endpoint, GET /api/3.0/topologies, to create, read, update and delete flexible topologies.
    • Traffic Ops: Added an API 3.0 endpoint, POST /api/3.0/topologies/{name}/queue_update, to queue or dequeue updates for all servers assigned to the Cachegroups in a given Topology.
    • Traffic Ops: Added new topology field to the /api/3.0/deliveryservices APIs
    • Traffic Ops: Added support for topology query parameter to GET /api/3.0/cachegroups to return all cachegroups used in the given topology.
    • Traffic Ops: Added support for topology query parameter to GET /api/3.0/deliveryservices to return all delivery services that employ a given topology.
    • Traffic Ops: Added support for dsId query parameter for GET /api/3.0/servers for topology-based delivery services.
    • Traffic Ops: Excluded ORG-type servers from GET /api/3.0/servers?dsId=# for Topology-based Delivery Services unless the ORG server is assigned to that Delivery Service.
    • Traffic Ops: Added support for topology query parameter for GET /api/3.0/servers to return all servers whose cachegroups are in a given topology.
    • Traffic Ops: Added new topology-based delivery service fields for header rewrites: firstHeaderRewrite, innerHeaderRewrite, lastHeaderRewrite
    • Traffic Ops: Added validation to prohibit assigning caches to topology-based delivery services
    • Traffic Ops: Added validation to prohibit removing a capability from a server if no other server in the same cachegroup can satisfy the required capabilities of the delivery services assigned to it via topologies.
    • Traffic Ops: Added validation to ensure that updated topologies are still valid with respect to the required capabilities of their assigned delivery services.
    • Traffic Ops: Added validation to ensure that at least one server per cachegroup in a delivery service's topology has the delivery service's required capabilities.
    • Traffic Ops: Added validation to ensure that at least one server exists in each cachegroup that is used in a Topology on the /api/3.0/topologies endpoint and the /api/3.0/servers/{{ID}} endpoint.
    • Traffic Ops: Consider Topologies parentage when queueing or checking server updates
    • ORT: Added Topologies to Config Generation.
    • Traffic Portal: Added the ability to create, read, update and delete flexible topologies.
    • Traffic Portal: Added the ability to assign topologies to delivery services.
    • Traffic Portal: Added the ability to view all delivery services, cache groups and servers associated with a topology.
    • Traffic Portal: Added the ability to define first, inner and last header rewrite values for DNS* and HTTP* delivery services that employ a topology.
    • Traffic Portal: Adds the ability to view all servers utilized by a topology-based delivery service.
    • Traffic Portal: Added topology section to cdn snapshot diff.
    • Added to TP the ability to assign ORG servers to topology-based delivery services
    • Traffic Router: Added support for topology-based delivery services
    • Traffic Monitor: Added the ability to mark topology-based delivery services as available
    • CDN-in-a-Box: Add a second mid to CDN-in-a-Box, add topology demo1-top, and make the demo1 delivery service topology-based
    • Traffic Ops: Added validation to ensure assigned ORG server cachegroups are in the topology when updating a delivery service
  • Updated /servers/details to use multiple interfaces in API v3
  • Added Edge Traffic Routing feature which allows Traffic Router to localize more DNS record types than just the routing name for DNS delivery services
  • Added the ability to speedily build development RPMs from any OS without needing Docker
  • Added the ability to perform a quick search, override default pagination size and clear column filters on the Traffic Portal servers table.
  • Astats csv support - astats will now respond to Accept: text/csv and return a csv formatted stats list
  • Updated /deliveryservices/{{ID}}/servers to use multiple interfaces in API v3
  • Updated /deliveryservices/{{ID}}/servers/eligible to use multiple interfaces in API v3
  • Added the ability to view Hash ID field (aka xmppID) on Traffic Portals' server summary page
  • Added the ability to delete invalidation requests in Traffic Portal
  • Added the ability to set TLS config provided here: https://golang.org/pkg/crypto/tls/#Config in Traffic Ops
  • Added support for the cachegroupName query parameter for GET /api/3.0/servers in Traffic Ops
  • Added an indiciator to the Traffic Monitor UI when using a disk backup of Traffic Ops.
  • Added debugging functionality to CDN-in-a-Box for Traffic Stats.
  • Added If-Match and If-Unmodified-Since Support in Server and Clients.
  • Added debugging functionality to the Traffic Router unit tests runner at /traffic_router/tests
  • Made the Traffic Router unit tests runner at /traffic_router/tests run in Alpine Linux
  • Added GitHub Actions workflow for building RPMs and running the CDN-in-a-Box readiness check
  • Added the Status Last Updated field to servers, and the UI, so that we can see when the last status change took place for a server.
  • Added functionality in TR, so that it uses the default miss location of the DS, in case the location(for the client IP) returned was the default location of the country.
  • Added ability to set DNS Listening IPs in dns.properties
  • Added Traffic Monitor: Support astats CSV output. Includes http_polling_format configuration option to specify the Accept header sent to stats endpoints. Adds CSV parsing ability (~100% faster than JSON) to the astats plugin
  • Added Traffic Monitor: Support stats over http CSV output. Officially supported in ATS 9.0 unless backported by users. Users must also include system_stats.so when using stats over http in order to keep all the same functionality (and included stats) that astats_over_http provides.
  • Added ability for Traffic Monitor to determine health of cache based on interface data and aggregate data. Using the new stats_over_http health.polling.format value that allows monitoring of multiple interfaces will first require that all Traffic Monitors monitoring the affected cache server be upgraded.
  • Added ORT option to try all primaries before falling back to secondary parents, via Delivery Service Profile Parameter "try_all_primaries_before_secondary".
  • Traffic Ops, Traffic Ops ORT, Traffic Monitor, Traffic Stats, and Grove are now compiled using Go version 1.15.
  • Added --traffic_ops_insecure=<0|1> optional option to traffic_ops_ort.pl
  • Added User-Agent string to Traffic Router log output.
  • Added default sort logic to GET API calls using Read()
  • Traffic Ops: added validation for assigning ORG servers to topology-based delivery services
  • Added locationByDeepCoverageZone to the crs/stats/ip/{ip} endpoint in the Traffic Router API
  • Traffic Ops: added validation for topology updates and server updates/deletions to ensure that topologies have at least one server per cachegroup in each CDN of any assigned delivery services
  • Traffic Ops: added validation for delivery service updates to ensure that topologies have at least one server per cachegroup in each CDN of any assigned delivery services
  • Traffic Ops: added a feature to get delivery services filtered by the active flag
  • Traffic Portal: upgraded change log UI table to use more powerful/performant ag-grid component
  • Traffic Portal: change log days are now configurable in traffic_portal_properties.json (default is 7 days) and can be overridden by the user in TP
  • #5319 - Added support for building RPMs that target CentOS 8
  • #5360 - Adds the ability to clone a topology

Fixed

  • Fixed #5188 - DSR (delivery service request) incorrectly marked as complete and error message not displaying when DSR fulfilled and DS update fails in Traffic Portal. Related Github issue
  • Fixed #3455 - Alphabetically sorting CDN Read API call Related Github issue
  • Fixed #5010 - Fixed Reference urls for Cache Config on Delivery service pages (HTTP, DNS) in Traffic Portal. Related Github issue
  • Fixed #5147 - GET /servers?dsId={id} should only return mid servers (in addition to edge servers) for the cdn of the delivery service if the mid tier is employed. Related github issue
  • Fixed #4981 - Cannot create routing regular expression with a blank pattern param in Delivery Service Related github issue
  • Fixed #4979 - Returns a Bad Request error during server creation with missing profileId Related github issue
  • Fixed #4237 - Do not return an internal server error when delivery service's capacity is zero. Related github issue
  • Fixed #2712 - Invalid TM logrotate configuration permissions causing TM logs to be ignored by logrotate. Related github issue
  • Fixed #3400 - Allow "0" as a TTL value for Static DNS entries Related github issue
  • Fixed #5050 - Allows the TP administrator to name a TP instance (production, staging, etc) and flag whether it is production or not in traffic_portal_properties.json Related github issue
  • Fixed #4743 - Validate absolute DNS name requirement on Static DNS entry for CNAME type Related github issue
  • Fixed #4848 - GET /api/x/cdns/capacity gives back 500, with the message capacity was zero
  • Fixed #2156 - Renaming a host in TC, does not impact xmpp_id and thereby hashid Related github issue
  • Fixed #5038 - Adds UI warning when server interface IP CIDR is too large Related github issue
  • Fixed #3661 - Anonymous Proxy ipv4 whitelist does not work
  • Fixed #1847 - Delivery Service with SSL keys are no longer allowed to be updated when the fields changed are relevant to the SSL Keys validity.
  • Fixed #5153 - Right click context menu on new ag-grid tables appearing at the wrong place after scrolling. Related github issue
  • Fixed the GET /api/x/jobs and GET /api/x/jobs/:id Traffic Ops API routes to allow falling back to Perl via the routing blacklist
  • Fixed ORT config generation not using the coalesce_number_v6 Parameter.
  • Fixed POST deliveryservices/request (designed to simple send an email) regression which erroneously required deep caching type and routing name. Related github issue
  • Removed audit logging from the POST /api/x/serverchecks Traffic Ops API endpoint in order to reduce audit log spam
  • Fixed an issue that causes Traffic Router to mistakenly route to caches that had recently been set from ADMIN_DOWN to OFFLINE
  • Fixed an issue that caused Traffic Monitor to poll caches that did not have the status ONLINE/REPORTED/ADMIN_DOWN
  • Fixed /deliveryservice_stats regression restricting metric type to a predefined set of values. Related github issue
  • Fixed audit logging from the /jobs APIs to bring them back to the same level of information provided by TO-Perl
  • Fixed maxRevalDurationDays validation for POST /api/1.x/user/current/jobs and added that validation to the /api/x/jobs endpoints
  • Fixed slice plugin error in delivery service request view. Related github issue
  • Fixed update procedure of servers, so that if a server is linked to one or more delivery services, you cannot change its "cdn". Related github issue
  • Fixed POST /api/x/steering and PUT /api/x/steering so that a steering target with an invalid type is no longer accepted. Related github issue
  • Fixed cachegroups READ endpoint, so that if a request is made with the type specified as a non integer value, you get back a 400 with error details, instead of a 500. Related github issue
  • Fixed ORT bug miscalculating Mid Max Origin Connections as all servers, usually resulting in 1.
  • Fixed ORT atstccfg helper log to append and not overwrite old logs. Also changed to log to /var/log/ort and added a logrotate to the RPM. See the ORT README.md for details.
  • Added Delivery Service Raw Remap __RANGE_DIRECTIVE__ directive to allow inserting the Range Directive after the Raw Remap text. This allows Raw Remaps which manipulate the Range.
  • Added an option for coordinateRange in the RGB configuration file, so that in case a client doesn't have a postal code, we can still determine if it should be allowed or not, based on whether or not the latitude/ longitude of the client falls within the supplied ranges. Related github issue
  • Fixed TR build configuration (pom.xml) to invoke preinstall.sh. Related github issue
  • Fixed #3548 - Prevents DS regexes with non-consecutive order from generating invalid CRconfig/snapshot.
  • Fixes #4984 - Lets create_tables.sql be run concurrently without issue
  • Fixed #5020, #5021 - Creating an ASN with the same number and same cache group should not be allowed.
  • Fixed #5006 - Traffic Ops now generates the Monitoring on-the-fly if the snapshot doesn't exist, and logs an error. This fixes upgrading to 4.x to not break the CDN until a Snapshot is done.
  • Fixed #4680 - Change Content-Type to application/json for TR auth calls
  • Fixed #4292 - Traffic Ops not looking for influxdb.conf in the right place
  • Fixed #5102 - Python client scripts fail silently on authentication failures
  • Fixed #5103 - Python client scripts crash on connection errors
  • Fixed matching of wildcards in subjectAlternateNames when loading TLS certificates
  • Fixed #5180 - Global Max Mbps and Tps is not send to TM
  • Fixed #3528 - Fix Traffic Ops monitoring.json missing DeliveryServices
  • Fixed an issue where the jobs and servers table in Traffic Portal would not clear a column's filter when it's hidden
  • Fixed an issue with Traffic Router failing to authenticate if secrets are changed
  • Fixed validation error message for Traffic Ops POST /api/x/profileparameters route
  • Fixed #5216 - Removed duplicate button to link delivery service to server Related Github issue
  • Fixed an issue where Traffic Router would erroneously return 503s or NXDOMAINs if the caches in a cachegroup were all unavailable for a client's requested IP version, rather than selecting caches from the next closest available cachegroup.
  • Fixed an issue where downgrading the database would fail while having server interfaces with null gateways, MTU, and/or netmasks.
  • Fixed an issue where partial upgrades of the database would occasionally fail to apply 2020081108261100_add_server_ip_profile_trigger.
  • Fixed #5197 - Allows users to assign topology-based DS to ORG servers Related Github issue
  • Fixed #5161 - Fixes topology name character validation Related Github issue
  • Fixed #5237 - /isos API endpoint rejecting valid IPv6 addresses with CIDR-notation network prefixes.
  • Fixed an issue with Traffic Monitor to fix peer polling to work as expected
  • Fixed #5274 - CDN in a Box's Traffic Vault image failed to build due to Basho's repo responding with 402 Payment Required. The repo has been removed from the image.
  • #5069 - For LetsEncryptDnsChallengerWatcher in Traffic Router, the cr-config location is configurable instead of only looking at /opt/traffic_router/db/cr-config.json
  • #5191 - Error from IMS requests to /federations/all
  • Fixed Astats csv issue where it could crash if caches dont return proc data
  • #5380 - Show the correct servers (including ORGs) when a topology based DS with required capabilities + ORG servers is queried for the assigned servers
  • Fixed parent.config generation for topology-based delivery services (inline comments not supported)
  • Fixed parent.config generation for MSO delivery services with required capabilities

Changed

  • Changed some Traffic Ops Go Client methods to use DeliveryServiceNullable inputs and outputs.
  • When creating invalidation jobs through TO/TP, if an identical regex is detected that overlaps its time, then warnings will be returned indicating that overlap exists.
  • Changed Traffic Portal to disable browser caching on GETs until it utilizes the If-Modified-Since functionality that the TO API now provides.
  • Changed Traffic Portal to use Traffic Ops API v3
  • Changed Traffic Portal to use the more performant and powerful ag-grid for all server and invalidation request tables.
  • Changed ORT Config Generation to be deterministic, which will prevent spurious diffs when nothing actually changed.
  • Changed ORT to find the local ATS config directory and use it when location Parameters don't exist for many required configs, including all Delivery Service files (Header Rewrites, Regex Remap, URL Sig, URI Signing).
  • Changed ORT to not update ip_allow.config but log an error if it needs updating in syncds mode, and only actually update in badass mode.
    • ATS has a known bug, where reloading when ip_allow.config has changed blocks arbitrary addresses. This will break things by not allowing any new necessary servers, but prevents breaking the Mid server. There is no solution that doesn't break something, until ATS fixes the bug, and breaking an Edge is better than breaking a Mid.
  • Changed the access logs in Traffic Ops to now show the route ID with every API endpoint call. The Route ID is appended to the end of the access log line.
  • Changed Traffic Monitor's tmconfig.backup to store the result of GET /api/2.0/cdns/{{name}}/configs/monitoring instead of a transformed map
  • Changed OAuth workflow to use Basic Auth if client secret is provided per RFC6749 section 2.3.1.
  • Multiple Interface Servers
    • Interface data is constructed from IP Address/Gateway/Netmask (and their IPv6 counterparts) and Interface Name and Interface MTU fields on services. These MUST have proper, valid data before attempting to upgrade or the upgrade WILL fail. In particular IP fields need to be valid IP addresses/netmasks, and MTU must only be positive integers of at least 1280.
    • The /servers and /servers/{{ID}}} TO API endpoints have been updated to use and reflect multi-interface servers.
    • Updated /cdns/{{name}}/configs/monitoring TO API endpoint to return multi-interface data.
    • CDN Snapshots now use a server's "service addresses" to provide its IP addresses.
    • Changed the Cache States tab of the Traffic Monitor UI to properly handle multiple interfaces.
    • Changed the /publish/CacheStats in Traffic Monitor to support multiple interfaces.
    • Changed the CDN-in-a-Box server enrollment template to support multiple interfaces.
  • Changed Tomcat Java dependency to 8.5.57.
  • Changed Spring Framework Java dependency to 4.2.5.
  • Changed certificate loading code in Traffic Router to use Bouncy Castle instead of deprecated Sun libraries.
  • Changed deprecated AsyncHttpClient Java dependency to use new active mirror and updated to version 2.12.1.
  • Changed Traffic Portal to use the more performant and powerful ag-grid for the delivery service request (DSR) table.
  • Traffic Ops: removed change log entry created during server update/revalidation unqueue
  • Updated CDN in a Box to CentOS 8 and added RHEL_VERSION Docker build arg so CDN in a Box can be built for CentOS 7, if desired

Deprecated

  • Deprecated the non-nullable DeliveryService Go struct and other structs that use it. DeliveryServiceNullable structs should be used instead.
  • Deprecated the insecure option in traffic_ops_golang in favor of "tls_config": { "InsecureSkipVerify": <bool> }
  • Importing Traffic Ops Go clients via the un-versioned github.com/apache/trafficcontrol/traffic_ops/client is now deprecated in favor of versioned import paths e.g. github.com/apache/trafficcontrol/traffic_ops/v3-client.

Removed

  • Removed deprecated Traffic Ops Go Client methods.
  • Configuration generation logic in the TO API (v1) for all files and the "meta" route - this means that versions of Traffic Ops ORT earlier than 4.0.0 will not work any longer with versions of Traffic Ops moving forward.
  • Removed from Traffic Portal the ability to view cache server config files as the contents are no longer reliable through the TO API due to the introduction of atstccfg.

4.1.0 - 2020-04-23

Added

  • Added support for use of ATS Slice plugin as an additonal option to range request handling on HTTP/DNS DSes.
  • Added a boolean to delivery service in Traffic Portal and Traffic Ops to enable EDNS0 client subnet at the delivery service level and include it in the cr-config.
  • Updated Traffic Router to read new EDSN0 client subnet field and route accordingly only for enabled delivery services. When enabled and a subnet is present in the request, the subnet appears in the chi field and the resolver address is in the rhi field.
  • Traffic Router DNSSEC zone diffing: if enabled via the new "dnssec.zone.diffing.enabled" TR profile parameter, TR will diff existing zones against newly generated zones in order to determine if a zone needs to be re-signed. Zones are typically generated on every snapshot and whenever new DNSSEC keys are found, and since signing a zone is a relatively CPU-intensive operation, this optimization can drastically reduce the CPU time taken to process new snapshots and new DNSSEC keys.
  • Added an optimistic quorum feature to Traffic Monitor to prevent false negative states from propagating to downstream components in the event of network isolation.
  • Added the ability to fetch users by role
  • Added an API 1.5 endpoint to generate delivery service certificates using Let's Encrypt
  • Added an API 1.5 endpoint to GET a single or all records for Let's Encrypt DNS challenge
  • Added an API 1.5 endpoint to renew certificates
  • Added ability to create multiple objects from generic API Create with a single POST.
  • Added debugging functionality to CDN-in-a-Box.
  • Added an SMTP server to CDN-in-a-Box.
  • Cached builder Docker images on Docker Hub to speed up build time
  • Added functionality in the GET endpoints to support the "If-Modified-Since" header in the incoming requests.
  • Traffic Ops Golang Endpoints
    • /api/2.0 for all of the most recent route versions
    • /api/1.1/cachegroupparameters/{{cachegroupID}}/{{parameterID}} (DELETE)
    • /api/1.5/stats_summary (POST)
    • /api/1.1/cdns/routing
    • /api/1.1/cachegroupparameters/ (GET, POST)
    • /api/2.0/isos
    • /api/1.5/deliveryservice/:id/routing
    • /api/1.5/deliveryservices/sslkeys/generate/letsencrypt POST
    • /api/2.0/deliveryservices/xmlId/:XMLID/sslkeys DELETE
    • /deliveryserviceserver/:dsid/:serverid
    • /api/1.5/letsencrypt/autorenew POST
    • /api/1.5/letsencrypt/dnsrecords GET
    • /api/2.0/vault/ping GET
    • /api/2.0/vault/bucket/:bucket/key/:key/values GET
    • /api/2.0/servercheck GET
    • /api/2.0/servercheck/extensions/:id (DELETE)
    • /api/2.0/servercheck/extensions (GET, POST)
    • /api/2.0/servers/:name-or-id/update POST
    • /api/2.0/plugins (GET)
    • /api/2.0/snapshot PUT

Changed

  • Add null check in astats plugin before calling strtok to find ip mask values in the config file
  • Fix to traffic_ops_ort.pl to strip specific comment lines before checking if a file has changed. Also promoted a changed file message from DEBUG to ERROR for report mode.
  • Fixed Traffic Portal regenerating CDN DNSSEC keys with the wrong effective date
  • Fixed issue #4583: POST /users/register internal server error caused by failing DB query
  • Type mutation through the api is now restricted to only those types that apply to the "server" table
  • Updated The Traffic Ops Python, Go and Java clients to use API version 2.0 (when possible)
  • Updated CDN-in-a-Box scripts and enroller to use TO API version 2.0
  • Updated numerous, miscellaneous tools to use TO API version 2.0
  • Updated TP to use TO API v2
  • Updated TP application build dependencies
  • Modified Traffic Monitor to poll over IPv6 as well as IPv4 and separate the availability statuses.
  • Modified Traffic Router to separate availability statuses between IPv4 and IPv6.
  • Modified Traffic Portal and Traffic Ops to accept IPv6 only servers.
  • Updated Traffic Monitor to default to polling both IPv4 and IPv6.
  • Traffic Ops, Traffic Monitor, Traffic Stats, and Grove are now compiled using Go version 1.14. This requires a Traffic Vault config update (see note below).
  • Existing installations must enable TLSv1.1 for Traffic Vault in order for Traffic Ops to reach it. See Enabling TLS 1.1 in the Traffic Vault administrator's guide for instructions.
  • Changed the totalBytes property of responses to GET requests to /deliveryservice_stats to the more appropriate totalKiloBytes in API 2.x
  • Fix to traffic_ops_ort to generate logging.yaml files correctly.
  • Fixed issue #4650: add the "Vary: Accept-Encoding" header to all responses from Traffic Ops

Deprecated/Removed

  • The Traffic Ops db/admin.pl script has now been removed. Please use the db/admin binary instead.
  • Traffic Ops Python client no longer supports Python 2.
  • Traffic Ops API Endpoints
    • /api_capabilities/:id
    • /asns/:id
    • /cachegroups/:id (GET)
    • /cachegroup/:parameterID/parameter
    • /cachegroups/:parameterID/parameter/available
    • /cachegroups/:id/unassigned_parameters
    • /cachegroups/trimmed
    • /cdns/:name/configs/routing
    • /cdns/:name/federations/:id (GET)
    • /cdns/configs
    • /cdns/:id (GET)
    • /cdns/:id/snapshot
    • /cdns/name/:name (GET)
    • /cdns/usage/overview
    • /deliveryservice_matches
    • /deliveryservice_server/:dsid/:serverid
    • /deliveryservice_user
    • /deliveryservice_user/:dsId/:userId
    • /deliveryservices/hostname/:name/sslkeys
    • /deliveryservices/{dsid}/regexes/{regexid} (GET)
    • /deliveryservices/:id (GET)
    • /deliveryservices/:id/state
    • /deliveryservices/xmlId/:XMLID/sslkeys/delete
    • /divisions/:division_name/regions
    • /divisions/:id
    • /divisions/name/:name
    • /hwinfo/dtdata
    • /jobs/:id
    • /keys/ping
    • /logs/:days/days
    • /parameters/:id (GET)
    • /parameters/:id/profiles
    • /parameters/:id/unassigned_profiles
    • /parameters/profile/:name
    • /parameters/validate
    • /phys_locations/trimmed
    • /phys_locations/:id (GET)
    • /profile/:id (GET)
    • /profile/:id/unassigned_parameters
    • /profile/trimmed
    • /regions/:id (GET, DELETE)
    • /regions/:region_name/phys_locations
    • /regions/name/:region_name
    • /riak/bucket/:bucket/key/:key/vault
    • /riak/ping
    • /riak/stats
    • /servercheck/aadata
    • /servers/hostname/:hostName/details
    • /servers/status
    • /servers/:id (GET)
    • /servers/totals
    • /snapshot/:cdn
    • /stats_summary/create
    • /steering/:deliveryservice/targets/:target (GET)
    • /tenants/:id (GET)
    • /statuses/:id (GET)
    • /to_extensions/:id/delete
    • /to_extensions
    • /traffic_monitor/stats
    • /types/trimmed
    • /types/{{ID}} (GET)
    • /user/current/jobs
    • /users/:id/deliveryservices
    • /servers/checks
    • /user/{{user ID}}/deliveryservices/available

4.0.0 - 2019-12-16

Added

  • Traffic Router: TR now generates a self-signed certificate at startup and uses it as the default TLS cert. The default certificate is used whenever a client attempts an SSL handshake for an SNI host which does not match any of the other certificates.

  • Client Steering Forced Diversity: force Traffic Router to return more unique edge caches in CLIENT_STEERING results instead of the default behavior which can sometimes return a result of multiple targets using the same edge cache. In the case of edge cache failures, this feature will give clients a chance to retry a different edge cache. This can be enabled with the new "client.steering.forced.diversity" Traffic Router profile parameter.

  • Traffic Ops Golang Endpoints

    • /api/1.4/deliveryservices (GET,POST,PUT)
    • /api/1.4/users (GET,POST,PUT)
    • /api/1.1/deliveryservices/xmlId/:xmlid/sslkeys GET
    • /api/1.1/deliveryservices/hostname/:hostname/sslkeys GET
    • /api/1.1/deliveryservices/sslkeys/add POST
    • /api/1.1/deliveryservices/xmlId/:xmlid/sslkeys/delete GET
    • /api/1.4/deliveryservices_required_capabilities (GET,POST,DELETE)
    • /api/1.1/servers/status GET
    • /api/1.4/cdns/dnsseckeys/refresh GET
    • /api/1.1/cdns/name/:name/dnsseckeys GET
    • /api/1.1/roles GET
    • /api/1.4/cdns/name/:name/dnsseckeys GET
    • /api/1.4/user/login/oauth POST
    • /api/1.1/servers/:name/configfiles/ats GET
    • /api/1.1/servers/:id/queue_update POST
    • /api/1.1/profiles/:name/configfiles/ats/* GET
    • /api/1.4/profiles/name/:name/copy/:copy
    • /api/1.1/servers/:name/configfiles/ats/* GET
    • /api/1.1/cdns/:name/configfiles/ats/* GET
    • /api/1.1/servers/:id/status PUT
    • /api/1.1/dbdump GET
    • /api/1.1/servers/:name/configfiles/ats/parent.config
    • /api/1.1/servers/:name/configfiles/ats/remap.config
    • /api/1.1/user/login/token POST
    • /api/1.4/deliveryservice_stats GET
    • /api/1.1/deliveryservices/request
    • /api/1.1/federations/:id/users
    • /api/1.1/federations/:id/users/:userID
    • /api/1.2/current_stats
    • /api/1.1/osversions
    • /api/1.1/stats_summary GET
    • /api/1.1/api_capabilities GET
    • /api/1.1/user/current PUT
    • /api/1.1/federations/:id/federation_resolvers (GET, POST)

  • Traffic Router: Added a tunable bounded queue to support DNS request processing.

  • Traffic Ops API Routing Blacklist: via the routing_blacklist field in cdn.conf, enable certain whitelisted Go routes to be handled by Perl instead (via the perl_routes list) in case a regression is found in the Go handler, and explicitly disable any routes via the disabled_routes list. Requests to disabled routes are immediately given a 503 response. Both fields are lists of Route IDs, and route information (ID, version, method, path, and whether or not it can bypass to Perl) can be found by running ./traffic_ops_golang --api-routes. To disable a route or have it bypassed to Perl, find its Route ID using the previous command and put it in the disabled_routes or perl_routes list, respectively.

  • To support reusing a single riak cluster connection, an optional parameter is added to riak.conf: "HealthCheckInterval". This options takes a 'Duration' value (ie: 10s, 5m) which affects how often the riak cluster is health checked. Default is currently set to: "HealthCheckInterval": "5s".

  • Added a new Go db/admin binary to replace the Perl db/admin.pl script which is now deprecated and will be removed in a future release. The new db/admin binary is essentially a drop-in replacement for db/admin.pl since it supports all of the same commands and options; therefore, it should be used in place of db/admin.pl for all the same tasks.

  • Added an API 1.4 endpoint, /api/1.4/cdns/dnsseckeys/refresh, to perform necessary behavior previously served outside the API under /internal.

  • Added the DS Record text to the cdn dnsseckeys endpoint in 1.4.

  • Added monitoring.json snapshotting. This stores the monitoring json in the same table as the crconfig snapshot. Snapshotting is now required in order to push out monitoring changes.

  • To traffic_ops_ort.pl added the ability to handle ##OVERRIDE## delivery service ANY_MAP raw remap text to replace and comment out a base delivery service remap rules. THIS IS A TEMPORARY HACK until versioned delivery services are implemented.

  • Snapshotting the CRConfig now deletes HTTPS certificates in Riak for delivery services which have been deleted in Traffic Ops.

  • Added a context menu in place of the "Actions" column from the following tables in Traffic Portal: cache group tables, CDN tables, delivery service tables, parameter tables, profile tables, server tables.

  • Traffic Portal standalone Dockerfile

  • In Traffic Portal, removes the need to specify line breaks using __RETURN__ in delivery service edge/mid header rewrite rules, regex remap expressions, raw remap text and traffic router additional request/response headers.

  • In Traffic Portal, provides the ability to clone delivery service assignments from one cache to another cache of the same type. Issue #2963.

  • Added an API 1.4 endpoint, /api/1.4/server_capabilities, to create, read, and delete server capabilities.

  • Traffic Ops now allows each delivery service to have a set of query parameter keys to be retained for consistent hash generation by Traffic Router.

  • In Traffic Portal, delivery service table columns can now be rearranged and their visibility toggled on/off as desired by the user. Hidden table columns are excluded from the table search. These settings are persisted in the browser.

  • Added an API 1.4 endpoint, /api/1.4/user/login/oauth to handle SSO login using OAuth.

  • Added /#!/sso page to Traffic Portal to catch redirects back from OAuth provider and POST token into the API.

  • In Traffic Portal, server table columns can now be rearranged and their visibility toggled on/off as desired by the user. Hidden table columns are excluded from the table search. These settings are persisted in the browser.

  • Added pagination support to some Traffic Ops endpoints via three new query parameters, limit and offset/page

  • Traffic Ops now supports a "sortOrder" query parameter on some endpoints to return API responses in descending order

  • Traffic Ops now uses a consistent format for audit logs across all Go endpoints

  • Added cache-side config generator, atstccfg, installed with ORT. Includes all configs. Includes a plugin system.

  • Fixed ATS config generation to omit regex remap, header rewrite, URL Sig, and URI Signing files for delivery services not assigned to that server.

  • In Traffic Portal, all tables now include a 'CSV' link to enable the export of table data in CSV format.

  • Pylint configuration now enforced (present in a file in the Python client directory)

  • Added an optional SMTP server configuration to the TO configuration file, api now has unused abilitiy to send emails

  • Traffic Monitor now has "gbps" calculated stat, allowing operators to monitor bandwidth in Gbps.

  • Added an API 1.4 endpoint, /api/1.4/deliveryservices_required_capabilities, to create, read, and delete associations between a delivery service and a required capability.

  • Added ATS config generation omitting parents without Delivery Service Required Capabilities.

  • In Traffic Portal, added the ability to create, view and delete server capabilities and associate those server capabilities with servers and delivery services. See blueprint

  • Added validation to prevent assigning servers to delivery services without required capabilities.

  • Added deep coverage zone routing percentage to the Traffic Portal dashboard.

  • Added a traffic_ops/app/bin/osversions-convert.pl script to convert the osversions.cfg file from Perl to JSON as part of the /osversions endpoint rewrite.

  • Added [Experimental] - Emulated Vault suppling a HTTP server mimicking RIAK behavior for usage as traffic-control vault.

  • Added Traffic Ops Client function that returns a Delivery Service Nullable Response when requesting for a Delivery Service by XMLID

Changed

  • Traffic Router: TR will now allow steering DSs and steering target DSs to have RGB enabled. (fixes #3910)
  • Traffic Portal: Traffic Portal now allows Regional Geo Blocking to be enabled for a Steering Delivery Service.
  • Traffic Ops: fixed a regression where the Expires cookie header was not being set properly in responses. Also, added the Max-Age cookie header in responses.
  • Traffic Router, added TLS certificate validation on certificates imported from Traffic Ops
    • validates modulus of private and public keys
    • validates current timestamp falls within the certificate date bracket
    • validates certificate subjects against the DS URL
  • Traffic Ops Golang Endpoints
    • Updated /api/1.1/cachegroups: Cache Group Fallbacks are included
    • Updated /api/1.1/cachegroups: fixed so fallbackToClosest can be set through API
      • Warning: a PUT of an old Cache Group JSON without the fallbackToClosest field will result in a null value for that field
  • Traffic Router: fixed a bug which would cause REFUSED DNS answers if the zone priming execution did not complete within the configured zonemanager.init.timeout period.
  • Issue 2821: Fixed "Traffic Router may choose wrong certificate when SNI names overlap"
  • traffic_ops/app/bin/checks/ToDnssecRefresh.pl now requires "user" and "pass" parameters of an operations-level user! Update your scripts accordingly! This was necessary to move to an API endpoint with proper authentication, which may be safely exposed.
  • Traffic Monitor UI updated to support HTTP or HTTPS traffic.
  • Traffic Monitor health/stat time now includes full body download (like prior TM <=2.1 version)
  • Modified Traffic Router logging format to include an additional field for DNS log entries, namely rhi. This defaults to '-' and is only used when EDNS0 client subnet extensions are enabled and a client subnet is present in the request. When enabled and a subnet is present, the subnet appears in the chi field and the resolver address is in the rhi field.
  • Changed traffic_ops_ort.pl so that hdr_rw-<ds>.config files are compared with strict ordering and line duplication when detecting configuration changes.
  • Traffic Ops (golang), Traffic Monitor, Traffic Stats are now compiled using Go version 1.11. Grove was already being compiled with this version which improves performance for TLS when RSA certificates are used.
  • Fixed issue #3497: TO API clients that don't specify the latest minor version will overwrite/default any fields introduced in later versions
  • Fixed permissions on DELETE /api/$version/deliveryservice_server/{dsid}/{serverid} endpoint
  • Issue 3476: Traffic Router returns partial result for CLIENT_STEERING Delivery Services when Regional Geoblocking or Anonymous Blocking is enabled.
  • Upgraded Traffic Portal to AngularJS 1.7.8
  • Issue 3275: Improved the snapshot diff performance and experience.
  • Issue 3550: Fixed TC golang client setting for cache control max age
  • Issue #3605: Fixed Traffic Monitor custom ports in health polling URL.
  • Issue 3587: Fixed Traffic Ops Golang reverse proxy and Riak logs to be consistent with the format of other error logs.
  • Database migrations have been collapsed. Rollbacks to migrations that previously existed are no longer possible.
  • Issue #3750: Fixed Grove access log fractional seconds.
  • Issue #3646: Fixed Traffic Monitor Thresholds.
  • Modified Traffic Router API to be available via HTTPS.
  • Added fields to traffic_portal_properties.json to configure SSO through OAuth.
  • Added field to cdn.conf to configure whitelisted URLs for Json Key Set URL returned from OAuth provider.
  • Improved profile comparison view in Traffic Portal.
  • Issue #3871 - provides users with a specified role the ability to mark any delivery service request as complete.
  • Fixed Traffic Ops Golang POST servers/id/deliveryservice continuing erroneously after a database error.
  • Fixed Traffic Ops Golang POST servers/id/deliveryservice double-logging errors.
  • Issue #4131 - The "Clone Delivery Service Assignments" menu item is hidden on a cache when the cache has zero delivery service assignments to clone.
  • Traffic Portal - Turn off TLSv1
  • Removed Traffic Portal dependency on Restangular
  • Issue #1486 - Dashboard graph for bandwidth now displays units in the tooltip when hovering over a data point

Deprecated/Removed

  • Traffic Ops API Endpoints
    • /api/1.1/cachegroup_fallbacks
    • /api_capabilities POST

3.0.0 - 2018-10-30

Added

  • Removed MySQL-to-Postgres migration tools. This tool is supported for 1.x to 2.x upgrades only and should not be used with 3.x.
  • Backup Edge Cache group: If the matched group in the CZF is not available, this list of backup edge cache group configured via Traffic Ops API can be used as backup. In the event of all backup edge cache groups not available, GEO location can be optionally used as further backup. APIs detailed here
  • Traffic Ops Golang Proxy Endpoints
    • /api/1.4/users (GET,POST,PUT)
    • /api/1.3/origins (GET,POST,PUT,DELETE)
    • /api/1.3/coordinates (GET,POST,PUT,DELETE)
    • /api/1.3/staticdnsentries (GET,POST,PUT,DELETE)
    • /api/1.1/deliveryservices/xmlId/:xmlid/sslkeys GET
    • /api/1.1/deliveryservices/hostname/:hostname/sslkeys GET
    • /api/1.1/deliveryservices/sslkeys/add POST
    • /api/1.1/deliveryservices/xmlId/:xmlid/sslkeys/delete GET
  • Delivery Service Origins Refactor: The Delivery Service API now creates/updates an Origin entity on Delivery Service creates/updates, and the org_server_fqdn column in the deliveryservice table has been removed. The org_server_fqdn data is now computed from the Delivery Service's primary origin (note: the name of the primary origin is the xml_id of its delivery service).
  • Cachegroup-Coordinate Refactor: The Cachegroup API now creates/updates a Coordinate entity on Cachegroup creates/updates, and the latitude and longitude columns in the cachegroup table have been replaced with coordinate (a foreign key to Coordinate). Coordinates created from Cachegroups are given the name from_cachegroup_\<cachegroup name\>.
  • Geolocation-based Client Steering: two new steering target types are available to use for CLIENT_STEERING delivery services: STEERING_GEO_ORDER and STEERING_GEO_WEIGHT. When targets of these types have an Origin with a Coordinate, Traffic Router will order and prioritize them based upon the shortest total distance from client -> edge -> origin. Co-located targets are grouped together and can be weighted or ordered within the same location using STEERING_GEO_WEIGHT or STEERING_GEO_ORDER, respectively.
  • Tenancy is now the default behavior in Traffic Ops. All database entries that reference a tenant now have a default of the root tenant. This eliminates the need for the use_tenancy global parameter and will allow for code to be simplified as a result. If all user and delivery services reference the root tenant, then there will be no difference from having use_tenancy set to 0.
  • Cachegroup Localization Methods: The Cachegroup API now supports an optional localizationMethods field which specifies the localization methods allowed for that cachegroup (currently 'DEEP_CZ', 'CZ', and 'GEO'). By default if this field is null/empty, all localization methods are enabled. After Traffic Router has localized a client, it will only route that client to cachegroups that have enabled the localization method used. For example, this can be used to prevent GEO-localized traffic (i.e. most likely from off-net/internet clients) to cachegroups that aren't optimal for internet traffic.
  • Traffic Monitor Client Update: Traffic Monitor is updated to use the Traffic Ops v13 client.
  • Removed previously deprecated traffic_monitor_java
  • Added infrastructure/cdn-in-a-box for Apachecon 2018 demonstration
  • The CacheURL Delivery service field is deprecated. If you still need this functionality, you can create the configuration explicitly via the raw remap field.

2.2.0 - 2018-06-07

Added

  • Per-DeliveryService Routing Names: you can now choose a Delivery Service's Routing Name (rather than a hardcoded "tr" or "edge" name). This might require a few pre-upgrade steps detailed here
  • Delivery Service Requests: When enabled, delivery service requests are created when ALL users attempt to create, update or delete a delivery service. This allows users with higher level permissions to review delivery service changes for completeness and accuracy before deploying the changes.
  • Traffic Ops Golang Proxy Endpoints
    • /api/1.3/about (GET)
    • /api/1.3/asns (GET,POST,PUT,DELETE)
    • /api/1.3/cachegroups (GET,POST,PUT,DELETE)
    • /api/1.3/cdns (GET,POST,PUT,DELETE)
    • /api/1.3/cdns/capacity (GET)
    • /api/1.3/cdns/configs (GET)
    • /api/1.3/cdns/dnsseckeys (GET)
    • /api/1.3/cdns/domain (GET)
    • /api/1.3/cdns/monitoring (GET)
    • /api/1.3/cdns/health (GET)
    • /api/1.3/cdns/routing (GET)
    • /api/1.3/deliveryservice_requests (GET,POST,PUT,DELETE)
    • /api/1.3/divisions (GET,POST,PUT,DELETE)
    • /api/1.3/hwinfos (GET)
    • /api/1.3/login (POST)
    • /api/1.3/parameters (GET,POST,PUT,DELETE)
    • /api/1.3/profileparameters (GET,POST,PUT,DELETE)
    • /api/1.3/phys_locations (GET,POST,PUT,DELETE)
    • /api/1.3/ping (GET)
    • /api/1.3/profiles (GET,POST,PUT,DELETE)
    • /api/1.3/regions (GET,POST,PUT,DELETE)
    • /api/1.3/servers (GET,POST,PUT,DELETE)
    • /api/1.3/servers/checks (GET)
    • /api/1.3/servers/details (GET)
    • /api/1.3/servers/status (GET)
    • /api/1.3/servers/totals (GET)
    • /api/1.3/statuses (GET,POST,PUT,DELETE)
    • /api/1.3/system/info (GET)
    • /api/1.3/types (GET,POST,PUT,DELETE)
  • Fair Queuing Pacing: Using the FQ Pacing Rate parameter in Delivery Services allows operators to limit the rate of individual sessions to the edge cache. This feature requires a Trafficserver RPM containing the fq_pacing experimental plugin AND setting 'fq' as the default Linux qdisc in sysctl.
  • Traffic Ops rpm changed to remove world-read permission from configuration files.

Changed

  • Reformatted this CHANGELOG file to the keep-a-changelog format