Skip to content

Commit

Permalink
Release version 3.1.0
Browse files Browse the repository at this point in the history
  • Loading branch information
sebix authored and aaronkaplan committed Feb 10, 2023
1 parent 0affb51 commit eba91a6
Show file tree
Hide file tree
Showing 4 changed files with 30 additions and 26 deletions.
32 changes: 15 additions & 17 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,11 @@
CHANGELOG
==========

3.1.0 (unreleased)
3.1.0 (2023-02-10)
------------------

- Upgraded syntax to Python 3.6 (mostly Format-Strings) using pyuprade (PR#2136 by Sebastian Wagner).

### Configuration

### Core
- `intelmq.lib.upgrades`:
- Refactor upgrade functions global configuration handling removing the old-style defaults configuration (PR#2058 by Sebastian Wagner).
Expand Down Expand Up @@ -45,14 +43,12 @@ CHANGELOG
- Removes `tzone` argument from `DateTime.from_timestamp` and `DateTime.from_epoch_millis`
- `DateTime.from_timstamp` now also allows string argument
- Removes `pytz` global dependency
- Removed support for Python 3.6, including removing conditional dependencies and updating syntax to use features from newest versions. (fixes [#2272](https://github.com/certtools/intelmq/issues/2272)
- Removed support for Python 3.6, including removing conditional dependencies and updating syntax to use features from newest versions. (fixes [#2272](https://github.com/certtools/intelmq/issues/2272))

### Development
- Removed Python 3.6 from CI.
- Enabled tests against Python 3.11.

### Data Format

### Bots
- Set the parent class of all bots to the correct bot class

Expand All @@ -68,16 +64,18 @@ CHANGELOG
#### Parsers
- `intelmq.bots.parsers.alienvault.parser_otx`: Save CVE data in `extra.cve` instead of `extra.CVE` due to the field name restriction on lower-case characters (PR#2059 by Sebastian Wagner).
- `intelmq.bots.parsers.anubisnetworks.parser`: Changed field name format from `extra.communication.http.x_forwarded_for_#1` to `extra.communication.http.x_forwarded_for_1` due to the field name restriction on alphanumeric characters (PR#2059 by Sebastian Wagner).
- `intelmq.bots.parsers.dataplane.parser`: Add support for additional feeds (PR#2102 by Mikk Margus Möll).
- DNS Recursion Desired
- DNS Recursion Desired ANY
- DNS Version
- Protocol 41
- SMTP Greet
- SMTP Data
- Telnet Login
- VNC/RFB Login
- Removed `intelmq.bots.parsers.malc0de`: this bot was marked as deprecated and removed from feed due to offline status (PR#2184 by Tamas Gutsohn, fixes#2178).
- `intelmq.bots.parsers.dataplane.parser`:
- Add support for additional feeds (PR#2102 by Mikk Margus Möll).
- DNS Recursion Desired
- DNS Recursion Desired ANY
- DNS Version
- Protocol 41
- SMTP Greet
- SMTP Data
- Telnet Login
- VNC/RFB Login
- Fix event object creation (PR#2298 by DigitalTrustCenter).
- Removed `intelmq.bots.parsers.malc0de`: this bot was marked as deprecated and removed from feed due to offline status (PR#2184 by Tamas Gutsohn, fixes #2178).
- `intelmq.bots.parsers.microsoft.parser_ctip`:
- New parameter `overwrite` (PR#2112 by Sebastian Wagner, fixes #2022).
- Fix handling of field `Payload.domain` if it contains the same IP address as `Payload.serverIp` (PR#2144 by Mikk Margus Möll and Sebastian Wagner).
Expand Down Expand Up @@ -130,7 +128,7 @@ CHANGELOG
- Recovering CSV lines preserves the original line ending (PR#2280 by Kamil Mankowski, fixes [#1597](https://github.com/certtools/intelmq/issues/1597))
- `intelmq.bots.parsers.autoshun.parser`: Removed, as the feed is discontinued (PR#2214 by Sebastian Waldbauer, fixes #2162).
- `intelmq.bots.parsers.openphish.parser_commercial`: Refactored complete code (PR#2160 by Filip Pokorný).
- Fixes wrong mapping of `host` field to `source.fqdn` when the content was in IP address.
- Fixes wrong mapping of `host` field to `source.fqdn` when the content was an IP address.
- Adds newly added fields in the feed.
- `intelmq.bots.parsers.phishtank.parser`: Refactored code (PR#2270 by Filip Pokorný)
- Changes feed URL to JSON format (contains more information). The URL needs to by manually updated in the configuration!
Expand Down
14 changes: 7 additions & 7 deletions NEWS.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<!-- comment
SPDX-FileCopyrightText: 2015-2022 Sebastian Wagner
SPDX-FileCopyrightText: 2015-2023 Sebastian Wagner
SPDX-License-Identifier: AGPL-3.0-or-later
-->

Expand All @@ -10,25 +10,25 @@ This file lists all changes which have an affect on the administration of IntelM
Please refer to the change log for a full list of changes.


3.1.0 Feature release (unreleased)
3.1.0 Feature release (2023-02-10)
----------------------------------

### Bots
#### ShadowServer Reports API collector
#### Shadowserver Reports API collector
The misleading `country` parameter has been depreciated and a `reports` parameter has been added.
The backwards-compatibility will be removed in IntelMQ version 4.0.0.
See the [Shadowserver Reports API bot's documentation](https://intelmq.readthedocs.io/en/latest/user/bots.html#shadowserver-reports-api).

#### GitHub Collector
GitHub removed the basic `Username/Password` Authentication in favor of personal access tokens. So the GitHub Collector uses an Personal Access Token for authentication [Github Documentation: Generate a personal access token](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token)
GitHub removed the basic `Username/Password` Authentication in favor of personal access tokens. So the GitHub Collector uses an Personal Access Token for authentication [GitHub Documentation: Generate a personal access token](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token)

#### url expert bot will deprecate url2fqdn
There is a new, more abstract bot (URL expert bot) which will gradually replace the old url2fqdn bot. The new one builds on top of the urlparse lib of python.
If you use the url2fqdn bot, please start migrating.

### Feeds
#### Abuse.ch Feodo Tracker
IntelMQ previously supported two feeds: "Feodo Tracker IPs" (downloaded as csv file) and "Feodo Tracker Browse" (downloaded as HTML table). These two feeds contain the same data but differ in the additional details. This IntelMQ release replaces both these feeds (and their parsers) with a feed called "Feodo Tracker" (downloaded as json file) which contains all the additional details from both feeds. The parser module for the new feed is `intelmq.bots.parsers.abusech.parser_feodotracker`.
IntelMQ previously supported two feeds: "Feodo Tracker IPs" (downloaded as CSV file) and "Feodo Tracker Browse" (downloaded as HTML table). These two feeds contain the same data but differ in the additional details. This IntelMQ release replaces both these feeds (and their parsers) with a feed called "Feodo Tracker" (downloaded as JSON file) which contains all the additional details from both feeds. The parser module for the new feed is `intelmq.bots.parsers.abusech.parser_feodotracker`.

### Data Format
#### Field name checks
Expand All @@ -37,7 +37,7 @@ The check which ensures this, was ineffective prior to this version and is effec
The [Data format documentation](https://intelmq.readthedocs.io/en/maintenance/dev/data-format.html#rules-for-keys) describes the required format.

### Logrotate
The packaged configuration for logrotate falsely contained options applying to other programs' log files. This caused wrong ownerships of log files.
The packaged configuration for *logrotate* falsely contained options applying to other programs' log files. This caused wrong ownership of log files.
This issues is corrected, but the ownership of affected log files may need to be changed manually.
To find affected files, you may use:
```bash
Expand All @@ -50,7 +50,7 @@ The parameter `timeout` has been merged into `redis_cache_ttl`.

### Postgres databases

The develop branch previously contained a set of unnecessary statements to update the classification.identifier. If these changes were made please revert back to the previous state.
The develop branch previously contained a set of unnecessary statements in a pre-release version to update the `classification.identifier`. If these changes were made please revert back to the previous state.


3.0.2 Maintenance release (2021-09-10)
Expand Down
6 changes: 6 additions & 0 deletions debian/changelog
Original file line number Diff line number Diff line change
@@ -1,3 +1,9 @@
intelmq (3.1.0-1) stable; urgency=medium

* Update to 3.1.0.

-- Sebastian Wagner <sebix@sebix.at> Fri, 10 Feb 2023 09:05:25 +0100

intelmq (3.1.0~rc1-1) stable; urgency=medium

* 3.1.0 Release candidate 1.
Expand Down
4 changes: 2 additions & 2 deletions intelmq/version.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# SPDX-FileCopyrightText: 2016-2022 Sebastian Wagner
# SPDX-FileCopyrightText: 2016-2023 Sebastian Wagner
#
# SPDX-License-Identifier: AGPL-3.0-or-later

__version_info__ = (3, 1, 0, 'rc1')
__version_info__ = (3, 1, 0)
__version__ = '.'.join(map(str, __version_info__))

0 comments on commit eba91a6

Please sign in to comment.