Skip to content

Commit b175837

Browse files
authored
Merge pull request #43 from Hamstring-NDR/fix-docuemntation
Fix docuemntation
2 parents 9135eee + 8b8a5cd commit b175837

11 files changed

Lines changed: 12 additions & 60 deletions

README.md

Lines changed: 7 additions & 55 deletions
Original file line numberDiff line numberDiff line change
@@ -43,33 +43,29 @@
4343
<a href="https://github.com/hamstring-ndr/hamstring/actions/workflows/build_test_macos.yml">
4444
<img src="https://img.shields.io/github/actions/workflow/status/hamstring-ndr/hamstring/build_test_macos.yml?branch=main&logo=apple&style=for-the-badge&label=macos" alt="MacOS WorkFlows" />
4545
</a>
46-
<a href="https://github.com/hamstring-ndr/hamstring/actions/workflows/build_test_windows.yml">
47-
<img src="https://img.shields.io/github/actions/workflow/status/hamstring-ndr/hamstring/build_test_windows.yml?branch=main&logo=windows&style=for-the-badge&label=windows" alt="Windows WorkFlows" />
48-
</a>
4946
</td>
5047
</tr>
5148
</table>
5249

5350
## About the Project
5451

55-
![Pipeline overview](./assets/heidgaf_architecture.svg)
52+
![Pipeline overview](./assets/hamstring_architecture.svg)
5653

5754
## Getting Started
5855

5956
#### Run **HAMSTRING** using Docker Compose:
6057
```sh
6158
HOST_IP=127.0.0.1 docker compose -f docker/docker-compose.yml --profile prod up
6259
```
63-
<p align="center">
64-
<img src="https://raw.githubusercontent.com/hamstring-ndr/hamstring/main/assets/terminal_example.gif?raw=true" alt="Terminal example"/>
65-
</p>
66-
6760
#### Use the dev profile for testing out changes in docker containers:
6861
```sh
6962
HOST_IP=127.0.0.1 docker compose -f docker/docker-compose.yml --profile dev up
7063
```
64+
<p align="center">
65+
<img src="./assets/hamstring_terminal.gif" alt="Terminal example"/>
66+
</p>
67+
7168

72-
<p align="right">(<a href="#readme-top">back to top</a>)</p>
7369

7470

7571

@@ -85,7 +81,7 @@ possibly infrastructure.
8581

8682
The section `pipeline.log_collection.collector.logline_format` has to be adjusted to reflect your specific input log
8783
line format. Using our adjustable and flexible log line configuration, you can rename, reorder and fully configure each
88-
field of a valid log line. Freely define timestamps, RegEx patterns, lists, and IP addresses. For example, your
84+
field of a valid log line. You can freely define timestamps, RegEx patterns, lists, and IP addresses. For example, your
8985
configuration might look as follows:
9086

9187
```yml
@@ -187,24 +183,11 @@ Have a look at the following pictures showing examples of how these dashboards m
187183

188184
</details>
189185

190-
<p align="right">(<a href="#readme-top">back to top</a>)</p>
191-
192-
193186
## Models and Training
194187

195-
To train and test our and possibly your own models, we currently rely on the following datasets:
196-
197-
- [DGTA Benchmark](https://data.mendeley.com/datasets/2wzf9bz7xr/1)
198-
- [DNS Tunneling Queries for Binary Classification](https://data.mendeley.com/datasets/mzn9hvdcxg/1)
199-
- [UMUDGA - University of Murcia Domain Generation Algorithm Dataset](https://data.mendeley.com/datasets/y8ph45msv8/1)
200-
- [DGArchive](https://dgarchive.caad.fkie.fraunhofer.de/)
201-
- [DNS Exfiltration](https://data.mendeley.com/datasets/c4n7fckkz3/3)
202-
203-
We compute all features separately and only rely on the `domain` and `class` for binary classification.
204-
205188
### Inserting Data for Testing
206189

207-
For testing purposes, you can ingest PCAPs or tap on network interfaces using the zeek-based sensor in its `1.0.0` release. For more information on it, please refer to [the documentation](https://github.com/Hamstring-NDR/hamstring-zeek).
190+
For testing purposes, you can ingest PCAPs or tap on network interfaces using the zeek-based sensor that is integrated into the docker-compose file. For more information on the sensor, please refer to [the documentation](https://github.com/Hamstring-NDR/hamstring-zeek).
208191

209192
### Training Your Own Models
210193

@@ -260,33 +243,6 @@ The results will be saved per default to `./results`, if not configured otherwis
260243
```
261244
This will create a `rules.txt` file containing the innards of the model, explaining the rules it created.
262245

263-
<p align="right">(<a href="#readme-top">back to top</a>)</p>
264-
265-
266-
### Data
267-
268-
> [!IMPORTANT]
269-
> We support custom schemes.
270-
271-
Depending on your data and usecase, you can customize the data scheme to fit your needs.
272-
The below configuration is part of the [main configuration file](./config.yaml) which is detailed in our [documentation](https://HAMSTRING.readthedocs.io/en/latest/usage.html#id2)
273-
274-
```yml
275-
loglines:
276-
fields:
277-
- [ "timestamp", RegEx, '^\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}\.\d{3}Z$' ]
278-
- [ "status_code", ListItem, [ "NOERROR", "NXDOMAIN" ], [ "NXDOMAIN" ] ]
279-
- [ "src_ip", IpAddress ]
280-
- [ "dns_server_ip", IpAddress ]
281-
- [ "domain_name", RegEx, '^(?=.{1,253}$)((?!-)[A-Za-z0-9-]{1,63}(?<!-)\.)+[A-Za-z]{2,63}$' ]
282-
- [ "record_type", ListItem, [ "A", "AAAA" ] ]
283-
- [ "response_ip", IpAddress ]
284-
- [ "size", RegEx, '^\d+b$' ]
285-
```
286-
287-
288-
289-
<p align="right">(<a href="#readme-top">back to top</a>)</p>
290246

291247
<!-- CONTRIBUTING -->
292248
## Contributing
@@ -305,16 +261,12 @@ Don't forget to give the project a star! Thanks again!
305261
</a>
306262

307263

308-
<p align="right">(<a href="#readme-top">back to top</a>)</p>
309-
310264
<!-- LICENSE -->
311265

312266
## License
313267

314268
Distributed under the EUPL License. See `LICENSE.txt` for more information.
315269

316-
<p align="right">(<a href="#readme-top">back to top</a>)</p>
317-
318270

319271
<!-- MARKDOWN LINKS & IMAGES -->
320272
<!-- https://www.markdownguide.org/basic-syntax/#reference-style-links -->

assets/hamstring_terminal.gif

2.75 MB
Loading

assets/terminal_example.gif

-312 KB
Binary file not shown.

docker/docker-compose/prod/docker-compose.monitoring.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
services:
22
monitoring_agent:
3-
image: ghcr.io/hamstring-ndr/hamstring-monitoring:v1.0.0
3+
image: ghcr.io/hamstring-ndr/hamstring-monitoring:v2.0.0
44
restart: "unless-stopped"
55
volumes:
66
- ../../../config.yaml:/app/config.yaml
71.9 KB
Loading

docs/media/hamstring_architecture.svg

Lines changed: 4 additions & 0 deletions
Loading

docs/media/heidgaf_architecture.svg

Lines changed: 0 additions & 4 deletions
This file was deleted.
-199 KB
Binary file not shown.

docs/media/monitoring_pipeline.png

-166 KB
Binary file not shown.

0 commit comments

Comments
 (0)