feat(sources): New amqp (Rabbitmq) Source/Sink #7120

dbcfd · 2021-04-14T17:05:11Z

Add amqp source and sink.

Closes: #670
Closes: #558

dbcfd · 2021-04-14T17:06:54Z

Questions

Anything beyond https://github.com/timberio/vector/blob/f30d4c6ed43838b36769753f2a591c2378162e04/CONTRIBUTING.md#integration-tests for testing?

Cargo.toml

dbcfd · 2021-04-14T17:54:07Z

I've marked this PR as WIP since it is my first vector source/sink. It's based off of kafka, but I'm sure I've missed things, or there may be better ways to do the implementation.

jszwedko · 2021-04-14T19:59:35Z

Thanks @dbcfd ! I'll make sure this gets a detailed review next week, but it seems to be generally along the right lines.

To answer your question about testing I think what you have looks reasonable, testing some stuff in mod test and then integration tests in mod integration_tests. If you are up to it, you could add a test that tests that the source and sink work together; that is, that events sent out from the sink can be consumed from the source.

We'll also want to add docs (under docs/). You could probably copy the Kafka ones and modify them, but we can also help with that later. They are written using cue.

jszwedko

This is great work, thank you @dbcfd ! Apologies for the delay in review. I appreciate the integration tests that you added.

I left some in-line comments, but I think this is generally on the right path. Once these comments are addressed, I'll try it out locally.

Cargo.toml

docs/reference/components/amqp.cue

docs/reference/components/sinks/amqp.cue

src/sinks/amqp.rs

src/sources/amqp.rs

docs/reference/components/sinks/amqp.cue

jszwedko

Thanks for the updates @dbcfd !

I left a few more comments. This seems to be coming along.

Makefile

docs/reference/components/amqp.cue

docs/reference/components/sinks/amqp.cue

docs/reference/components/amqp.cue

src/amqp.rs

src/sinks/amqp.rs

dbcfd · 2021-07-09T14:35:12Z

@jszwedko I think I've addressed all the comments now. I have one conflict that I will fix if everything looks good.

github-actions · 2022-09-08T11:52:55Z

Soak Test Results

Baseline: e9c79f9
Comparison: 048a805
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	236.18KiB	1.81	100.00%	12.72MiB	242.42KiB	4.95KiB	0.0186122	12.95MiB	567.55KiB	11.55KiB	0.0427987	False	False
datadog_agent_remap_blackhole	941.62KiB	1.53	100.00%	60.0MiB	4.29MiB	89.32KiB	0.0715002	60.92MiB	2.66MiB	55.47KiB	0.0436172	False	False
datadog_agent_remap_blackhole_acks	770.29KiB	1.3	100.00%	57.72MiB	4.54MiB	94.51KiB	0.0786329	58.47MiB	3.38MiB	70.66KiB	0.0577591	False	False
http_pipelines_blackhole_acks	8.22KiB	0.68	99.61%	1.18MiB	112.97KiB	2.3KiB	0.0935637	1.19MiB	82.2KiB	1.68KiB	0.0676147	False	False
splunk_hec_to_splunk_hec_logs_noack	12.21KiB	0.05	72.43%	23.83MiB	432.53KiB	8.83KiB	0.0177245	23.84MiB	337.1KiB	6.88KiB	0.0138068	False	False
splunk_hec_indexer_ack_blackhole	9.98KiB	0.04	29.37%	23.74MiB	940.86KiB	19.13KiB	0.038692	23.75MiB	899.85KiB	18.31KiB	0.03699	False	False
enterprise_http_to_http	-902.76B	-0	9.75%	23.85MiB	249.22KiB	5.09KiB	0.0102039	23.85MiB	248.73KiB	5.09KiB	0.0101842	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.85KiB	-0.01	5.84%	23.76MiB	885.59KiB	18.01KiB	0.0363978	23.75MiB	873.54KiB	17.76KiB	0.0359053	False	False
http_pipelines_blackhole	-531.82B	-0.03	19.32%	1.66MiB	24.59KiB	514.34B	0.0144504	1.66MiB	101.21KiB	2.06KiB	0.0595044	False	False
file_to_blackhole	-56.27KiB	-0.06	44.03%	95.34MiB	3.05MiB	63.18KiB	0.0319614	95.29MiB	3.51MiB	72.91KiB	0.036796	False	False
http_to_http_json	-30.31KiB	-0.12	98.71%	23.85MiB	332.67KiB	6.79KiB	0.0136207	23.82MiB	495.38KiB	10.12KiB	0.0203077	False	False
fluent_elasticsearch	-128.86KiB	-0.16	100.00%	79.47MiB	52.46KiB	1.06KiB	0.000644552	79.35MiB	1.26MiB	26.02KiB	0.0159204	False	False
syslog_splunk_hec_logs	-35.23KiB	-0.21	90.30%	16.45MiB	800.17KiB	16.27KiB	0.0474974	16.41MiB	668.84KiB	13.63KiB	0.0397849	False	False
http_to_http_noack	-87.47KiB	-0.36	99.98%	23.84MiB	409.2KiB	8.37KiB	0.0167605	23.75MiB	1.06MiB	22.1KiB	0.044605	False	False
splunk_hec_route_s3	-91.09KiB	-0.47	83.75%	18.93MiB	2.25MiB	46.84KiB	0.118732	18.84MiB	2.17MiB	45.36KiB	0.115114	False	False
datadog_agent_remap_datadog_logs_acks	-315.37KiB	-0.53	99.60%	57.6MiB	3.46MiB	72.25KiB	0.0601247	57.29MiB	3.96MiB	82.35KiB	0.0690382	False	False
syslog_regex_logs2metric_ddmetrics	-91.57KiB	-0.7	100.00%	12.79MiB	598.94KiB	12.21KiB	0.045723	12.7MiB	567.18KiB	11.56KiB	0.043603	False	False
http_pipelines_no_grok_blackhole	-77.86KiB	-0.71	99.96%	10.67MiB	199.79KiB	4.08KiB	0.018283	10.59MiB	1.04MiB	21.69KiB	0.0982987	False	False
syslog_log2metric_splunk_hec_metrics	-175.34KiB	-0.94	100.00%	18.28MiB	601.63KiB	12.26KiB	0.0321293	18.11MiB	668.71KiB	13.62KiB	0.0360489	False	False
http_to_http_acks	-223.09KiB	-1.25	65.43%	17.45MiB	7.96MiB	166.34KiB	0.45599	17.23MiB	8.06MiB	168.2KiB	0.467585	True	True
syslog_humio_logs	-207.22KiB	-1.26	100.00%	16.1MiB	165.03KiB	3.37KiB	0.0100047	15.9MiB	106.97KiB	2.19KiB	0.00656759	False	False
datadog_agent_remap_datadog_logs	-845.13KiB	-1.34	100.00%	61.62MiB	607.2KiB	12.44KiB	0.00962101	60.79MiB	4.0MiB	83.32KiB	0.0657844	False	False
http_text_to_http_json	-656.6KiB	-1.69	100.00%	38.04MiB	901.65KiB	18.4KiB	0.0231428	37.4MiB	815.35KiB	16.65KiB	0.0212865	False	False
syslog_loki	-373.31KiB	-2.59	100.00%	14.06MiB	214.35KiB	4.39KiB	0.0148886	13.69MiB	682.3KiB	13.87KiB	0.0486539	False	False
socket_to_socket_blackhole	-957.41KiB	-3.96	100.00%	23.62MiB	146.99KiB	3.0KiB	0.00607566	22.69MiB	227.2KiB	4.64KiB	0.00977816	False	False

src/internal_events/amqp.rs

src/sources/amqp.rs

Signed-off-by: Stephen Wakely <[email protected]>

github-actions · 2022-09-09T11:25:03Z

Soak Test Results

Baseline: 3c8f8de
Comparison: 1ec1fb7
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	679.58KiB	1.1	100.00%	60.31MiB	4.11MiB	85.61KiB	0.0681388	60.97MiB	3.21MiB	66.87KiB	0.0525639	False	False
datadog_agent_remap_blackhole_acks	456.08KiB	0.73	100.00%	61.36MiB	3.94MiB	81.99KiB	0.0641268	61.81MiB	3.31MiB	69.16KiB	0.0535534	False	False
syslog_log2metric_humio_metrics	89.79KiB	0.71	100.00%	12.35MiB	283.2KiB	5.78KiB	0.0223977	12.43MiB	558.77KiB	11.37KiB	0.0438807	False	False
syslog_splunk_hec_logs	68.92KiB	0.41	99.97%	16.51MiB	644.08KiB	13.13KiB	0.0380961	16.57MiB	691.68KiB	14.09KiB	0.0407449	False	False
http_pipelines_blackhole_acks	2.99KiB	0.24	66.71%	1.22MiB	119.96KiB	2.44KiB	0.0958514	1.22MiB	93.17KiB	1.9KiB	0.0742653	False	False
syslog_regex_logs2metric_ddmetrics	9.13KiB	0.07	38.20%	12.32MiB	664.11KiB	13.53KiB	0.0526374	12.33MiB	604.86KiB	12.33KiB	0.0479069	False	False
splunk_hec_indexer_ack_blackhole	15.95KiB	0.07	49.28%	23.75MiB	861.3KiB	17.51KiB	0.0354089	23.76MiB	810.36KiB	16.49KiB	0.0332927	False	False
splunk_hec_to_splunk_hec_logs_noack	6.64KiB	0.03	46.87%	23.83MiB	395.09KiB	8.06KiB	0.0161854	23.84MiB	337.88KiB	6.9KiB	0.0138382	False	False
splunk_hec_to_splunk_hec_logs_acks	2.93KiB	0.01	9.68%	23.76MiB	843.72KiB	17.16KiB	0.0346774	23.76MiB	833.14KiB	16.95KiB	0.0342387	False	False
enterprise_http_to_http	-610.23B	-0	6.58%	23.85MiB	246.94KiB	5.04KiB	0.0101108	23.85MiB	252.07KiB	5.16KiB	0.010321	False	False
file_to_blackhole	-55.44KiB	-0.06	37.26%	95.34MiB	3.69MiB	76.49KiB	0.0386933	95.28MiB	4.08MiB	84.83KiB	0.0427883	False	False
http_to_http_json	-37.86KiB	-0.16	99.69%	23.85MiB	330.88KiB	6.76KiB	0.0135474	23.81MiB	532.63KiB	10.87KiB	0.0218416	False	False
http_to_http_noack	-70.35KiB	-0.29	99.96%	23.85MiB	245.67KiB	5.02KiB	0.0100588	23.78MiB	938.07KiB	19.12KiB	0.0385192	False	False
http_to_http_acks	-56.95KiB	-0.32	18.96%	17.32MiB	7.79MiB	162.74KiB	0.449489	17.26MiB	8.28MiB	172.76KiB	0.479289	True	True
http_pipelines_blackhole	-6.46KiB	-0.37	99.76%	1.7MiB	13.7KiB	286.47B	0.00786186	1.7MiB	103.53KiB	2.11KiB	0.0596354	False	False
splunk_hec_route_s3	-92.65KiB	-0.49	83.35%	18.46MiB	2.3MiB	47.92KiB	0.124654	18.36MiB	2.24MiB	46.77KiB	0.121806	False	False
fluent_elasticsearch	-622.38KiB	-0.76	100.00%	79.47MiB	53.98KiB	1.09KiB	0.000663168	78.87MiB	5.88MiB	120.59KiB	0.0745115	False	False
http_pipelines_no_grok_blackhole	-92.96KiB	-0.83	100.00%	10.89MiB	44.95KiB	939.71B	0.0040309	10.8MiB	976.4KiB	19.87KiB	0.0882996	False	False
datadog_agent_remap_datadog_logs_acks	-579.84KiB	-0.92	100.00%	61.83MiB	3.12MiB	65.23KiB	0.0504622	61.26MiB	4.36MiB	90.67KiB	0.0710882	False	False
syslog_loki	-150.94KiB	-1.01	100.00%	14.63MiB	307.21KiB	6.29KiB	0.0204976	14.49MiB	712.04KiB	14.47KiB	0.047992	False	False
datadog_agent_remap_datadog_logs	-630.13KiB	-1.01	100.00%	60.76MiB	435.44KiB	8.91KiB	0.00699685	60.15MiB	4.04MiB	84.16KiB	0.0671771	False	False
syslog_log2metric_splunk_hec_metrics	-184.52KiB	-1.02	100.00%	17.66MiB	710.23KiB	14.46KiB	0.0392625	17.48MiB	942.17KiB	19.16KiB	0.0526215	False	False
syslog_humio_logs	-291.07KiB	-1.89	100.00%	15.01MiB	1.12MiB	23.5KiB	0.0748582	14.72MiB	1.47MiB	30.76KiB	0.0996316	False	False
socket_to_socket_blackhole	-530.96KiB	-2.28	100.00%	22.79MiB	359.88KiB	7.35KiB	0.0154185	22.27MiB	354.12KiB	7.23KiB	0.0155249	False	False
http_text_to_http_json	-1001.04KiB	-2.53	100.00%	38.65MiB	835.07KiB	17.05KiB	0.0210944	37.67MiB	852.65KiB	17.41KiB	0.0220974	False	False

github-actions · 2022-09-09T13:02:28Z

Soak Test Results

Baseline: 3c8f8de
Comparison: 6df7f92
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	278.02KiB	2.33	100.00%	11.65MiB	1.04MiB	21.77KiB	0.0894932	11.92MiB	1.08MiB	22.44KiB	0.090346	False	False
datadog_agent_remap_blackhole_acks	791.44KiB	1.42	99.94%	54.25MiB	7.99MiB	166.39KiB	0.147248	55.02MiB	7.58MiB	158.88KiB	0.137793	False	False
datadog_agent_remap_blackhole	555.68KiB	0.92	100.00%	59.02MiB	4.03MiB	84.16KiB	0.0683527	59.56MiB	2.87MiB	59.84KiB	0.0481044	False	False
syslog_splunk_hec_logs	104.36KiB	0.63	100.00%	16.26MiB	809.13KiB	16.45KiB	0.048587	16.36MiB	638.54KiB	13.02KiB	0.0381046	False	False
splunk_hec_route_s3	98.23KiB	0.53	86.00%	17.94MiB	2.28MiB	47.52KiB	0.127195	18.03MiB	2.23MiB	46.6KiB	0.123445	False	False
http_pipelines_blackhole_acks	2.6KiB	0.21	65.37%	1.22MiB	103.58KiB	2.11KiB	0.082809	1.22MiB	87.63KiB	1.79KiB	0.0699146	False	False
syslog_regex_logs2metric_ddmetrics	23.5KiB	0.18	84.57%	12.64MiB	601.63KiB	12.26KiB	0.0464769	12.66MiB	541.57KiB	11.04KiB	0.0417615	False	False
splunk_hec_indexer_ack_blackhole	5.6KiB	0.02	15.55%	23.73MiB	1000.53KiB	20.34KiB	0.041169	23.73MiB	985.37KiB	20.03KiB	0.040536	False	False
splunk_hec_to_splunk_hec_logs_noack	5.63KiB	0.02	41.28%	23.83MiB	381.76KiB	7.79KiB	0.0156405	23.84MiB	335.25KiB	6.84KiB	0.0137319	False	False
enterprise_http_to_http	-2.36KiB	-0.01	24.35%	23.85MiB	265.59KiB	5.42KiB	0.0108738	23.84MiB	260.57KiB	5.33KiB	0.0106692	False	False
splunk_hec_to_splunk_hec_logs_acks	-5.53KiB	-0.02	18.58%	23.76MiB	811.79KiB	16.52KiB	0.033354	23.76MiB	824.13KiB	16.77KiB	0.0338684	False	False
syslog_humio_logs	-4.12KiB	-0.02	63.37%	16.65MiB	167.16KiB	3.41KiB	0.00980155	16.65MiB	147.39KiB	3.02KiB	0.00864448	False	False
file_to_blackhole	-35.79KiB	-0.04	25.08%	95.33MiB	3.61MiB	74.88KiB	0.0378831	95.3MiB	4.0MiB	83.2KiB	0.0419482	False	False
http_to_http_json	-30.39KiB	-0.12	98.54%	23.85MiB	347.71KiB	7.1KiB	0.0142362	23.82MiB	499.96KiB	10.22KiB	0.0204954	False	False
fluent_elasticsearch	-183.84KiB	-0.23	100.00%	79.47MiB	54.08KiB	1.09KiB	0.000664349	79.29MiB	1.53MiB	31.56KiB	0.0193422	False	False
syslog_log2metric_splunk_hec_metrics	-50.41KiB	-0.27	99.61%	17.96MiB	495.23KiB	10.1KiB	0.0269165	17.91MiB	699.11KiB	14.24KiB	0.0381017	False	False
http_to_http_noack	-104.96KiB	-0.43	99.99%	23.83MiB	518.71KiB	10.6KiB	0.021254	23.73MiB	1.19MiB	24.81KiB	0.0501646	False	False
http_pipelines_blackhole	-9.81KiB	-0.56	100.00%	1.7MiB	13.19KiB	275.85B	0.00758468	1.69MiB	113.13KiB	2.31KiB	0.0654252	False	False
datadog_agent_remap_datadog_logs	-402.84KiB	-0.65	100.00%	60.1MiB	971.82KiB	19.9KiB	0.015788	59.71MiB	3.84MiB	79.99KiB	0.0642965	False	False
http_to_http_acks	-118.63KiB	-0.66	38.89%	17.59MiB	7.46MiB	156.02KiB	0.42435	17.47MiB	8.32MiB	173.4KiB	0.475951	True	True
datadog_agent_remap_datadog_logs_acks	-487.8KiB	-0.78	100.00%	60.78MiB	3.23MiB	67.58KiB	0.0532048	60.31MiB	4.3MiB	89.55KiB	0.0713196	False	False
syslog_loki	-151.05KiB	-1.01	100.00%	14.54MiB	313.67KiB	6.42KiB	0.0210651	14.39MiB	712.42KiB	14.48KiB	0.0483353	False	False
http_pipelines_no_grok_blackhole	-128.67KiB	-1.15	100.00%	10.89MiB	44.65KiB	933.59B	0.00400209	10.77MiB	1.07MiB	22.26KiB	0.0992949	False	False
socket_to_socket_blackhole	-593.74KiB	-2.51	100.00%	23.12MiB	202.01KiB	4.12KiB	0.00853098	22.54MiB	173.27KiB	3.54KiB	0.00750549	False	False
http_text_to_http_json	-1016.81KiB	-2.58	100.00%	38.44MiB	854.68KiB	17.45KiB	0.0217107	37.44MiB	937.63KiB	19.14KiB	0.0244495	False	False

Signed-off-by: Stephen Wakely <[email protected]>

github-actions · 2022-09-09T15:21:19Z

Soak Test Results

Baseline: 3c8f8de
Comparison: c35e1bd
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_regex_logs2metric_ddmetrics	819.26KiB	6.78	100.00%	11.79MiB	1.03MiB	21.4KiB	0.0870299	12.59MiB	558.68KiB	11.4KiB	0.043314	False	False
syslog_log2metric_splunk_hec_metrics	412.8KiB	2.32	100.00%	17.36MiB	986.92KiB	20.12KiB	0.0554966	17.77MiB	851.87KiB	17.35KiB	0.0468155	False	False
datadog_agent_remap_blackhole_acks	741.58KiB	1.18	100.00%	61.22MiB	4.26MiB	88.61KiB	0.069501	61.95MiB	2.66MiB	55.66KiB	0.04293	False	False
datadog_agent_remap_blackhole	488.67KiB	0.79	100.00%	60.26MiB	4.01MiB	83.48KiB	0.0664987	60.74MiB	2.99MiB	62.44KiB	0.0492671	False	False
splunk_hec_route_s3	148.53KiB	0.78	97.30%	18.61MiB	2.35MiB	48.9KiB	0.126223	18.75MiB	2.2MiB	45.99KiB	0.117261	False	False
syslog_splunk_hec_logs	118.31KiB	0.7	100.00%	16.51MiB	677.21KiB	13.79KiB	0.0400396	16.63MiB	563.99KiB	11.51KiB	0.0331136	False	False
syslog_log2metric_humio_metrics	76.19KiB	0.6	100.00%	12.37MiB	240.98KiB	4.92KiB	0.0190178	12.45MiB	529.87KiB	10.78KiB	0.0415667	False	False
syslog_humio_logs	22.41KiB	0.15	53.86%	15.06MiB	1.07MiB	22.4KiB	0.0711339	15.08MiB	1005.39KiB	20.58KiB	0.0651008	False	False
splunk_hec_to_splunk_hec_logs_noack	23.6KiB	0.1	94.13%	23.82MiB	510.73KiB	10.42KiB	0.0209376	23.84MiB	336.21KiB	6.86KiB	0.0137698	False	False
splunk_hec_indexer_ack_blackhole	23.08KiB	0.09	61.20%	23.74MiB	968.14KiB	19.68KiB	0.0398251	23.76MiB	888.94KiB	18.09KiB	0.0365324	False	False
splunk_hec_to_splunk_hec_logs_acks	12.05KiB	0.05	37.67%	23.75MiB	881.54KiB	17.93KiB	0.0362443	23.76MiB	823.09KiB	16.75KiB	0.0338244	False	False
enterprise_http_to_http	-1.39KiB	-0.01	15.26%	23.85MiB	249.12KiB	5.09KiB	0.0101994	23.85MiB	251.66KiB	5.15KiB	0.0103043	False	False
http_pipelines_blackhole_acks	-532.18B	-0.04	15.24%	1.22MiB	103.39KiB	2.11KiB	0.0828166	1.22MiB	83.27KiB	1.7KiB	0.0667264	False	False
file_to_blackhole	-52.17KiB	-0.05	38.88%	95.34MiB	3.26MiB	67.51KiB	0.0341503	95.29MiB	3.72MiB	77.29KiB	0.0389918	False	False
http_to_http_json	-39.96KiB	-0.16	99.74%	23.84MiB	345.19KiB	7.05KiB	0.0141343	23.81MiB	549.18KiB	11.21KiB	0.0225241	False	False
fluent_elasticsearch	-297.56KiB	-0.37	99.99%	79.47MiB	52.41KiB	1.06KiB	0.000643909	79.18MiB	3.81MiB	78.28KiB	0.0480769	False	False
http_to_http_noack	-94.21KiB	-0.39	99.99%	23.84MiB	401.6KiB	8.21KiB	0.0164489	23.75MiB	1.09MiB	22.67KiB	0.0457714	False	False
http_pipelines_blackhole	-9.23KiB	-0.53	99.98%	1.7MiB	21.45KiB	449.23B	0.0123553	1.69MiB	119.62KiB	2.44KiB	0.0692636	False	False
http_to_http_acks	-141.54KiB	-0.79	45.95%	17.42MiB	7.56MiB	158.03KiB	0.433852	17.28MiB	8.09MiB	168.77KiB	0.46813	True	True
datadog_agent_remap_datadog_logs_acks	-599.62KiB	-0.95	100.00%	61.48MiB	3.09MiB	64.63KiB	0.0502783	60.9MiB	4.34MiB	90.35KiB	0.0712574	False	False
datadog_agent_remap_datadog_logs	-641.7KiB	-1.01	100.00%	61.75MiB	247.41KiB	5.06KiB	0.00391168	61.13MiB	3.99MiB	83.1KiB	0.0652572	False	False
http_pipelines_no_grok_blackhole	-114.13KiB	-1.04	100.00%	10.71MiB	88.95KiB	1.82KiB	0.00810842	10.6MiB	1.06MiB	21.97KiB	0.0995494	False	False
syslog_loki	-163.76KiB	-1.13	100.00%	14.11MiB	401.92KiB	8.23KiB	0.0278165	13.95MiB	759.11KiB	15.43KiB	0.0531402	False	False
http_text_to_http_json	-886.7KiB	-2.25	100.00%	38.51MiB	855.85KiB	17.47KiB	0.0216977	37.65MiB	798.94KiB	16.31KiB	0.0207206	False	False
socket_to_socket_blackhole	-582.14KiB	-2.49	100.00%	22.81MiB	366.75KiB	7.49KiB	0.0156955	22.25MiB	325.75KiB	6.65KiB	0.0142975	False	False

Signed-off-by: Stephen Wakely <[email protected]>

github-actions · 2022-09-13T12:34:37Z

Soak Test Results

Baseline: 5230fcd
Comparison: 12498de
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_text_to_http_json	1.54MiB	4.13	100.00%	37.43MiB	781.13KiB	15.94KiB	0.0203772	38.97MiB	812.2KiB	16.59KiB	0.0203481	False	False
syslog_loki	466.3KiB	3.17	100.00%	14.36MiB	406.91KiB	8.32KiB	0.0276699	14.81MiB	752.55KiB	15.3KiB	0.0496005	False	False
splunk_hec_route_s3	392.43KiB	2.09	100.00%	18.29MiB	2.3MiB	47.8KiB	0.125495	18.68MiB	2.22MiB	46.35KiB	0.118618	False	False
syslog_splunk_hec_logs	279.1KiB	1.67	100.00%	16.33MiB	764.96KiB	15.57KiB	0.0457503	16.6MiB	601.61KiB	12.26KiB	0.03539	False	False
datadog_agent_remap_blackhole	844.59KiB	1.39	100.00%	59.23MiB	4.02MiB	83.84KiB	0.0679037	60.05MiB	3.34MiB	69.64KiB	0.0555833	False	False
datadog_agent_remap_datadog_logs_acks	780.76KiB	1.28	100.00%	59.46MiB	2.92MiB	61.13KiB	0.0491346	60.22MiB	4.37MiB	90.9KiB	0.0724963	False	False
datadog_agent_remap_blackhole_acks	705.02KiB	1.14	100.00%	60.45MiB	4.1MiB	85.4KiB	0.0678312	61.14MiB	2.05MiB	42.97KiB	0.0335381	False	False
syslog_regex_logs2metric_ddmetrics	115.99KiB	0.92	100.00%	12.26MiB	569.43KiB	11.59KiB	0.0453511	12.37MiB	440.73KiB	8.99KiB	0.0347795	False	False
socket_to_socket_blackhole	203.33KiB	0.87	100.00%	22.71MiB	131.73KiB	2.69KiB	0.00566442	22.9MiB	145.93KiB	2.98KiB	0.0062208	False	False
datadog_agent_remap_datadog_logs	551.54KiB	0.87	100.00%	61.96MiB	202.11KiB	4.14KiB	0.00318484	62.5MiB	4.16MiB	86.61KiB	0.0665346	False	False
syslog_log2metric_splunk_hec_metrics	148.19KiB	0.82	100.00%	17.73MiB	491.41KiB	10.02KiB	0.0270572	17.88MiB	702.68KiB	14.31KiB	0.0383765	False	False
syslog_humio_logs	127.16KiB	0.76	100.00%	16.44MiB	233.75KiB	4.77KiB	0.0138821	16.56MiB	161.9KiB	3.31KiB	0.00954291	False	False
http_pipelines_blackhole_acks	1.92KiB	0.15	54.24%	1.23MiB	106.75KiB	2.17KiB	0.0847007	1.23MiB	68.67KiB	1.4KiB	0.0544018	False	False
splunk_hec_to_splunk_hec_logs_acks	20.98KiB	0.09	61.18%	23.74MiB	885.18KiB	18.0KiB	0.0363992	23.76MiB	802.9KiB	16.34KiB	0.0329874	False	False
splunk_hec_indexer_ack_blackhole	3.04KiB	0.01	9.60%	23.75MiB	877.11KiB	17.84KiB	0.0360606	23.75MiB	872.33KiB	17.74KiB	0.0358594	False	False
splunk_hec_to_splunk_hec_logs_noack	1.57KiB	0.01	12.79%	23.84MiB	335.39KiB	6.86KiB	0.013737	23.84MiB	338.35KiB	6.91KiB	0.0138572	False	False
enterprise_http_to_http	-1.07KiB	-0	11.97%	23.85MiB	243.89KiB	4.98KiB	0.00998563	23.85MiB	247.75KiB	5.07KiB	0.010144	False	False
file_to_blackhole	-90.15KiB	-0.09	71.88%	95.34MiB	2.61MiB	54.14KiB	0.0273867	95.26MiB	3.07MiB	63.78KiB	0.0322378	False	False
http_to_http_noack	-25.16KiB	-0.1	82.46%	23.83MiB	503.75KiB	10.3KiB	0.0206403	23.8MiB	757.61KiB	15.45KiB	0.0310738	False	False
http_to_http_json	-42.7KiB	-0.17	99.88%	23.85MiB	329.26KiB	6.72KiB	0.0134808	23.81MiB	554.69KiB	11.32KiB	0.0227499	False	False
http_to_http_acks	-29.79KiB	-0.17	10.14%	17.5MiB	8.19MiB	171.17KiB	0.467737	17.48MiB	7.62MiB	159.05KiB	0.43596	True	True
fluent_elasticsearch	-382.75KiB	-0.47	100.00%	79.47MiB	52.98KiB	1.07KiB	0.000650892	79.1MiB	4.12MiB	84.73KiB	0.0521237	False	False
http_pipelines_blackhole	-11.49KiB	-0.66	100.00%	1.7MiB	35.4KiB	741.31B	0.020381	1.68MiB	61.71KiB	1.26KiB	0.0357661	False	False
syslog_log2metric_humio_metrics	-166.05KiB	-1.27	100.00%	12.72MiB	493.76KiB	10.07KiB	0.0379045	12.56MiB	540.81KiB	11.02KiB	0.042053	False	False
http_pipelines_no_grok_blackhole	-200.05KiB	-1.9	100.00%	10.3MiB	188.99KiB	3.86KiB	0.0179066	10.11MiB	1.02MiB	21.16KiB	0.100521	False	False

src/internal_events/amqp.rs

Signed-off-by: Stephen Wakely <[email protected]>

github-actions · 2022-09-15T11:52:24Z

Soak Test Results

Baseline: bcbcb2e
Comparison: 56bd535
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_to_http_acks	201.39KiB	1.13	59.26%	17.35MiB	8.33MiB	174.16KiB	0.480113	17.55MiB	8.12MiB	169.52KiB	0.462664	True	True
datadog_agent_remap_blackhole	289.72KiB	0.46	99.68%	60.88MiB	4.0MiB	83.35KiB	0.0657187	61.16MiB	2.48MiB	51.77KiB	0.0405422	False	False
http_pipelines_blackhole_acks	5.33KiB	0.43	94.17%	1.21MiB	117.96KiB	2.4KiB	0.0948104	1.22MiB	72.19KiB	1.47KiB	0.057779	False	False
splunk_hec_route_s3	24.57KiB	0.14	28.22%	17.7MiB	2.31MiB	48.19KiB	0.13068	17.73MiB	2.29MiB	47.95KiB	0.129245	False	False
datadog_agent_remap_blackhole_acks	48.42KiB	0.08	33.79%	61.53MiB	4.27MiB	88.91KiB	0.0693924	61.58MiB	3.16MiB	66.07KiB	0.0513536	False	False
splunk_hec_indexer_ack_blackhole	5.32KiB	0.02	15.86%	23.75MiB	933.69KiB	18.99KiB	0.0383905	23.75MiB	914.89KiB	18.61KiB	0.037609	False	False
splunk_hec_to_splunk_hec_logs_noack	-913.92B	-0	7.35%	23.84MiB	334.16KiB	6.83KiB	0.0136862	23.84MiB	336.05KiB	6.86KiB	0.0137637	False	False
enterprise_http_to_http	874.51B	0	9.35%	23.85MiB	252.08KiB	5.15KiB	0.0103216	23.85MiB	251.11KiB	5.13KiB	0.0102814	False	False
splunk_hec_to_splunk_hec_logs_acks	-11.86KiB	-0.05	36.83%	23.75MiB	833.11KiB	16.95KiB	0.0342432	23.74MiB	885.79KiB	18.01KiB	0.0364266	False	False
fluent_elasticsearch	-64.1KiB	-0.08	100.00%	79.47MiB	52.87KiB	1.07KiB	0.000649509	79.41MiB	736.07KiB	14.81KiB	0.00905007	False	False
file_to_blackhole	-81.42KiB	-0.08	69.13%	95.38MiB	2.62MiB	54.37KiB	0.0275023	95.3MiB	2.82MiB	58.64KiB	0.0296118	False	False
http_to_http_json	-34.61KiB	-0.14	99.32%	23.84MiB	341.57KiB	6.97KiB	0.0139865	23.81MiB	524.67KiB	10.71KiB	0.0215148	False	False
syslog_regex_logs2metric_ddmetrics	-22.25KiB	-0.17	83.95%	12.63MiB	619.07KiB	12.61KiB	0.0478491	12.61MiB	471.28KiB	9.61KiB	0.0364888	False	False
syslog_loki	-38.07KiB	-0.26	98.82%	14.5MiB	165.96KiB	3.4KiB	0.0111745	14.46MiB	723.9KiB	14.72KiB	0.0488689	False	False
syslog_splunk_hec_logs	-48.11KiB	-0.28	99.21%	16.54MiB	737.35KiB	15.01KiB	0.0435297	16.49MiB	496.6KiB	10.13KiB	0.0294007	False	False
http_to_http_noack	-84.67KiB	-0.35	99.97%	23.84MiB	416.41KiB	8.51KiB	0.0170558	23.75MiB	1.03MiB	21.53KiB	0.0434435	False	False
datadog_agent_remap_datadog_logs_acks	-446.12KiB	-0.71	99.99%	61.59MiB	3.28MiB	68.52KiB	0.0532343	61.15MiB	4.36MiB	90.7KiB	0.0712376	False	False
http_pipelines_blackhole	-11.24KiB	-0.73	97.35%	1.5MiB	168.44KiB	3.44KiB	0.109989	1.48MiB	182.12KiB	3.71KiB	0.119802	False	False
syslog_humio_logs	-153.88KiB	-0.91	100.00%	16.57MiB	139.9KiB	2.86KiB	0.00824342	16.42MiB	150.37KiB	3.07KiB	0.00894115	False	False
http_text_to_http_json	-385.84KiB	-0.99	100.00%	38.14MiB	886.58KiB	18.1KiB	0.0226939	37.77MiB	877.97KiB	17.93KiB	0.0226978	False	False
syslog_log2metric_splunk_hec_metrics	-199.95KiB	-1.12	100.00%	17.49MiB	545.15KiB	11.11KiB	0.0304336	17.29MiB	780.51KiB	15.89KiB	0.0440646	False	False
datadog_agent_remap_datadog_logs	-739.51KiB	-1.19	100.00%	60.56MiB	327.42KiB	6.7KiB	0.00527825	59.84MiB	3.74MiB	77.87KiB	0.0624512	False	False
http_pipelines_no_grok_blackhole	-153.0KiB	-1.39	100.00%	10.76MiB	214.34KiB	4.38KiB	0.0194461	10.61MiB	1.07MiB	22.37KiB	0.101244	False	False
syslog_log2metric_humio_metrics	-265.68KiB	-2	100.00%	13.0MiB	303.09KiB	6.18KiB	0.0227629	12.74MiB	530.38KiB	10.8KiB	0.0406452	False	False
socket_to_socket_blackhole	-663.41KiB	-2.69	100.00%	24.11MiB	121.6KiB	2.48KiB	0.00492486	23.46MiB	213.6KiB	4.36KiB	0.00889003	False	False

src/sinks/amqp/tests.rs

src/sinks/amqp/mod.rs

Signed-off-by: Stephen Wakely <[email protected]>

github-actions · 2022-09-20T12:08:44Z

Soak Test Results

Baseline: a3de633
Comparison: 5f8c535
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
socket_to_socket_blackhole	255.24KiB	1.08	100.00%	23.08MiB	184.5KiB	3.77KiB	0.00780642	23.32MiB	198.19KiB	4.05KiB	0.00829631	False	False
http_pipelines_blackhole_acks	12.46KiB	1	100.00%	1.21MiB	120.34KiB	2.45KiB	0.097021	1.22MiB	89.19KiB	1.82KiB	0.0711962	False	False
http_to_http_acks	50.47KiB	0.29	16.86%	17.22MiB	8.06MiB	168.39KiB	0.467676	17.27MiB	7.99MiB	166.75KiB	0.462585	True	True
syslog_splunk_hec_logs	26.4KiB	0.16	76.01%	16.15MiB	924.34KiB	18.82KiB	0.0558741	16.18MiB	600.7KiB	12.25KiB	0.0362529	False	False
splunk_hec_to_splunk_hec_logs_noack	8.59KiB	0.04	58.71%	23.83MiB	383.81KiB	7.84KiB	0.0157248	23.84MiB	341.64KiB	6.97KiB	0.0139923	False	False
splunk_hec_indexer_ack_blackhole	5.48KiB	0.02	16.37%	23.74MiB	930.25KiB	18.92KiB	0.0382544	23.75MiB	912.98KiB	18.57KiB	0.0375358	False	False
syslog_humio_logs	1.92KiB	0.01	13.63%	16.4MiB	531.12KiB	10.84KiB	0.0316186	16.4MiB	137.71KiB	2.82KiB	0.00819728	False	False
enterprise_http_to_http	-2.76KiB	-0.01	29.44%	23.85MiB	249.45KiB	5.09KiB	0.0102133	23.84MiB	255.28KiB	5.22KiB	0.010453	False	False
file_to_blackhole	-46.39KiB	-0.05	33.49%	95.34MiB	3.41MiB	70.62KiB	0.0357236	95.29MiB	3.87MiB	80.58KiB	0.040613	False	False
splunk_hec_to_splunk_hec_logs_acks	-13.8KiB	-0.06	42.53%	23.76MiB	824.57KiB	16.78KiB	0.0338852	23.75MiB	884.39KiB	17.99KiB	0.036364	False	False
http_to_http_json	-28.84KiB	-0.12	97.91%	23.85MiB	349.85KiB	7.14KiB	0.0143249	23.82MiB	501.1KiB	10.24KiB	0.0205424	False	False
datadog_agent_remap_blackhole	-107.12KiB	-0.17	69.44%	60.19MiB	3.98MiB	82.83KiB	0.0660495	60.08MiB	3.06MiB	63.79KiB	0.050891	False	False
fluent_elasticsearch	-175.15KiB	-0.22	100.00%	79.47MiB	53.23KiB	1.08KiB	0.000653896	79.3MiB	1.56MiB	32.17KiB	0.0197086	False	False
datadog_agent_remap_blackhole_acks	-175.7KiB	-0.29	88.70%	60.11MiB	4.45MiB	92.68KiB	0.0740453	59.94MiB	2.91MiB	60.76KiB	0.0484815	False	False
http_to_http_noack	-96.59KiB	-0.4	100.00%	23.85MiB	254.12KiB	5.2KiB	0.010405	23.75MiB	1.07MiB	22.22KiB	0.0448403	False	False
http_text_to_http_json	-169.42KiB	-0.43	100.00%	38.32MiB	862.47KiB	17.61KiB	0.0219728	38.16MiB	870.76KiB	17.77KiB	0.0222801	False	False
http_pipelines_blackhole	-14.35KiB	-0.84	100.00%	1.66MiB	31.72KiB	663.62B	0.0186308	1.65MiB	127.24KiB	2.59KiB	0.0753831	False	False
splunk_hec_route_s3	-199.55KiB	-1.07	99.68%	18.29MiB	2.31MiB	48.16KiB	0.126413	18.09MiB	2.27MiB	47.44KiB	0.125324	False	False
datadog_agent_remap_datadog_logs_acks	-685.68KiB	-1.08	100.00%	62.08MiB	2.23MiB	46.76KiB	0.0359488	61.41MiB	4.25MiB	88.56KiB	0.0692479	False	False
syslog_log2metric_splunk_hec_metrics	-206.16KiB	-1.17	100.00%	17.27MiB	679.29KiB	13.85KiB	0.038406	17.07MiB	748.34KiB	15.25KiB	0.042809	False	False
datadog_agent_remap_datadog_logs	-739.53KiB	-1.17	100.00%	61.88MiB	560.59KiB	11.47KiB	0.00884551	61.16MiB	4.02MiB	83.72KiB	0.0657083	False	False
syslog_log2metric_humio_metrics	-185.22KiB	-1.4	100.00%	12.9MiB	353.48KiB	7.21KiB	0.0267631	12.71MiB	518.4KiB	10.56KiB	0.0398082	False	False
syslog_regex_logs2metric_ddmetrics	-192.31KiB	-1.51	100.00%	12.46MiB	547.36KiB	11.15KiB	0.0428984	12.27MiB	462.56KiB	9.43KiB	0.0368071	False	False
http_pipelines_no_grok_blackhole	-206.62KiB	-1.86	100.00%	10.87MiB	49.05KiB	1.0KiB	0.00440628	10.67MiB	1.03MiB	21.47KiB	0.0966192	False	False
syslog_loki	-499.23KiB	-3.38	100.00%	14.41MiB	518.08KiB	10.6KiB	0.0351138	13.92MiB	751.72KiB	15.28KiB	0.0527338	False	False

StephenWakely · 2022-09-20T12:34:59Z

@dbcfd We got there!! Thanks for the PR.

dbcfd requested review from a team, blt and prognant and removed request for a team April 14, 2021 17:05

dbcfd commented Apr 14, 2021

View reviewed changes

Cargo.toml Outdated Show resolved Hide resolved

dbcfd requested review from a team and jszwedko and removed request for a team April 14, 2021 17:51

jszwedko added this to the Vector 0.14 milestone Apr 14, 2021

dbcfd force-pushed the rabbitmq branch from 5cdbd5a to 81fe055 Compare April 19, 2021 18:03

jszwedko removed request for a team, blt and prognant April 22, 2021 17:58

jszwedko self-assigned this Apr 22, 2021

jszwedko reviewed Apr 30, 2021

View reviewed changes

dbcfd force-pushed the rabbitmq branch from af6b9a8 to 5ba0c65 Compare May 19, 2021 15:53

jszwedko modified the milestones: Vector 0.14.0, Vector 0.15.0 Jun 4, 2021

jszwedko changed the title ~~[WIP] Feat(Amqp): Initial Amqp (Rabbitmq) Source/Sink~~ feat(sources): New amqp (Rabbitmq) Source/Sink Jun 28, 2021

jszwedko reviewed Jun 29, 2021

View reviewed changes

dbcfd force-pushed the rabbitmq branch 2 times, most recently from 700a178 to 4c3c2ba Compare July 6, 2021 18:58

jszwedko removed this from the Vector 0.15.0 milestone Jul 9, 2021

neuronull reviewed Sep 8, 2022

View reviewed changes

src/internal_events/amqp.rs Outdated Show resolved Hide resolved

neuronull reviewed Sep 8, 2022

View reviewed changes

src/sources/amqp.rs Show resolved Hide resolved

StephenWakely added 4 commits September 8, 2022 17:05

Fix duplicate events CI error

925b1fc

Signed-off-by: Stephen Wakely <[email protected]>

Rename routing_key to routing_key_field

91b57bd

Signed-off-by: Stephen Wakely <[email protected]>

Fmt

1ec1fb7

Signed-off-by: Stephen Wakely <[email protected]>

Updated tests.

6df7f92

Signed-off-by: Stephen Wakely <[email protected]>

StephenWakely added 2 commits September 9, 2022 14:37

Cue fmt

fc45cac

Signed-off-by: Stephen Wakely <[email protected]>

Update routing_key name

c35e1bd

Signed-off-by: Stephen Wakely <[email protected]>

StephenWakely approved these changes Sep 13, 2022

View reviewed changes

StephenWakely added 3 commits September 13, 2022 10:31

Merge remote-tracking branch 'origin/master' into rabbitmq

a4e5241

Fix following merge.

b645a1f

Signed-off-by: Stephen Wakely <[email protected]>

Use write_all utility fn.

12498de

Signed-off-by: Stephen Wakely <[email protected]>

neuronull reviewed Sep 13, 2022

View reviewed changes

src/internal_events/amqp.rs Show resolved Hide resolved

Merge remote-tracking branch 'origin/master' into rabbitmq

56bd535

Signed-off-by: Stephen Wakely <[email protected]>

jszwedko requested review from neuronull and spencergilbert September 16, 2022 13:38

neuronull reviewed Sep 16, 2022

View reviewed changes

src/sinks/amqp/tests.rs Outdated Show resolved Hide resolved

spencergilbert approved these changes Sep 16, 2022

View reviewed changes

src/sinks/amqp/mod.rs Outdated Show resolved Hide resolved

StephenWakely added 2 commits September 20, 2022 11:28

Renamed tests.rs to integration_tests.rs

d4423af

Signed-off-by: Stephen Wakely <[email protected]>

Remove inventory submit

5f8c535

Signed-off-by: Stephen Wakely <[email protected]>

StephenWakely enabled auto-merge (squash) September 20, 2022 10:29

StephenWakely merged commit dec33dc into vectordotdev:master Sep 20, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(sources): New amqp (Rabbitmq) Source/Sink #7120

feat(sources): New amqp (Rabbitmq) Source/Sink #7120

dbcfd commented Apr 14, 2021 •

edited by jszwedko

Loading

dbcfd commented Apr 14, 2021 •

edited

Loading

dbcfd commented Apr 14, 2021

jszwedko commented Apr 14, 2021

jszwedko left a comment

jszwedko left a comment

dbcfd commented Jul 9, 2021

github-actions bot commented Sep 8, 2022

github-actions bot commented Sep 9, 2022

github-actions bot commented Sep 9, 2022

github-actions bot commented Sep 9, 2022

github-actions bot commented Sep 13, 2022

github-actions bot commented Sep 15, 2022

github-actions bot commented Sep 20, 2022

StephenWakely commented Sep 20, 2022

feat(sources): New amqp (Rabbitmq) Source/Sink #7120

feat(sources): New amqp (Rabbitmq) Source/Sink #7120

Conversation

dbcfd commented Apr 14, 2021 • edited by jszwedko Loading

dbcfd commented Apr 14, 2021 • edited Loading

dbcfd commented Apr 14, 2021

jszwedko commented Apr 14, 2021

jszwedko left a comment

Choose a reason for hiding this comment

jszwedko left a comment

Choose a reason for hiding this comment

dbcfd commented Jul 9, 2021

github-actions bot commented Sep 8, 2022

Soak Test Results

github-actions bot commented Sep 9, 2022

Soak Test Results

github-actions bot commented Sep 9, 2022

Soak Test Results

github-actions bot commented Sep 9, 2022

Soak Test Results

github-actions bot commented Sep 13, 2022

Soak Test Results

github-actions bot commented Sep 15, 2022

Soak Test Results

github-actions bot commented Sep 20, 2022

Soak Test Results

StephenWakely commented Sep 20, 2022

dbcfd commented Apr 14, 2021 •

edited by jszwedko

Loading

dbcfd commented Apr 14, 2021 •

edited

Loading