Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x-pack/filebeat/module/salesforce: Refactor a Salesforce module #37509

Merged
merged 210 commits into from
Apr 15, 2024
Merged

x-pack/filebeat/module/salesforce: Refactor a Salesforce module #37509

Show file tree
Hide file tree
Changes from 193 commits
Commits
Show all changes
210 commits
Select commit Hold shift + click to select a range
8d004f1
new salesforce input initial commit
kush-elastic Nov 27, 2023
dcfd937
Push partial changes
shmsr Nov 27, 2023
4e13300
add basic cursor implementation
kush-elastic Nov 28, 2023
27be2ba
update soql query option for cursor
kush-elastic Nov 29, 2023
3f4595d
convert event.original to json string
kush-elastic Nov 29, 2023
c206e2f
Fix a bug
shmsr Nov 29, 2023
45c216a
Fix a bug
shmsr Nov 29, 2023
6267574
fix event.original
kush-elastic Nov 30, 2023
0b0647f
Fix a bug and add draft features
shmsr Nov 30, 2023
abd13a5
Draft code
shmsr Nov 30, 2023
d9003ce
Fix template code
shmsr Nov 30, 2023
4c139f1
- Add support of Objects based data collection
kush-elastic Dec 7, 2023
b2ad1d0
Bump go.mod
shmsr Dec 7, 2023
ad2debd
Make linter happy
shmsr Dec 7, 2023
ad877d5
Deduplicate code and more
shmsr Dec 11, 2023
e6b28a9
Fix doc
shmsr Dec 11, 2023
7b3e81e
Merge branch 'main' into new_salesforce_input
shmsr Dec 11, 2023
2f7d4c3
Make linter happy
shmsr Dec 11, 2023
3ab553d
Fix NOTICE
shmsr Dec 11, 2023
e306fab
Add JWT auth
shmsr Dec 11, 2023
acbfc1f
nit
shmsr Dec 11, 2023
0524cf9
Full JWT impl
shmsr Dec 11, 2023
c0231c2
Merge branch 'main' into new_salesforce_input
shmsr Dec 11, 2023
f5b0f45
add getTableFromSOQL func
shmsr Dec 12, 2023
2fda369
fix bugs
shmsr Dec 12, 2023
f1acb09
input will now can collect data from both ways in single input config…
kush-elastic Dec 18, 2023
fa30fcb
Merge branch 'new_salesforce_input' of https://github.com/kush-elasti…
kush-elastic Dec 18, 2023
fb7b100
Merge branch 'new_salesforce_input' of https://github.com/kush-elasti…
kush-elastic Dec 18, 2023
a8f8397
Merge branch 'new_salesforce_input' of https://github.com/kush-elasti…
kush-elastic Dec 18, 2023
7599c9e
update code to make sure only one of the iteration can pull data at p…
kush-elastic Dec 18, 2023
d38d1e1
remove assertions
kush-elastic Dec 18, 2023
fc446e4
add UT
shmsr Dec 18, 2023
a4d1f71
improve code
shmsr Dec 18, 2023
5fcbe2d
add more ut and mock time
shmsr Dec 18, 2023
69071de
required changes and sample UT
kush-elastic Dec 19, 2023
11e8875
remove getObjectFromSOQL
kush-elastic Dec 19, 2023
52f20fe
fix bugs
shmsr Dec 19, 2023
891dd29
refactor
shmsr Dec 19, 2023
cd0b63c
refactor
shmsr Dec 19, 2023
fa00503
refactor
shmsr Dec 19, 2023
6309b01
- Fix cursor for object method
kush-elastic Dec 20, 2023
215d8ec
add first_event_time and last_event_time in cursor
kush-elastic Dec 20, 2023
fb375db
refactor
shmsr Dec 20, 2023
4c0494b
add ut and refactor
shmsr Dec 21, 2023
790a99e
refactor code and add cursor with first & last event time options
kush-elastic Dec 21, 2023
e75623d
Merge branch 'main' of https://github.com/kush-elastic/beats into new…
kush-elastic Dec 21, 2023
5a71560
add ut
shmsr Dec 21, 2023
d826140
add ut
shmsr Dec 21, 2023
77a629d
go mod tidy
shmsr Dec 21, 2023
8bc208e
update ut
shmsr Dec 21, 2023
de94320
update code
shmsr Dec 21, 2023
6f4e7a7
template funcs
shmsr Dec 21, 2023
4fbf2f5
fix imports
shmsr Dec 21, 2023
6276fb5
InputTest update fix and add new testcase
kush-elastic Dec 21, 2023
263574f
add ut
shmsr Dec 21, 2023
2e93da8
filebeat.yml changes to make mage check happy
shmsr Dec 21, 2023
48e1ccc
make ci green
shmsr Dec 21, 2023
a32146e
Apply suggestions from code review
shmsr Dec 21, 2023
31ab2af
document functions and methods
shmsr Dec 25, 2023
bfaaa72
gofumpt
shmsr Dec 25, 2023
c54014b
document functions and methods
shmsr Dec 25, 2023
8a26a7d
refactor
shmsr Dec 25, 2023
16d8c31
struct ordering for efficient alignment of fields
shmsr Dec 26, 2023
e19ee20
add and update unit tests
kush-elastic Dec 26, 2023
7646bf0
update usage of token url
kush-elastic Dec 26, 2023
001597c
struct ordering and goimports
shmsr Dec 26, 2023
ca6ba57
initial changes to salesforce module filesets
kush-elastic Dec 26, 2023
16fca01
fix linter issue
kush-elastic Dec 27, 2023
8ce4fa4
comments and changelog entry
kush-elastic Dec 27, 2023
4c068d3
update cursor comments
kush-elastic Dec 27, 2023
1f54a16
first draft of doc for salesforce input
shmsr Jan 2, 2024
941a52d
doc: add clarifications
shmsr Jan 2, 2024
9cf0e75
doc: update
shmsr Jan 3, 2024
8a342ca
Apply suggestions from code review
shmsr Jan 5, 2024
f129695
Apply suggestions from code review
shmsr Jan 5, 2024
f92918c
address review comments
shmsr Jan 5, 2024
568f57f
address review comments
shmsr Jan 5, 2024
58a53af
make linter happy
shmsr Jan 5, 2024
6837cfb
Merge branch 'main' into new_salesforce_input
shmsr Jan 5, 2024
3589e3e
update go.{mod,sum} to use forked lib
shmsr Jan 5, 2024
4188d70
make ci gren
shmsr Jan 5, 2024
a5d2c62
change done condition in queries call
kush-elastic Jan 9, 2024
f8490cf
change a way to form events size
kush-elastic Jan 9, 2024
6394901
Update x-pack/filebeat/docs/inputs/input-salesforce.asciidoc
kush-elastic Jan 9, 2024
3a67b0e
Address review comments and put some nil checks suggested by nilaway
shmsr Jan 15, 2024
f269247
make linter happy
shmsr Jan 15, 2024
e17de51
make linter happy
shmsr Jan 15, 2024
8a1cb03
Merge branch 'main' into new_salesforce_input
shmsr Jan 15, 2024
7761eae
add initial_interval
kush-elastic Jan 17, 2024
3f717d2
add log file interval
kush-elastic Jan 18, 2024
3d608ff
Address review comments
shmsr Jan 18, 2024
3dc0a0f
Merge branch 'main' into new_salesforce_input
shmsr Jan 18, 2024
f040429
add default config for version
kush-elastic Jan 18, 2024
f17c886
remove defaultConfig
kush-elastic Jan 18, 2024
6990877
update configurations
kush-elastic Jan 30, 2024
e047025
Update x-pack/filebeat/modules.d/salesforce.yml.disabled
kush-elastic Feb 1, 2024
51ccd7b
Update x-pack/filebeat/modules.d/salesforce.yml.disabled
kush-elastic Feb 1, 2024
bd1940e
Update x-pack/filebeat/modules.d/salesforce.yml.disabled
kush-elastic Feb 1, 2024
cbc09d8
remove extra comments from template file
kush-elastic Feb 1, 2024
add9197
resolve comments
kush-elastic Feb 1, 2024
6a457ff
Merge branch 'main' of http://github.com/elastic/beats into refactor_…
kush-elastic Feb 1, 2024
ab2f344
update documentation
kush-elastic Feb 1, 2024
b431987
add event.provider
kush-elastic Feb 5, 2024
85c9bfe
Merge branch 'new_salesforce_input' of https://github.com/kush-elasti…
kush-elastic Feb 5, 2024
41879de
Apex: update ingest pipeline
kush-elastic Feb 5, 2024
eb5e138
SetupAuditTrail: update ingest pipeline
kush-elastic Feb 5, 2024
2303896
Login: update ingest pipeline
kush-elastic Feb 5, 2024
ae075ac
Logout: update ingest pipeline
kush-elastic Feb 5, 2024
1fb9e86
Merge branch 'main' into new_salesforce_input
shmsr Feb 6, 2024
b53f8ea
fix go.mod
shmsr Feb 6, 2024
83ac3c6
Merge branch 'main' into new_salesforce_input
shmsr Feb 6, 2024
5f861a0
Merge branch 'main' into new_salesforce_input
shmsr Feb 7, 2024
94ebc0d
update codeowners file
shmsr Feb 7, 2024
a2dfbe4
Merge branch 'main' into new_salesforce_input
shmsr Feb 8, 2024
2ab9a85
Merge branch 'main' into new_salesforce_input
shmsr Feb 8, 2024
433d128
Address review comments
shmsr Feb 8, 2024
73a4b41
Merge branch 'main' into new_salesforce_input
shmsr Feb 8, 2024
4becdbb
Update x-pack/filebeat/input/salesforce/input.go
shmsr Feb 9, 2024
13471e1
update doc changes and tests
kush-elastic Mar 6, 2024
cf7719a
updated pipeline
kush-elastic Mar 11, 2024
b041b23
fix typo
kush-elastic Mar 11, 2024
7c2a973
update queries and way authentication config is taken
kush-elastic Mar 13, 2024
655b0f1
Add retry and timeout in HTTP client
shmsr Mar 14, 2024
1217ca3
Address merge conflict
shmsr Mar 14, 2024
dabdef8
Update NOTICE.txt
shmsr Mar 14, 2024
651cfa5
Merge branch 'main' into new_salesforce_input
shmsr Mar 14, 2024
f3c2ee1
Update README
shmsr Mar 14, 2024
e08925c
Address review comments
shmsr Mar 18, 2024
9c87e7e
Merge branch 'main' into new_salesforce_input
shmsr Mar 18, 2024
1515711
Fix bugs
shmsr Mar 19, 2024
6e0cfca
Update Multiple Pipelines and update all the dashboards
kush-elastic Mar 26, 2024
80f1156
Merge branch 'main' of https://github.com/kush-elastic/beats into ref…
kush-elastic Mar 26, 2024
1005ae2
changes with make udpate
kush-elastic Mar 26, 2024
1d9a0b7
update documents
kush-elastic Mar 26, 2024
2cdcbcb
Merge branch 'main' of https://github.com/kush-elastic/beats into new…
kush-elastic Mar 26, 2024
9f2c3c2
Merge branch 'main' into new_salesforce_input
shmsr Mar 26, 2024
57ef355
Merge branch 'main' into new_salesforce_input
shmsr Mar 27, 2024
ebbba2c
Merge branch 'main' into new_salesforce_input
shmsr Mar 27, 2024
818b634
Merge branch 'main' into new_salesforce_input
shmsr Mar 27, 2024
63202b3
Merge branch 'main' into refactor_salesforce_module
kush-elastic Mar 28, 2024
1f71e1b
Merge branch 'new_salesforce_input' of https://github.com/kush-elasti…
kush-elastic Mar 28, 2024
0f2fdb2
fix go.mod
kush-elastic Mar 28, 2024
1740c80
fix pipelines and field mappings with new dashboards
kush-elastic Apr 3, 2024
424673b
Fix and improve ingest pipelines
shmsr Apr 3, 2024
091a691
Fix and improve ingest pipelines
shmsr Apr 4, 2024
3ac4435
Improve doc
shmsr Apr 5, 2024
2b9b75f
Improve config file
shmsr Apr 5, 2024
1758371
Improve and fix bugs for APEX fileset
shmsr Apr 5, 2024
6400690
update setup audit trail pipeline
kush-elastic Apr 5, 2024
0adf7ca
update logout pipeline
kush-elastic Apr 5, 2024
0914960
Update dashboard, docs, etc.
shmsr Apr 5, 2024
60dac03
Mage update
shmsr Apr 5, 2024
f357106
Merge branch 'main' of https://github.com/kush-elastic/beats into ref…
kush-elastic Apr 8, 2024
2472c18
Maps are not able to stored as in Dashboard panelJSON, manually saved…
kush-elastic Apr 8, 2024
180d8c8
Fix docs
shmsr Apr 8, 2024
e2e631e
Update dashboard
shmsr Apr 8, 2024
06ea0d9
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 8, 2024
9fa8e89
Update x-pack/filebeat/module/salesforce/setupaudittrail/config/setup…
kush-elastic Apr 9, 2024
284d15e
Update docs
shmsr Apr 9, 2024
837a816
Fix NOTE blocks in docs
shmsr Apr 9, 2024
1b51611
Remove extra spaces
shmsr Apr 9, 2024
97c5e4a
Update NOTICE.txt
shmsr Apr 10, 2024
a189c1e
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 10, 2024
b3f776e
Add CHANGELOG entry
shmsr Apr 10, 2024
416cc0a
Update doc
shmsr Apr 10, 2024
f520008
format configs and update dashboard IDs
kush-elastic Apr 10, 2024
6ec275f
Make checks happy
shmsr Apr 10, 2024
b8d10bd
Update ingest pipelines to add ignore_failure
shmsr Apr 10, 2024
12aef68
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 10, 2024
dc412c6
Improve sample config
shmsr Apr 10, 2024
f3bfa96
Upgrade to ecs 8.11.0
shmsr Apr 10, 2024
dc2bf54
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 10, 2024
76987a8
fix logout geoip processor
kush-elastic Apr 10, 2024
a7ad650
add ignore_failure to possible failures processors
kush-elastic Apr 10, 2024
5aeacfa
fix pipelines and formatting
kush-elastic Apr 11, 2024
a2f013d
add new Dashboard Apex
kush-elastic Apr 11, 2024
7636682
update salesforce.yml.disabled
kush-elastic Apr 11, 2024
ea07de3
remove extra panel
kush-elastic Apr 11, 2024
ead58a6
Use templated snippet for set
shmsr Apr 11, 2024
91947a4
Update x-pack/filebeat/module/salesforce/logout/config/logout.yml
shmsr Apr 11, 2024
58a0ddc
Update x-pack/filebeat/module/salesforce/login/config/login.yml
shmsr Apr 11, 2024
516146d
Update x-pack/filebeat/module/salesforce/apex/config/apex.yml
shmsr Apr 11, 2024
7c0187a
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 11, 2024
1446798
Add Login dashboard
kush-elastic Apr 11, 2024
ded973c
Improve doc
shmsr Apr 11, 2024
cf48f52
Address review comment
shmsr Apr 12, 2024
7229c8a
save maps in library
kush-elastic Apr 12, 2024
a85b5c4
Add Logout dashboard
kush-elastic Apr 12, 2024
e5929b9
Add Setup Audit Trail Dashboard
kush-elastic Apr 12, 2024
dc07793
Improve doc
shmsr Apr 12, 2024
1d0ebf3
Improve doc
shmsr Apr 12, 2024
a5b8b13
fix pipeline tests and remove finger print
kush-elastic Apr 12, 2024
a4151cf
Add Dashboard level dataset filter and remove from viz level
kush-elastic Apr 12, 2024
d0ece70
Fix ingest pipeline, fields and tests
shmsr Apr 13, 2024
d5951e5
Fix logout fileset
shmsr Apr 13, 2024
a32205e
Fix docs
shmsr Apr 13, 2024
596d493
Fix asset hash
shmsr Apr 13, 2024
c0c984e
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 13, 2024
5aa63f2
fix pipeline integration tests
kush-elastic Apr 13, 2024
bc4c139
fix EventLogFile cursor in salesforce input
kush-elastic Apr 13, 2024
bf03514
Merge branch 'main' into refactor_salesforce_module
kush-elastic Apr 13, 2024
f83f193
update dashboards screen shots
kush-elastic Apr 14, 2024
265a84d
add dashboard Screen shots
kush-elastic Apr 14, 2024
df0bfad
Update doc
shmsr Apr 14, 2024
bd396c0
Update input and module doc
shmsr Apr 15, 2024
376b92d
fix setup audit trail extra field issue
kush-elastic Apr 15, 2024
41ae526
Merge branch 'main' into refactor_salesforce_module
shmsr Apr 15, 2024
a20a033
update timestamp format for objects
kush-elastic Apr 15, 2024
bd914e6
Merge branch 'main' into refactor_salesforce_module
kush-elastic Apr 15, 2024
015af02
update Maps for login and logout dashboards
kush-elastic Apr 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.next.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ https://github.com/elastic/beats/compare/v8.8.1\...main[Check the HEAD diff]

- Convert netflow input to API v2 and disable event normalisation {pull}37901[37901]
- Introduce input/netmetrics and refactor netflow input metrics {pull}38055[38055]
- Update Salesforce module to use new Salesforce input. {pull}37509[37509]


*Heartbeat*
Expand Down
Loading
Loading