Skip to content

[Buildkite] Update settings for integrations pipeline #8758

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
mrodm merged 1 commit into from
Dec 20, 2023
Merged

[Buildkite] Update settings for integrations pipeline #8758

mrodm merged 1 commit into from
Dec 20, 2023

Conversation

@mrodm
Copy link
Collaborator

@mrodm mrodm commented Dec 19, 2023

Proposed commit message

Update settings to avoid canceling the builds in backport branches as it happens with main branch.
@mrodm mrodm requested a review from sharbuz December 19, 2023 16:32
@mrodm mrodm self-assigned this Dec 19, 2023
@mrodm mrodm requested a review from a team as a code owner December 19, 2023 16:32
@elasticmachine
Copy link

elasticmachine commented Dec 19, 2023

🚀 Benchmarks report

Package 1password 👍(0) 💚(2) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
item_usages 6944.44 5076.14 -1868.3 (-26.9%) 💔

Package apache_tomcat 👍(5) 💚(2) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
localhost 24390.24 20000 -4390.24 (-18%) 💔
session 14492.75 10309.28 -4183.47 (-28.87%) 💔

Package atlassian_bitbucket 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 4807.69 2985.07 -1822.62 (-37.91%) 💔

Package auth0 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
logs 4347.83 3521.13 -826.7 (-19.01%) 💔

Package azure 👍(6) 💚(1) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
application_gateway 2049.18 1340.48 -708.7 (-34.58%) 💔
firewall_logs 1721.17 1404.49 -316.68 (-18.4%) 💔
signinlogs 2123.14 1760.56 -362.58 (-17.08%) 💔

Package azure_metrics 👍(0) 💚(2) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
compute_vm_scaleset 250000 166666.67 -83333.33 (-33.33%) 💔
container_service 200000 166666.67 -33333.33 (-16.67%) 💔

Package bitwarden 👍(3) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
group 27027.03 21276.6 -5750.43 (-21.28%) 💔

Package bluecoat 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
director 35714.29 24390.24 -11324.05 (-31.71%) 💔

Package box_events 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
events 3787.88 2832.86 -955.02 (-25.21%) 💔

Package carbon_black_cloud 👍(2) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
asset_vulnerability_summary 8403.36 6944.44 -1458.92 (-17.36%) 💔
audit 19230.77 13333.33 -5897.44 (-30.67%) 💔

Package cisco_duo 👍(2) 💚(2) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
offline_enrollment 27027.03 20000 -7027.03 (-26%) 💔

Package cisco_meraki 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
events 10101.01 6896.55 -3204.46 (-31.72%) 💔

Package citrix_adc 👍(2) 💚(0) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
interface 3460.21 2724.8 -735.41 (-21.25%) 💔
service 10869.57 8264.46 -2605.11 (-23.97%) 💔
system 5617.98 4405.29 -1212.69 (-21.59%) 💔

Package citrix_waf 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 1447.18 1026.69 -420.49 (-29.06%) 💔

Package cloudflare_logpush 👍(10) 💚(6) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
workers_trace 7518.8 5555.56 -1963.24 (-26.11%) 💔
device_posture 6849.32 4672.9 -2176.42 (-31.78%) 💔

Package cyberark_pta 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
events 8196.72 5494.51 -2702.21 (-32.97%) 💔

Package cylance 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
protect 18518.52 14705.88 -3812.64 (-20.59%) 💔

Package elastic_package_registry 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
metrics 7246.38 4672.9 -2573.48 (-35.51%) 💔

Package f5 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
bigipafm 29411.76 14492.75 -14919.01 (-50.72%) 💔

Package forgerock 👍(4) 💚(4) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
am_access 9433.96 5952.38 -3481.58 (-36.9%) 💔
am_config 24390.24 16393.44 -7996.8 (-32.79%) 💔
idm_access 15151.52 11764.71 -3386.81 (-22.35%) 💔

Package gcp 👍(2) 💚(3) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
dns 2457 2070.39 -386.61 (-15.74%) 💔

Package github 👍(4) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
code_scanning 4366.81 2557.54 -1809.27 (-41.43%) 💔

Package google_workspace 👍(3) 💚(10) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
gcp 5076.14 3846.15 -1229.99 (-24.23%) 💔

Package hid_bravura_monitor 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
winlog 8928.57 6711.41 -2217.16 (-24.83%) 💔

Package ibmmq 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
qmgr 2824.86 1915.71 -909.15 (-32.18%) 💔

Package infoblox_bloxone_ddi 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
dns_config 1270.65 1038.42 -232.23 (-18.28%) 💔

Package iptables 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 11494.25 8695.65 -2798.6 (-24.35%) 💔

Package juniper_netscreen 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 100000 55555.56 -44444.44 (-44.44%) 💔

Package kibana 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 10869.57 8196.72 -2672.85 (-24.59%) 💔

Package logstash 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
slowlog 5319.15 3436.43 -1882.72 (-35.4%) 💔

Package lyve_cloud 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 865.8 647.25 -218.55 (-25.24%) 💔

Package microsoft_sqlserver 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 12500 10416.67 -2083.33 (-16.67%) 💔

Package mimecast 👍(4) 💚(3) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
ttp_ip_logs 18181.82 14925.37 -3256.45 (-17.91%) 💔
ttp_url_logs 18867.92 10752.69 -8115.23 (-43.01%) 💔

Package mysql 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
error 18867.92 15873.02 -2994.9 (-15.87%) 💔
slowlog 30303.03 25000 -5303.03 (-17.5%) 💔

Package nagios_xi 👍(1) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
host 3412.97 2717.39 -695.58 (-20.38%) 💔

Package network_traffic 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
memcached 762.78 536.19 -226.59 (-29.71%) 💔

Package nginx 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 3311.26 1811.59 -1499.67 (-45.29%) 💔

Package nginx_ingress_controller 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
error 15151.52 11904.76 -3246.76 (-21.43%) 💔

Package oracle_weblogic 👍(1) 💚(0) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 10204.08 8474.58 -1729.5 (-16.95%) 💔
admin_server 15151.52 12500 -2651.52 (-17.5%) 💔
domain 14492.75 8928.57 -5564.18 (-38.39%) 💔

Package panw_cortex_xdr 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
incidents 6493.51 5208.33 -1285.18 (-19.79%) 💔

Package php_fpm 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
pool 6802.72 5347.59 -1455.13 (-21.39%) 💔
process 6289.31 5181.35 -1107.96 (-17.62%) 💔

Package platform_observability 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
kibana_log 14705.88 12195.12 -2510.76 (-17.07%) 💔

Package proofpoint_tap 👍(3) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
clicks_permitted 10416.67 6944.44 -3472.23 (-33.33%) 💔

Package snyk 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
vulnerabilities 2415.46 1988.07 -427.39 (-17.69%) 💔

Package spring_boot 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
gc 11494.25 8333.33 -3160.92 (-27.5%) 💔

Package symantec_endpoint 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 414.08 316.26 -97.82 (-23.62%) 💔

Package tanium 👍(4) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
endpoint_config 12500 10416.67 -2083.33 (-16.67%) 💔

Package tenable_io 👍(1) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
asset 1663.89 960.61 -703.28 (-42.27%) 💔
plugin 2695.42 2114.16 -581.26 (-21.56%) 💔

Package tenable_sc 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
vulnerability 1934.24 1600 -334.24 (-17.28%) 💔

Package thycotic_ss 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
logs 1904.76 1371.74 -533.02 (-27.98%) 💔

Package ti_misp 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
threat 1594.9 1322.75 -272.15 (-17.06%) 💔
threat_attributes 3831.42 2747.25 -1084.17 (-28.3%) 💔

Package ti_otx 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
pulses_subscribed 3717.47 2906.98 -810.49 (-21.8%) 💔

Package ti_rapid7_threat_command 👍(0) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
ioc 2487.56 2024.29 -463.27 (-18.62%) 💔
vulnerability 5154.64 3278.69 -1875.95 (-36.39%) 💔

Package ti_recordedfuture 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
threat 2873.56 2242.15 -631.41 (-21.97%) 💔

Package trellix_epo_cloud 👍(1) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
group 23809.52 14705.88 -9103.64 (-38.24%) 💔

Package trend_micro_vision_one 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 4975.12 4149.38 -825.74 (-16.6%) 💔

Package vsphere 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 4000 3322.26 -677.74 (-16.94%) 💔

Package websphere_application_server 👍(1) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
servlet 33333.33 25641.03 -7692.3 (-23.08%) 💔
session_manager 16949.15 11111.11 -5838.04 (-34.44%) 💔

Package windows 👍(2) 💚(2) 💔(4)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
applocker_msi_and_script 10752.69 6711.41 -4041.28 (-37.58%) 💔
applocker_packaged_app_deployment 18867.92 10309.28 -8558.64 (-45.36%) 💔
applocker_packaged_app_execution 22727.27 12345.68 -10381.59 (-45.68%) 💔
sysmon_operational 2801.12 1960.78 -840.34 (-30%) 💔

Package wiz 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 2358.49 1949.32 -409.17 (-17.35%) 💔

Package zeek 👍(26) 💚(7) 💔(10)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
mysql 24390.24 18181.82 -6208.42 (-25.45%) 💔
capture_loss 27777.78 14705.88 -13071.9 (-47.06%) 💔
ocsp 33333.33 27027.03 -6306.3 (-18.92%) 💔
socks 28571.43 20833.33 -7738.1 (-27.08%) 💔
ssh 37037.04 27777.78 -9259.26 (-25%) 💔
syslog 52631.58 32258.06 -20373.52 (-38.71%) 💔
dce_rpc 18867.92 12195.12 -6672.8 (-35.37%) 💔
dnp3 25641.03 20000 -5641.03 (-22%) 💔
dpd 17241.38 8130.08 -9111.3 (-52.85%) 💔
files 38461.54 22727.27 -15734.27 (-40.91%) 💔

Package zscaler_zia 👍(3) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
firewall 2347.42 1976.28 -371.14 (-15.81%) 💔

To see the full report comment with /test benchmark fullreport
@elasticmachine
Copy link

elasticmachine commented Dec 19, 2023

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-12-19T16:32:24.897+0000

  • Duration: 271 min 56 sec

Test stats 🧪

Test Results
Failed 0
Passed 4857
Skipped 9
Total 4866

Steps errors 13

Expand to view the steps failures

Show only the first 10 steps failures

Checks if running on a Unix-like node
  • Took 0 min 0 sec . View more details here
  • Description: Unable to create live FilePath for fleet-ci-immutable-ubuntu-2004-1703013818530219748
Shell Script
  • Took 1 min 6 sec . View more details here
  • Description: gvm 1.21.1
Boot up the Elastic stack
  • Took 2 min 5 sec . View more details here
  • Description: ../../build/elastic-package stack up -d -v --version 8.10.1
Google Storage Download
  • Took 0 min 11 sec . View more details here
  • Description: [2023-12-19T17:06:10.818Z] fleet-ci-immutable-ubuntu-2004-1703004764431906359 was marked offline: No
Checks if running on a Unix-like node
  • Took 1 min 55 sec . View more details here
Cleanup
  • Took 1 min 20 sec . View more details here
  • Description: rm source.tgz
Boot up the Elastic stack
  • Took 2 min 0 sec . View more details here
  • Description: ../../build/elastic-package stack up -d -v --version 8.10.1
elastic-package report benchmark
  • Took 0 min 0 sec . View more details here
  • Description: elastic-package report benchmark --fail-on-missing=false --new="build/benchmark-results" --old="build/main/benchmark-results" --threshold=15 --report-output-path="report.md" --full=false
Error signal
  • Took 0 min 13 sec . View more details here
  • Description: untar: step failed with error Required context class hudson.Launcher is missingPerhaps you forgot to surround the code with a step that provides this, such as: node
Recursively delete the current directory from the workspace
  • Took 0 min 0 sec . View more details here
  • Description: [2023-12-19T17:03:29.755Z] fleet-ci-immutable-ubuntu-2004-1703004827830591794 was marked offline: No

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.
@elasticmachine
Copy link

elasticmachine commented Dec 19, 2023

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (449/449) 💚
Files 96.091% (762/793) 👎 -3.909
Classes 96.091% (762/793) 👎 -3.909
Methods 92.237% (7474/8103) 👍 67.237
Lines 88.552% (176222/199004) 👎 -11.448
Conditionals 100.0% (0/0) 💚
@mrodm mrodm merged commit 9937545 into elastic:main Dec 20, 2023
@mrodm mrodm deleted the update_integrations_settings_catalog_info branch December 20, 2023 08:55
v1v added a commit that referenced this pull request Dec 21, 2023
@v1v
Merge remote-tracking branch 'upstream/main' into v1v-patch-1
3e599b5 
* upstream/main: (117 commits) [TI MISP] Add IOC expiration support (#8639) Add CSPM Rules 6.2, 6.3 and 6.4 (#8778) [Infoblox NIOS] Update timestamp parsing logic (#8767) [Rapid7 InsightVM] Split vulnerability categories into array (#8768) [Exchange Online Message Trace] Add Additional Look-back Time & Fix Cursor Value (#8717) [Buildkite] Update bucket settings (#8765) Remove Jenkins .ci folder (#8766) First part of removal of Jenkins jobs (#8763) misp: parse URIs for URI type threats (#8760) [amazon_security_lake] Added support for all the OCSF Classes (#8579) [Buildkite] Update settings for integrations pipeline (#8758) [TI ThreatQ] Add IOC expiration support (#8691) [ti_opencti] Support OpenCTI 5.12 by removing filters parameter (#8744) [Cribl] Updating setup guidance for Cribl field (#8746) crowdstrike: add userinfo enrichment support and map fields to ECS (#8742) [etcd] Enable TSDB for metrics datastream (#8649) Bump golang.org/x/crypto from 0.16.0 to 0.17.0 (#8749) auditd: relax field_split pattern and handle AVC header (#8748) Update cloud packages codeowner (#8672) [O11Y] [AWS Billing] Convert "Total Estimated Charges" visualization to new metric (#8509) ...
qcorporation pushed a commit that referenced this pull request Feb 3, 2025
@v1v
Merge remote-tracking branch 'upstream/main' into v1v-patch-1
7a91099 
* upstream/main: (117 commits) [TI MISP] Add IOC expiration support (#8639) Add CSPM Rules 6.2, 6.3 and 6.4 (#8778) [Infoblox NIOS] Update timestamp parsing logic (#8767) [Rapid7 InsightVM] Split vulnerability categories into array (#8768) [Exchange Online Message Trace] Add Additional Look-back Time & Fix Cursor Value (#8717) [Buildkite] Update bucket settings (#8765) Remove Jenkins .ci folder (#8766) First part of removal of Jenkins jobs (#8763) misp: parse URIs for URI type threats (#8760) [amazon_security_lake] Added support for all the OCSF Classes (#8579) [Buildkite] Update settings for integrations pipeline (#8758) [TI ThreatQ] Add IOC expiration support (#8691) [ti_opencti] Support OpenCTI 5.12 by removing filters parameter (#8744) [Cribl] Updating setup guidance for Cribl field (#8746) crowdstrike: add userinfo enrichment support and map fields to ECS (#8742) [etcd] Enable TSDB for metrics datastream (#8649) Bump golang.org/x/crypto from 0.16.0 to 0.17.0 (#8749) auditd: relax field_split pattern and handle AVC header (#8748) Update cloud packages codeowner (#8672) [O11Y] [AWS Billing] Convert "Total Estimated Charges" visualization to new metric (#8509) ...
qcorporation pushed a commit that referenced this pull request Feb 4, 2025
@v1v
Merge remote-tracking branch 'upstream/main' into v1v-patch-1
2b2dec7 
* upstream/main: (117 commits) [TI MISP] Add IOC expiration support (#8639) Add CSPM Rules 6.2, 6.3 and 6.4 (#8778) [Infoblox NIOS] Update timestamp parsing logic (#8767) [Rapid7 InsightVM] Split vulnerability categories into array (#8768) [Exchange Online Message Trace] Add Additional Look-back Time & Fix Cursor Value (#8717) [Buildkite] Update bucket settings (#8765) Remove Jenkins .ci folder (#8766) First part of removal of Jenkins jobs (#8763) misp: parse URIs for URI type threats (#8760) [amazon_security_lake] Added support for all the OCSF Classes (#8579) [Buildkite] Update settings for integrations pipeline (#8758) [TI ThreatQ] Add IOC expiration support (#8691) [ti_opencti] Support OpenCTI 5.12 by removing filters parameter (#8744) [Cribl] Updating setup guidance for Cribl field (#8746) crowdstrike: add userinfo enrichment support and map fields to ECS (#8742) [etcd] Enable TSDB for metrics datastream (#8649) Bump golang.org/x/crypto from 0.16.0 to 0.17.0 (#8749) auditd: relax field_split pattern and handle AVC header (#8748) Update cloud packages codeowner (#8672) [O11Y] [AWS Billing] Convert "Total Estimated Charges" visualization to new metric (#8509) ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

4 participants

@mrodm @elasticmachine @jsoriano @sharbuz