You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 03:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Aug 24, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102309910531049,2cyclictest9763-21kworker/1:1+events22:52:531
102379910521050,2cyclictest8484-21kworker/3:0+events21:33:423
102379910521050,2cyclictest8484-21kworker/3:0+events21:29:123
102379910521050,2cyclictest19854-21kworker/3:2+events23:04:033
102309910521049,2cyclictest9763-21kworker/1:1+events23:30:221
102309910521049,2cyclictest17345-21kworker/1:2+events23:35:441
102379910511049,2cyclictest6694-21kworker/3:1+events21:11:063
102379910511049,2cyclictest29852-21kworker/3:2+events21:21:173
102309910511048,2cyclictest9763-21kworker/1:1+events19:10:221
102309910511048,2cyclictest17345-21kworker/1:2+events23:43:071
102379910501048,2cyclictest27744-21kworker/3:0+events00:07:363
102269910501047,3cyclictest1909-21turbostat22:54:550
102379910491047,2cyclictest30536-21kworker/3:2+events20:24:403
102379910491047,2cyclictest26425-21kworker/3:1+events19:53:133
102379910491047,2cyclictest19854-21kworker/3:2+events23:10:423
102379910491047,2cyclictest12719-21kworker/3:1+events23:06:483
102379910491047,2cyclictest12719-21kworker/3:1+events00:03:173
102379910481045,3cyclictest12719-21kworker/3:1+events23:48:073
102309910481046,2cyclictest9763-21kworker/1:1+events23:26:521
102379910471045,2cyclictest19854-21kworker/3:2+events22:56:523
102269910471046,1cyclictest5541-21kworker/0:1+events21:36:160
102379910461044,2cyclictest24375-21kworker/3:0+events20:02:363
102379910451044,1cyclictest6694-21kworker/3:1+events21:03:003
102379910451043,2cyclictest30536-21kworker/3:2+events20:59:123
102269910411039,2cyclictest18574-21turbostat20:54:550
102379910381036,2cyclictest19854-21kworker/3:2+events22:07:033
102269910281026,2cyclictest32311-21kworker/0:2+events23:54:120
102269910281025,3cyclictest5173-21turbostat23:59:540
102269910261024,2cyclictest26637-21turbostat21:14:550
102269910251024,1cyclictest6257-21kworker/0:1+events00:33:060
102269910221021,1cyclictest26342-21kworker/0:0+events00:17:430
102379910211019,2cyclictest4003-21turbostat00:29:543
102269910191015,4cyclictest20240-21turbostat19:39:550
102379910101009,1cyclictest19854-21kworker/3:2+events23:15:233
102379910091006,3cyclictest10117-21turbostat19:14:553
102379910061004,2cyclictest30536-21kworker/3:2+events20:36:073
10226991001998,3cyclictest12510-21turbostat20:39:550
1023799995993,2cyclictest26361-21kworker/3:0+events21:06:503
1023799991990,1cyclictest30536-21kworker/3:2+events20:27:423
1022699991990,1cyclictest26342-21kworker/0:0+events00:21:160
1023299990989,1cyclictest14745-21kworker/2:0+events00:39:262
1023299989988,1cyclictest19392-21kworker/2:2+events22:43:272
1022699987986,1cyclictest5541-21kworker/0:1+events21:44:020
1022699983982,1cyclictest6257-21kworker/0:1+events00:29:180
1022699983982,1cyclictest30281-21kworker/0:2+events22:49:360
1022699982981,1cyclictest5541-21kworker/0:1+events19:15:210
1022699982981,1cyclictest29469-21kworker/0:0+events23:22:330
1022699981980,1cyclictest5541-21kworker/0:1+events19:21:270
1023299978976,2cyclictest13305-21kworker/2:0+events22:31:492
1023299977975,2cyclictest6090-21kworker/2:0+events21:52:332
1023299976975,1cyclictest31461-21kworker/2:2+events22:20:522
1023299971970,1cyclictest22661-21kworker/2:1+events20:16:502
1023299970969,1cyclictest22661-21kworker/2:1+events20:13:402
1022699969969,0cyclictest5541-21kworker/0:1+events19:27:260
1022699968966,2cyclictest7104-21turbostat22:59:550
1023299966965,1cyclictest31461-21kworker/2:2+events22:01:042
1023299965964,1cyclictest6090-21kworker/2:0+events21:59:482
1023299965964,1cyclictest31461-21kworker/2:2+events21:46:572
1023299965964,1cyclictest18033-21kworker/2:1+events22:29:552
1023299964964,0cyclictest19392-21kworker/2:2+events22:36:482
1023299961960,1cyclictest31461-21kworker/2:2+events22:19:232
1023799960958,2cyclictest29120-21turbostat22:49:553
1023799960958,2cyclictest20798-21turbostat00:14:543
1023099956953,3cyclictest19932-21turbostat22:09:551
1023299955954,1cyclictest22661-21kworker/2:1+events20:06:042
1023299953952,1cyclictest31461-21kworker/2:2+events22:12:542
1023799950949,1cyclictest6694-21kworker/3:1+events20:41:493
1022699949947,2cyclictest14736-21turbostat22:04:550
1022699943941,2cyclictest14537-21turbostat20:44:550
1023799941937,4cyclictest1145-21turbostat23:24:553
1023799933931,2cyclictest32371-21turbostat23:54:543
1022699933931,2cyclictest21990-21turbostat23:44:560
1023799928927,1cyclictest18206-21kworker/3:2+events19:30:443
1022699922918,4cyclictest16558-21turbostat20:49:550
1023799919916,3cyclictest9195-21turbostat00:34:543
1023799915913,2cyclictest6694-21kworker/3:1+events21:18:193
1022699910907,3cyclictest6437-21turbostat20:24:550
1022699907905,2cyclictest4429-21turbostat20:19:550
1023799902901,1cyclictest18206-21kworker/3:2+events19:39:203
1023799897896,1cyclictest6694-21kworker/3:1+events20:31:493
1023799896895,1cyclictest6694-21kworker/3:1+events20:53:483
1023799894893,1cyclictest24375-21kworker/3:0+events19:57:323
1023299894892,2cyclictest28335-21turbostat23:19:552
1023299894892,2cyclictest16214-21turbostat19:29:552
1023799893893,0cyclictest30536-21kworker/3:2+events20:45:213
1023799892891,1cyclictest18206-21kworker/3:2+events19:44:223
1023799887886,1cyclictest26425-21kworker/3:1+events19:47:333
1023799866864,2cyclictest25466-21turbostat21:44:553
1022699864863,1cyclictest26731-21turbostat19:54:550
1022699856853,3cyclictest20585-21turbostat20:59:550
1023799853851,2cyclictest23906-21turbostat22:44:553
1022699692688,4cyclictest23906-21turbostat22:44:550
1023299689688,1cyclictest25466-21turbostat21:44:552
1023099688686,2cyclictest29120-21turbostat22:49:561
1022699679676,3cyclictest27207-21turbostat23:49:550
1022699644643,1cyclictest10117-21turbostat19:14:550
1022699625624,1cyclictest15089-21turbostat21:34:550
1023799622620,2cyclictest14736-21turbostat22:04:553
1023799606604,2cyclictest21990-21turbostat23:44:553
1023299606605,1cyclictest19932-21turbostat22:09:552
1023799580578,2cyclictest4429-21turbostat20:19:553
1023799579576,3cyclictest16214-21turbostat19:29:553
1023299546544,2cyclictest30772-21turbostat20:04:552
1023299545541,4cyclictest9195-21turbostat00:34:542
1023799521520,1cyclictest1909-21turbostat22:54:553
1023799500498,2cyclictest5173-21turbostat23:59:553
1023099465464,1cyclictest1145-21turbostat23:24:561
1022699460458,2cyclictest28335-21turbostat23:19:550
1022699424421,3cyclictest20798-21turbostat00:14:540
10237992019,1cyclictest67750irq/123-lan21:48:443
10237992019,1cyclictest67750irq/123-lan21:36:523
10237991918,1cyclictest67750irq/123-lan00:15:163
10237991818,0cyclictest67750irq/123-lan22:14:593
10237991817,1cyclictest67750irq/123-lan22:15:163
10237991817,1cyclictest67750irq/123-lan00:35:163
10237991717,0cyclictest67750irq/123-lan23:30:393
10237991716,1cyclictest67750irq/123-lan22:35:183
10237991716,1cyclictest67750irq/123-lan22:25:043
10237991716,1cyclictest67750irq/123-lan21:50:193
10237991716,1cyclictest67750irq/123-lan20:10:113
10237991716,1cyclictest67750irq/123-lan19:20:163
10237991716,1cyclictest67750irq/123-lan00:24:113
10237991615,1cyclictest67750irq/123-lan23:37:463
10237991615,1cyclictest67750irq/123-lan23:25:163
10237991615,1cyclictest67750irq/123-lan22:34:553
10237991615,1cyclictest67750irq/123-lan22:22:533
10237991615,1cyclictest67750irq/123-lan21:55:113
10226991614,2cyclictest784-21snmpd22:07:060
10237991414,0cyclictest67750irq/123-lan19:16:123
10237991312,1cyclictest67750irq/123-lan20:05:173
10232991313,0cyclictest6090-21kworker/2:0+events_freezable20:35:152
1023099108,2cyclictest784-21snmpd21:31:501
102329993,5cyclictest32309-21cat23:49:552
102309998,1cyclictest784-21snmpd22:26:041
102309998,1cyclictest782-21lldpd21:29:491
102309998,1cyclictest526-21avahi-daemon21:48:111
102309998,1cyclictest526-21avahi-daemon21:11:381
102269998,1cyclictest784-21snmpd20:01:530
102329988,0cyclictest784-21snmpd22:51:282
102329988,0cyclictest782-21lldpd23:56:012
102329988,0cyclictest782-21lldpd22:49:272
102329987,1cyclictest784-21snmpd21:36:322
102329986,2cyclictest784-21snmpd00:23:322
102309988,0cyclictest784-21snmpd22:13:571
102309988,0cyclictest784-21snmpd20:18:081
102309987,1cyclictest784-21snmpd21:19:401
102309987,1cyclictest784-21snmpd20:52:211
102309987,1cyclictest784-21snmpd19:44:101
102309987,1cyclictest784-21snmpd00:27:591
102309987,1cyclictest507-21systemd-resolve00:14:191
102309986,2cyclictest784-21snmpd23:51:191
102309986,2cyclictest784-21snmpd22:37:191
102309986,2cyclictest784-21snmpd22:17:481
102309986,2cyclictest784-21snmpd21:56:381
102309986,2cyclictest784-21snmpd21:54:291
102309986,2cyclictest784-21snmpd20:34:541
102309986,2cyclictest784-21snmpd19:48:311
102309986,2cyclictest784-21snmpd19:36:451
102309986,2cyclictest784-21snmpd19:16:491
102269988,0cyclictest784-21snmpd20:14:140
102269988,0cyclictest782-21lldpd23:31:130
102269988,0cyclictest782-21lldpd22:27:260
102269988,0cyclictest782-21lldpd22:13:330
102269988,0cyclictest782-21lldpd20:32:490
102269988,0cyclictest782-21lldpd00:04:390
102269987,1cyclictest784-21snmpd23:25:360
102269987,1cyclictest526-21avahi-daemon23:14:440
102269987,1cyclictest526-21avahi-daemon22:31:290
102269987,1cyclictest507-21systemd-resolve21:00:160
102269987,1cyclictest507-21systemd-resolve00:08:370
102269985,2cyclictest762-21ntpd20:05:170
102329977,0cyclictest784-21snmpd20:45:272
102329976,1cyclictest784-21snmpd20:29:122
102329976,1cyclictest507-21systemd-resolve23:28:442
102329976,1cyclictest12843-21ntp_kernel_pll_23:30:192
102329975,2cyclictest784-21snmpd20:21:322
102329974,2cyclictest574-21rs:main2
102329973,3cyclictest245-20systemd-journal23:21:222
102329973,3cyclictest245-20systemd-journal19:10:142
102329973,3cyclictest12363-21ssh21:26:132
102309977,0cyclictest784-21snmpd23:04:051
102309977,0cyclictest782-21lldpd20:24:451
102309977,0cyclictest782-21lldpd20:04:461
102309977,0cyclictest782-21lldpd19:25:121
102309976,1cyclictest784-21snmpd21:00:431
102309976,1cyclictest784-21snmpd20:27:361
102309976,1cyclictest782-21lldpd20:40:191
102309975,2cyclictest784-21snmpd22:59:321
102309975,2cyclictest784-21snmpd22:43:011
102309975,2cyclictest784-21snmpd20:59:491
102309975,2cyclictest784-21snmpd20:11:381
102269977,0cyclictest784-21snmpd21:23:190
102269977,0cyclictest784-21snmpd21:09:280
102269977,0cyclictest782-21lldpd21:51:090
102269977,0cyclictest782-21lldpd21:27:250
102269976,1cyclictest784-21snmpd22:21:510
102269975,2cyclictest784-21snmpd23:05:570
102269975,2cyclictest784-21snmpd19:30:550
102269973,3cyclictest1331-21users21:15:220
102329966,0cyclictest782-21lldpd21:04:132
102329966,0cyclictest782-21lldpd19:51:362
102329966,0cyclictest782-21lldpd19:31:282
102329965,1cyclictest784-21snmpd23:12:202
102329965,1cyclictest526-21avahi-daemon21:31:242
102329965,1cyclictest507-21systemd-resolve00:00:012
102329964,2cyclictest784-21snmpd23:41:212
102329964,2cyclictest784-21snmpd19:56:382
102329964,2cyclictest547-21NetworkManager23:37:122
102329963,3cyclictest23346-21grep19:40:142
102329963,2cyclictest6881-21ssh00:26:472
102329962,3cyclictest507-21systemd-resolve00:16:282
102329962,3cyclictest13851-21wc23:00:202
102309966,0cyclictest784-21snmpd23:07:321
102309966,0cyclictest782-21lldpd20:45:591
102309966,0cyclictest782-21lldpd19:55:581
102309966,0cyclictest782-21lldpd19:34:241
102309965,1cyclictest9195-21turbostat00:34:541
102309965,1cyclictest795-21cut20:05:121
102309965,1cyclictest782-21lldpd21:23:351
102309965,1cyclictest782-21lldpd19:24:261
102309965,1cyclictest526-21avahi-daemon20:36:501
102309964,2cyclictest784-21snmpd21:41:021
102309964,2cyclictest784-21snmpd21:37:321
102309963,2cyclictest245-20systemd-journal23:16:551
102309963,2cyclictest17216-21ssh22:32:571
102309962,3cyclictest31806-21ssh23:49:131
102309962,3cyclictest16965-21ssh00:05:191
102309962,3cyclictest15817-21grep22:00:151
102269966,0cyclictest526-21avahi-daemon23:39:260
102269965,1cyclictest526-21avahi-daemon21:58:110
102269965,1cyclictest31571-21cpuspeed_turbos21:45:120
102269965,1cyclictest25057-21cpuspeed_turbos19:45:130
102269964,2cyclictest784-21snmpd23:04:200
102269963,2cyclictest245-20systemd-journal22:19:010
102269962,3cyclictest245-20systemd-journal19:42:110
102329955,0cyclictest784-21snmpd23:05:442
102329955,0cyclictest21590-21needreboot19:35:162
102329954,1cyclictest21548-21ntpq20:55:162
102329954,1cyclictest16316-21gltestperf00:05:142
102329953,2cyclictest15417-21ps19:20:182
102329952,2cyclictest574-21rs:main2
102329952,2cyclictest27304-21fschecks_time21:10:122
102329952,2cyclictest245-20systemd-journal00:10:292
102329952,2cyclictest2097-21sh23:50:432
102329952,2cyclictest13101-21netstat19:15:152
102329951,4cyclictest547-21NetworkManager21:05:362
102329951,3cyclictest245-20systemd-journal21:20:502
102329951,3cyclictest15096-21fw_conntrack20:40:132
102329951,2cyclictest11422-21head20:30:152
102309954,1cyclictest526-21avahi-daemon23:55:271
102309954,1cyclictest331ktimers/100:35:191
102309953,2cyclictest547-21NetworkManager21:05:001
102309952,2cyclictest32202-21cat00:20:161
102309952,2cyclictest28449-21ssh00:16:131
102309952,2cyclictest25203-21ssh23:10:391
102309951,3cyclictest11633-21ld00:00:181
102309950,4cyclictest4312-21ntpq22:20:161
102269952,3cyclictest784-21snmpd19:58:400
102269952,2cyclictest245-20systemd-journal22:36:590
102269952,2cyclictest17403-21ssh00:36:590
102269951,3cyclictest9363-21grep20:25:150
102329941,2cyclictest8373-21ntpq22:55:182
102329940,4cyclictest19536-21ntp_192.168.11420:50:172
102309943,1cyclictest27397-21idleruntime19:50:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional