You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 08:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sat Sep 05, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
105009910551050,3cyclictest24803-21kworker/0:0+events00:29:260
105059910521050,2cyclictest8136-21kworker/1:0+events20:19:021
105059910521050,2cyclictest27095-21kworker/1:2+events22:54:091
105059910521050,2cyclictest16003-21kworker/1:2+events22:34:351
105009910521050,2cyclictest13018-21kworker/0:2+events21:28:390
105009910521047,3cyclictest24803-21kworker/0:0+events23:14:130
105059910511049,2cyclictest8136-21kworker/1:0+events20:22:541
105059910511049,2cyclictest4933-21kworker/1:0+events22:42:331
105059910511049,2cyclictest4674-21kworker/1:1+events20:27:531
105009910511049,2cyclictest27530-21kworker/0:0+events19:58:210
105009910511048,3cyclictest13018-21kworker/0:2+events20:37:110
105009910511048,3cyclictest10295-21kworker/0:1+events20:00:220
105009910511047,3cyclictest24803-21kworker/0:0+events00:14:450
105009910511047,3cyclictest13018-21kworker/0:2+events23:06:520
105059910501048,2cyclictest8136-21kworker/1:0+events20:31:591
105059910501047,3cyclictest4933-21kworker/1:0+events22:27:101
105009910501049,1cyclictest27530-21kworker/0:0+events19:50:450
105009910501048,2cyclictest27530-21kworker/0:0+events20:13:190
105009910501048,2cyclictest12540-21kworker/0:2+events00:34:020
105009910501048,2cyclictest12527-21kworker/0:0+events23:01:150
105059910491047,2cyclictest4933-21kworker/1:0+events22:46:281
105059910491047,2cyclictest30689-21kworker/1:1+events22:22:091
105059910491047,2cyclictest30689-21kworker/1:1+events22:22:091
105059910491047,2cyclictest30689-21kworker/1:1+events22:18:231
105059910491047,2cyclictest17611-21kworker/1:2+events00:07:441
105009910491046,3cyclictest22788-21kworker/0:1+events00:36:050
105009910491046,3cyclictest22788-21kworker/0:1+events00:22:120
105009910481045,3cyclictest24803-21kworker/0:0+events00:17:100
105059910471045,2cyclictest8136-21kworker/1:0+events21:21:061
105059910471045,2cyclictest4933-21kworker/1:0+events22:36:291
105059910461044,2cyclictest5317-21kworker/1:1+events00:04:001
105059910441042,2cyclictest5317-21kworker/1:1+events23:56:281
105009910421040,2cyclictest4949-21turbostat21:24:550
105059910411039,2cyclictest9725-21kworker/1:2+events21:58:381
105059910351032,3cyclictest16426-21kworker/1:0+events22:00:441
105109910331032,1cyclictest28234-21kworker/2:1+events21:44:192
105139910301028,2cyclictest32128-21turbostat23:54:553
105109910201019,1cyclictest15692-21kworker/2:0+events21:37:412
105109910191017,2cyclictest15692-21kworker/2:0+events21:49:102
105109910181015,1cyclictest7746-21kworker/2:2+events23:34:122
105139910161013,3cyclictest25734-21turbostat21:44:563
105109910161015,1cyclictest15692-21kworker/2:0+events23:24:232
105139910121010,2cyclictest32124-21turbostat21:19:553
105109910121011,1cyclictest15692-21kworker/2:0+events23:17:322
105009910081006,2cyclictest24939-21turbostat22:14:550
105109910021001,1cyclictest15692-21kworker/2:0+events23:28:142
10513991001999,2cyclictest2943-21turbostat22:24:563
10513991001999,2cyclictest2943-21turbostat22:24:553
1051399998996,2cyclictest14564-21turbostat22:04:563
1051099996995,1cyclictest20304-21kworker/2:2+events22:05:442
1051099995994,1cyclictest20304-21kworker/2:2+events22:10:312
1051099995994,1cyclictest15692-21kworker/2:0+events21:52:512
1051399993992,1cyclictest14773-21kworker/3:0+events21:00:463
1051099993992,1cyclictest25478-21kworker/2:2+events21:33:362
1051099992991,1cyclictest15692-21kworker/2:0+events23:39:102
1051099983982,1cyclictest7746-21kworker/2:2+events23:41:052
1051399981978,1cyclictest8220-21kworker/3:2+events19:12:343
1051399978976,2cyclictest3290-21kworker/3:1+events22:56:083
1051399977976,1cyclictest14773-21kworker/3:0+events21:13:303
1050599974972,2cyclictest31028-21turbostat20:04:551
1051399961959,2cyclictest15350-21turbostat21:34:553
1051399961959,2cyclictest10282-21kworker/3:0+events19:20:203
1051399960959,1cyclictest8220-21kworker/3:2+events19:16:043
1051399956956,0cyclictest16326-21kworker/3:2+events19:46:293
1051399956954,2cyclictest15354-21turbostat00:09:553
1051399954953,1cyclictest10282-21kworker/3:0+events19:27:573
1051399953952,1cyclictest10282-21kworker/3:0+events19:43:383
1051399953952,1cyclictest10282-21kworker/3:0+events19:33:473
1051399951947,2cyclictest22519-21kworker/3:1+events20:57:573
1050099950948,2cyclictest10397-21turbostat19:14:550
1051399948947,1cyclictest22519-21kworker/3:1+events21:06:383
1051399948947,1cyclictest17163-21kworker/3:2+events20:51:063
1051399948947,1cyclictest16326-21kworker/3:2+events20:08:073
1051399946944,2cyclictest6900-21kworker/3:2+events23:45:543
1051399945944,1cyclictest14773-21kworker/3:0+events20:45:233
1051399940939,1cyclictest10282-21kworker/3:0+events19:37:333
1051399938937,1cyclictest14773-21kworker/3:0+events20:41:283
1051399935933,2cyclictest2683-21turbostat20:14:553
1050099935933,2cyclictest21327-21turbostat23:44:540
1051099925923,2cyclictest12782-21turbostat20:39:552
1050599925922,3cyclictest26526-21turbostat23:49:541
1050099906903,3cyclictest26922-21turbostat21:14:550
1051399905903,2cyclictest22550-21turbostat23:14:563
1051399886884,2cyclictest10779-21turbostat20:34:553
1051099866864,2cyclictest10158-21turbostat21:29:562
1051399863861,2cyclictest3745-21turbostat21:54:553
1051399857854,3cyclictest27730-21turbostat23:19:543
1050099857853,4cyclictest22874-21turbostat21:04:550
1051099856854,2cyclictest6972-21turbostat22:59:562
1050599695692,3cyclictest32124-21turbostat21:19:551
1050099671667,4cyclictest6972-21turbostat22:59:560
1051399658654,4cyclictest1770-21turbostat22:54:563
1051399625623,2cyclictest12782-21turbostat20:39:553
1050099622621,1cyclictest15354-21turbostat00:09:540
1050599618616,2cyclictest2683-21turbostat20:14:561
1051099605604,1cyclictest14564-21turbostat22:04:562
1051399600598,2cyclictest31028-21turbostat20:04:553
1051399579575,3cyclictest21327-21turbostat23:44:543
1050599578577,1cyclictest24939-21turbostat22:14:551
1050099568566,2cyclictest24566-21turbostat19:49:550
1050099554551,3cyclictest10779-21turbostat20:34:560
1050599547544,3cyclictest3745-21turbostat21:54:551
1050099530528,2cyclictest649-21turbostat20:09:550
1051099515512,3cyclictest22550-21turbostat23:14:562
1050599511510,1cyclictest32128-21turbostat23:54:551
10513991919,0cyclictest67750irq/123-lan00:34:153
10513991918,1cyclictest67750irq/123-lan22:10:153
10513991918,1cyclictest67750irq/123-lan20:15:153
10513991918,1cyclictest67750irq/123-lan00:26:563
10513991818,0cyclictest67750irq/123-lan23:57:383
10513991818,0cyclictest67750irq/123-lan21:58:573
10513991817,1cyclictest67750irq/123-lan22:40:113
10513991817,1cyclictest67750irq/123-lan22:30:193
10513991817,1cyclictest67750irq/123-lan22:27:253
10513991817,1cyclictest67750irq/123-lan21:25:173
10513991817,1cyclictest67750irq/123-lan21:20:133
10513991817,1cyclictest67750irq/123-lan00:17:513
10513991817,1cyclictest67750irq/123-lan00:11:243
10510991818,0cyclictest784-21snmpd22:16:522
10510991818,0cyclictest784-21snmpd21:15:502
10513991717,0cyclictest67750irq/123-lan23:02:563
10513991717,0cyclictest67750irq/123-lan21:35:153
10513991717,0cyclictest67750irq/123-lan00:35:123
10513991716,1cyclictest67750irq/123-lan23:30:113
10513991716,1cyclictest67750irq/123-lan23:28:433
10513991716,1cyclictest67750irq/123-lan23:20:163
10513991716,1cyclictest67750irq/123-lan21:46:193
10513991716,1cyclictest67750irq/123-lan00:24:533
10513991716,1cyclictest67750irq/123-lan00:01:453
10513991616,0cyclictest67750irq/123-lan23:09:323
10513991616,0cyclictest67750irq/123-lan22:16:293
10513991616,0cyclictest67750irq/123-lan22:05:173
10513991615,1cyclictest67750irq/123-lan23:35:143
10513991615,1cyclictest67750irq/123-lan22:47:173
10513991615,1cyclictest67750irq/123-lan22:35:403
10513991313,0cyclictest67750irq/123-lan20:25:153
10513991313,0cyclictest67750irq/123-lan19:59:513
10513991313,0cyclictest67750irq/123-lan19:50:293
10513991211,1cyclictest67750irq/123-lan20:20:173
105059998,1cyclictest784-21snmpd20:41:071
105009998,1cyclictest784-21snmpd20:19:420
105009998,1cyclictest782-21lldpd22:50:370
105109988,0cyclictest784-21snmpd20:18:542
105109988,0cyclictest784-21snmpd00:13:242
105109988,0cyclictest782-21lldpd19:10:032
105109986,2cyclictest784-21snmpd20:14:122
105109986,2cyclictest784-21snmpd19:32:442
105109986,2cyclictest762-21ntpd21:06:032
105109986,2cyclictest762-21ntpd21:00:522
105109986,2cyclictest762-21ntpd19:40:392
105109986,2cyclictest762-21ntpd19:35:512
105109986,2cyclictest29029-21kworker/u16:0-events_unbound00:23:472
105059988,0cyclictest784-21snmpd19:27:581
105059987,1cyclictest784-21snmpd21:45:311
105059987,1cyclictest784-21snmpd20:45:351
105059987,1cyclictest784-21snmpd20:07:561
105059987,1cyclictest784-21snmpd19:59:531
105059987,1cyclictest21719-21ntp_kernel_pll_21:35:161
105059986,2cyclictest784-21snmpd21:11:381
105059986,2cyclictest784-21snmpd19:45:141
105059986,2cyclictest784-21snmpd00:35:301
105009988,0cyclictest784-21snmpd23:45:310
105009988,0cyclictest782-21lldpd20:49:160
105009988,0cyclictest782-21lldpd19:37:560
105009987,1cyclictest784-21snmpd23:55:020
105009987,1cyclictest784-21snmpd20:27:000
105009987,1cyclictest782-21lldpd21:33:340
105009986,2cyclictest784-21snmpd23:17:190
105009986,2cyclictest784-21snmpd21:47:490
105009986,2cyclictest784-21snmpd20:20:150
105009986,2cyclictest784-21snmpd19:18:400
105109977,0cyclictest782-21lldpd00:37:192
105109977,0cyclictest782-21lldpd00:33:462
105109977,0cyclictest782-21lldpd00:17:442
105109976,1cyclictest784-21snmpd20:04:202
105109976,1cyclictest5760-21idleruntime21:20:142
105109976,1cyclictest526-21avahi-daemon22:29:162
105109975,2cyclictest784-21snmpd20:33:242
105109975,2cyclictest784-21snmpd20:26:192
105109975,2cyclictest784-21snmpd20:06:052
105109973,3cyclictest19934-21ntp_states20:50:172
105059977,0cyclictest784-21snmpd23:42:491
105059977,0cyclictest782-21lldpd23:03:031
105059977,0cyclictest782-21lldpd19:24:001
105059976,1cyclictest784-21snmpd23:15:401
105059976,1cyclictest784-21snmpd19:16:311
105059976,1cyclictest26193-21cpuspeed_turbos21:40:101
105059975,2cyclictest784-21snmpd20:52:341
105059975,2cyclictest784-21snmpd19:32:411
105059975,2cyclictest784-21snmpd00:23:261
105059975,2cyclictest784-21snmpd00:11:211
105059974,3cyclictest784-21snmpd19:44:411
105059973,3cyclictest26340-21ssh23:13:051
105009977,0cyclictest782-21lldpd21:56:120
105009977,0cyclictest782-21lldpd21:52:100
105009977,0cyclictest782-21lldpd20:59:520
105009976,1cyclictest782-21lldpd21:17:060
105009976,1cyclictest32590-21cpuspeed_turbos23:50:110
105009975,2cyclictest784-21snmpd22:33:260
105009975,2cyclictest784-21snmpd19:27:100
105009975,2cyclictest11764-21cat23:30:130
105109966,0cyclictest784-21snmpd19:16:522
105109966,0cyclictest782-21lldpd22:46:052
105109966,0cyclictest782-21lldpd22:34:492
105109966,0cyclictest782-21lldpd19:49:492
105109965,1cyclictest784-21snmpd23:50:472
105109965,1cyclictest784-21snmpd22:42:112
105109965,1cyclictest784-21snmpd20:47:562
105109965,1cyclictest507-21systemd-resolve23:47:222
105109965,1cyclictest10524-21/usr/sbin/munin00:00:172
105109964,2cyclictest784-21snmpd22:23:142
105109964,2cyclictest784-21snmpd22:23:132
105109964,2cyclictest784-21snmpd21:55:302
105109963,3cyclictest5490-21diskstats23:55:112
105109963,3cyclictest547-21NetworkManager00:07:162
105109963,2cyclictest28836-21ssh21:10:262
105109963,2cyclictest21662-21ssh23:08:472
105109962,3cyclictest19861-21ntp_states22:35:172
105109961,5cyclictest547-21NetworkManager19:56:402
105059966,0cyclictest784-21snmpd20:55:041
105059965,1cyclictest6982-21ntp_kernel_pll_23:25:171
105059965,1cyclictest16023-21fschecks_time21:30:121
105059964,2cyclictest784-21snmpd23:32:201
105059964,2cyclictest784-21snmpd19:36:401
105059964,2cyclictest784-21snmpd19:12:561
105059964,2cyclictest547-21NetworkManager00:16:031
105059963,2cyclictest22108-21ssh22:06:051
105059963,2cyclictest19717-21ssh23:06:031
105059962,3cyclictest8070-21ssh00:28:491
105059962,3cyclictest547-21NetworkManager23:36:521
105009966,0cyclictest782-21lldpd23:35:170
105009966,0cyclictest782-21lldpd22:38:020
105009966,0cyclictest782-21lldpd22:28:310
105009966,0cyclictest782-21lldpd22:24:520
105009966,0cyclictest782-21lldpd22:24:520
105009966,0cyclictest782-21lldpd20:51:280
105009966,0cyclictest782-21lldpd19:34:390
105009964,2cyclictest784-21snmpd21:05:060
105009963,3cyclictest547-21NetworkManager22:03:530
105009963,3cyclictest547-21NetworkManager21:37:110
105009963,2cyclictest245-20systemd-journal22:48:260
105009963,2cyclictest22286-21ssh22:06:190
105009962,3cyclictest6422-21perl23:25:140
105009962,3cyclictest574-21rs:main0
105109955,0cyclictest0-21swapper/220:55:122
105109954,1cyclictest17091-21gltestperf19:25:132
105109953,2cyclictest784-21snmpd20:23:182
105109952,3cyclictest16540-21sed19:25:002
105109952,2cyclictest5601-21sh00:25:222
105109952,2cyclictest14023-21ssh23:00:212
105109951,1cyclictest191rcu_preempt22:50:102
105059954,1cyclictest9478-21df_inode00:30:111
105059953,2cyclictest547-21NetworkManager23:20:191
105059952,2cyclictest762-21ntpd21:05:171
105059952,2cyclictest25006-21cat21:05:001
105059952,2cyclictest11749-21ssh22:59:281
105059952,2cyclictest11377-21ntpq21:25:181
105009953,2cyclictest547-21NetworkManager21:40:530
105009953,2cyclictest245-20systemd-journal00:01:570
105009952,2cyclictest23613-21ntpq19:40:160
105009951,3cyclictest32166-21ssh22:15:360
105109941,2cyclictest26575-21latency_hist19:50:012
105059941,2cyclictest13484-21awk20:35:131
105059940,4cyclictest26585-21apt-get19:50:011
105009941,2cyclictest15251-21cat20:40:120
105009941,2cyclictest14911-21entropy19:20:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional