You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 05:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Sep 14, 2026 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16799910511049,2cyclictest16552-21kworker/1:0+events21:18:061
16799910501048,2cyclictest30946-21kworker/1:1+events21:27:011
16799910501048,2cyclictest17712-21kworker/1:1+events23:19:101
16799910501048,2cyclictest10488-21kworker/1:1+events20:59:221
16889910481047,1cyclictest14516-21kworker/3:1+events21:11:373
16749910481047,1cyclictest4360-21kworker/0:1+events23:24:450
16889910461045,1cyclictest21458-21kworker/3:2+events20:15:543
16889910461044,2cyclictest13691-21kworker/3:1+events19:47:533
16749910461045,1cyclictest9985-21kworker/0:2+events22:42:190
16749910461045,1cyclictest7515-21kworker/0:2+events23:45:450
16889910451043,2cyclictest25925-21kworker/3:0+events00:26:493
16749910451042,3cyclictest32054-21turbostat21:59:550
16889910441043,1cyclictest25039-21kworker/3:2+events00:02:223
16799910441043,1cyclictest24062-21kworker/1:2+events21:20:331
16799910431042,1cyclictest9371-21kworker/1:0+events21:34:111
16889910401037,1cyclictest25039-21kworker/3:2+events22:21:173
16799910311028,3cyclictest20024-21turbostat22:19:551
16749910311029,2cyclictest4360-21kworker/0:1+events23:34:360
16889910301028,2cyclictest14537-21turbostat21:04:553
16749910261023,3cyclictest6613-21turbostat21:34:550
16749910231021,2cyclictest4360-21kworker/0:1+events23:35:200
16889910191015,2cyclictest16133-21kworker/3:2+events00:35:443
16749910141012,2cyclictest4252-21kworker/0:0+events22:48:400
16889910101008,2cyclictest3569-21kworker/3:1+events00:15:233
16889910081006,2cyclictest21812-21kworker/3:0+events22:01:503
16749910051002,3cyclictest19779-21turbostat19:59:550
16889910031001,2cyclictest21458-21kworker/3:2+events20:13:133
16839910031002,1cyclictest9310-21kworker/2:2+events21:38:092
16749910021000,2cyclictest16785-21turbostat21:44:560
16889910011000,1cyclictest3569-21kworker/3:1+events00:08:273
16839910011000,1cyclictest5250-21kworker/2:0+events19:20:232
16749910011000,1cyclictest10217-21kworker/0:2+events22:08:280
1674991000996,4cyclictest2911-21turbostat22:34:550
168899999997,2cyclictest8505-21turbostat20:49:553
168899997996,1cyclictest21458-21kworker/3:2+events20:42:423
168399997996,1cyclictest5250-21kworker/2:0+events19:32:322
168399995994,1cyclictest9310-21kworker/2:2+events19:37:192
168399995994,1cyclictest9310-21kworker/2:2+events19:26:362
167499994993,1cyclictest22762-21kworker/0:0+events23:25:220
168899993992,1cyclictest13691-21kworker/3:1+events20:00:223
168899981980,1cyclictest10253-21kworker/3:0+events00:13:173
167499981979,2cyclictest30467-21turbostat00:04:560
168899977976,1cyclictest13691-21kworker/3:1+events19:40:443
168899974973,1cyclictest21458-21kworker/3:2+events20:33:303
168899971969,2cyclictest6891-21kworker/3:0+events23:06:303
168899971968,1cyclictest25039-21kworker/3:2+events23:10:443
168399971968,3cyclictest23674-21turbostat22:54:542
168899970970,0cyclictest25039-21kworker/3:2+events22:34:093
168899970969,1cyclictest16133-21kworker/3:2+events00:30:233
168899967963,3cyclictest17123-21turbostat23:19:543
167499964961,3cyclictest12522-21turbostat20:59:550
168899963962,1cyclictest25039-21kworker/3:2+events22:28:203
168899961961,0cyclictest18980-21kworker/3:2+events21:48:073
168899961961,0cyclictest18980-21kworker/3:2+events21:48:073
167999961958,3cyclictest1744-21turbostat00:39:561
168899960959,1cyclictest5695-21kworker/3:0+events20:39:473
168899959958,1cyclictest32354-21kworker/3:0+events20:25:453
168899958957,1cyclictest21458-21kworker/3:2+events20:06:303
168899957956,1cyclictest16015-21kworker/3:0+events19:52:563
168899953952,1cyclictest3569-21kworker/3:1+events00:22:583
168899953952,1cyclictest21458-21kworker/3:2+events19:56:383
167499953951,2cyclictest16573-21turbostat21:09:550
167999952951,1cyclictest18457-21kworker/1:1+events19:17:211
167999951950,1cyclictest16552-21kworker/1:0+events21:07:111
167499949946,3cyclictest15748-21turbostat19:49:550
167999946945,1cyclictest9371-21kworker/1:0+events21:51:411
168899945943,2cyclictest3613-21turbostat19:19:553
168399944942,2cyclictest25385-21turbostat23:59:562
167499937936,1cyclictest9985-21kworker/0:2+events23:00:430
167499935934,1cyclictest7515-21kworker/0:2+events23:57:430
167499935934,1cyclictest17341-21kworker/0:0+events22:10:430
168899934930,4cyclictest10137-21turbostat23:44:563
167999934933,1cyclictest5407-21kworker/1:0+events20:54:461
167499934933,1cyclictest7515-21kworker/0:2+events23:54:510
167499933933,0cyclictest4252-21kworker/0:0+events22:51:520
167499933932,1cyclictest22234-21kworker/0:1+events22:18:360
167499926925,1cyclictest22234-21kworker/0:1+events22:35:220
167499925924,1cyclictest23488-21kworker/0:2+events20:22:450
168399924922,2cyclictest12035-21turbostat23:14:542
167499924922,1cyclictest7515-21kworker/0:2+events23:40:210
167499922921,1cyclictest4252-21kworker/0:0+events22:57:430
168399916913,3cyclictest23951-21turbostat00:29:552
168899896893,3cyclictest14939-21turbostat22:14:553
167999893892,1cyclictest18457-21kworker/1:1+events19:14:231
167999876874,2cyclictest29916-21turbostat20:24:551
168399873871,2cyclictest1999-21turbostat20:34:552
167499866865,1cyclictest25121-21turbostat22:24:540
168899863862,1cyclictest7667-21turbostat19:29:553
167499857854,3cyclictest21885-21turbostat21:49:550
167499857854,3cyclictest21885-21turbostat21:49:550
168899856854,2cyclictest11693-21turbostat21:39:563
167999855853,2cyclictest6042-21turbostat20:44:551
167499853851,2cyclictest26992-21turbostat21:54:550
167999696692,4cyclictest8505-21turbostat20:49:551
168899689688,1cyclictest29916-21turbostat20:24:553
167499687685,2cyclictest4760-21turbostat22:04:550
168899655654,1cyclictest25385-21turbostat23:59:563
168399652650,2cyclictest6613-21turbostat21:34:552
168899643642,1cyclictest20024-21turbostat22:19:553
168899637636,1cyclictest1456-21turbostat23:04:553
168899627626,1cyclictest32054-21turbostat21:59:553
168899612609,3cyclictest11699-21turbostat19:39:553
168899586584,2cyclictest16785-21turbostat21:44:553
167999581576,3cyclictest12035-21turbostat23:14:541
167499581579,2cyclictest11693-21turbostat21:39:550
167999576573,3cyclictest18591-21turbostat21:14:551
168399543541,2cyclictest3613-21turbostat19:19:552
168899538535,3cyclictest16573-21turbostat21:09:553
167999524523,1cyclictest14537-21turbostat21:04:561
167499489487,2cyclictest17123-21turbostat23:19:540
168899451450,1cyclictest12522-21turbostat20:59:553
167499423419,4cyclictest27899-21turbostat20:19:550
167999379378,1cyclictest21885-21turbostat21:49:551
167999379378,1cyclictest21885-21turbostat21:49:551
1674994141,0cyclictest31603-21fwupd00:31:230
1688991918,1cyclictest67750irq/123-lan23:47:313
1688991918,1cyclictest67750irq/123-lan22:50:143
1688991918,1cyclictest67750irq/123-lan21:20:233
1688991818,0cyclictest67750irq/123-lan22:05:193
1688991818,0cyclictest67750irq/123-lan21:25:143
1688991818,0cyclictest67750irq/123-lan21:15:133
1688991818,0cyclictest67750irq/123-lan19:30:483
1688991818,0cyclictest67750irq/123-lan19:20:173
1688991817,1cyclictest67750irq/123-lan23:30:173
1688991817,1cyclictest67750irq/123-lan23:25:143
1688991817,1cyclictest67750irq/123-lan22:40:353
1688991817,1cyclictest67750irq/123-lan22:36:233
1688991817,1cyclictest67750irq/123-lan21:54:083
1683991818,0cyclictest784-21snmpd00:22:082
1688991716,1cyclictest67750irq/123-lan23:50:203
1688991716,1cyclictest67750irq/123-lan23:38:333
1688991716,1cyclictest67750irq/123-lan23:20:223
1688991716,1cyclictest67750irq/123-lan22:55:113
1683991717,0cyclictest13214-21cat20:55:142
1688991616,0cyclictest67750irq/123-lan22:49:423
1688991615,1cyclictest67750irq/123-lan21:30:123
1683991616,0cyclictest839-21cat23:30:142
1683991616,0cyclictest784-21snmpd22:57:172
1683991616,0cyclictest784-21snmpd22:13:342
1688991514,1cyclictest67750irq/123-lan20:55:003
1683991515,0cyclictest784-21snmpd22:05:122
1683991515,0cyclictest784-21snmpd21:45:302
1683991515,0cyclictest784-21snmpd21:45:302
1683991515,0cyclictest784-21snmpd00:14:322
1688991414,0cyclictest67750irq/123-lan19:10:273
1683991414,0cyclictest784-21snmpd23:03:352
1683991414,0cyclictest784-21snmpd21:56:392
1683991414,0cyclictest784-21snmpd21:03:322
1683991414,0cyclictest784-21snmpd20:36:272
1683991414,0cyclictest17265-21cat21:05:142
1683991313,0cyclictest784-21snmpd23:17:302
1683991313,0cyclictest784-21snmpd00:06:522
1683991313,0cyclictest28605-21cat20:15:162
1683991313,0cyclictest24572-21cat21:15:152
1683991212,0cyclictest784-21snmpd20:20:332
168399108,2cyclictest784-21snmpd21:20:232
167999109,1cyclictest507-21systemd-resolve23:39:281
16799998,1cyclictest784-21snmpd23:31:451
16799998,1cyclictest784-21snmpd22:09:211
16749998,1cyclictest784-21snmpd20:31:300
16839986,2cyclictest784-21snmpd22:37:222
16839986,2cyclictest784-21snmpd22:16:222
16839986,2cyclictest784-21snmpd21:11:052
16839986,2cyclictest762-21ntpd20:29:412
16839986,2cyclictest762-21ntpd19:48:432
16839986,2cyclictest762-21ntpd19:43:512
16799988,0cyclictest784-21snmpd20:25:041
16799988,0cyclictest782-21lldpd22:27:521
16799988,0cyclictest782-21lldpd20:08:271
16799988,0cyclictest782-21lldpd20:01:561
16799988,0cyclictest782-21lldpd00:34:201
16799988,0cyclictest782-21lldpd00:28:581
16799987,1cyclictest784-21snmpd23:57:311
16799987,1cyclictest507-21systemd-resolve22:02:511
16799986,2cyclictest784-21snmpd22:46:171
16799986,2cyclictest784-21snmpd22:42:311
16799986,2cyclictest784-21snmpd19:28:591
16799986,2cyclictest4709-21cat20:35:131
16749988,0cyclictest784-21snmpd21:15:500
16749988,0cyclictest782-21lldpd00:07:580
16749987,1cyclictest784-21snmpd19:20:310
16749987,1cyclictest784-21snmpd19:19:460
16749986,2cyclictest784-21snmpd20:49:490
16749986,2cyclictest784-21snmpd20:25:090
16839977,0cyclictest784-21snmpd19:51:322
16839977,0cyclictest782-21lldpd20:13:162
16839977,0cyclictest782-21lldpd00:32:342
16839976,1cyclictest784-21snmpd23:22:462
16839976,1cyclictest784-21snmpd21:27:562
16839976,1cyclictest784-21snmpd20:45:222
16839975,2cyclictest784-21snmpd23:37:512
16839975,2cyclictest784-21snmpd20:07:332
16839973,3cyclictest15734-21ssh22:40:542
16799977,0cyclictest784-21snmpd23:50:041
16799977,0cyclictest784-21snmpd23:20:461
16799977,0cyclictest784-21snmpd00:08:071
16799977,0cyclictest782-21lldpd22:32:111
16799977,0cyclictest782-21lldpd19:30:191
16799976,1cyclictest784-21snmpd23:43:531
16799976,1cyclictest784-21snmpd22:37:041
16799976,1cyclictest784-21snmpd20:31:091
16799976,1cyclictest507-21systemd-resolve21:38:171
16799975,2cyclictest784-21snmpd21:55:301
16799975,2cyclictest784-21snmpd20:11:271
16799975,2cyclictest784-21snmpd19:45:021
16799975,2cyclictest6346-21cat19:20:151
16749977,0cyclictest784-21snmpd20:53:220
16749977,0cyclictest782-21lldpd22:26:520
16749977,0cyclictest782-21lldpd00:23:030
16749976,1cyclictest784-21snmpd20:42:520
16749975,2cyclictest784-21snmpd19:50:470
16749975,2cyclictest4708-21cat20:35:130
16839966,0cyclictest784-21snmpd19:10:142
16839965,1cyclictest784-21snmpd22:28:342
16839963,3cyclictest547-21NetworkManager23:42:482
16839963,3cyclictest547-21NetworkManager00:17:262
16839963,2cyclictest32006-21ssh21:54:582
16839963,2cyclictest17244-21ssh23:45:372
16839962,3cyclictest31152-21ssh23:28:152
16839962,3cyclictest11587-21ssh23:09:222
16839961,5cyclictest547-21NetworkManager22:49:332
16839960,5cyclictest30743-21cupsd00:00:032
16799966,0cyclictest784-21snmpd23:00:201
16799966,0cyclictest784-21snmpd21:43:201
16799966,0cyclictest784-21snmpd19:43:051
16799966,0cyclictest782-21lldpd19:35:061
16799966,0cyclictest782-21lldpd00:10:081
16799966,0cyclictest526-21avahi-daemon20:15:301
16799965,1cyclictest526-21avahi-daemon00:21:361
16799965,1cyclictest20108-21cpuspeed_turbos19:55:111
16799964,2cyclictest784-21snmpd22:50:441
16799964,2cyclictest784-21snmpd22:21:491
16799963,2cyclictest245-20systemd-journal00:02:321
16799962,3cyclictest18723-21ntp_192.168.11419:50:161
16799962,3cyclictest17299-21ssh00:17:481
16749966,0cyclictest782-21lldpd23:09:260
16749966,0cyclictest782-21lldpd00:35:370
16749965,1cyclictest784-21snmpd21:02:130
16749965,1cyclictest0-21swapper/020:10:000
16749964,2cyclictest784-21snmpd23:12:530
16749964,2cyclictest784-21snmpd19:11:400
16749963,3cyclictest19748-21ntpq21:10:170
16839955,0cyclictest784-21snmpd22:00:572
16839954,1cyclictest421ktimers/200:35:452
16839953,2cyclictest784-21snmpd22:32:222
16839953,2cyclictest25396-21ssh22:20:032
16839953,2cyclictest2103-21kworker/u16:3+nfsiod21:44:292
16839953,2cyclictest20672-21apt-get23:50:102
16839952,2cyclictest21091-21sed19:55:192
16839952,2cyclictest11432-21grep20:50:172
16799954,1cyclictest507-21systemd-resolve23:05:191
16799952,2cyclictest29578-21ssh22:55:141
16799952,2cyclictest29564-21ssh23:26:001
16799952,2cyclictest17723-21ssh22:11:441
16799951,3cyclictest15461-21ssh23:45:011
16749954,1cyclictest784-21snmpd20:03:420
16749953,2cyclictest784-21snmpd00:11:220
16749953,2cyclictest547-21NetworkManager00:16:050
16749953,0cyclictest0-21swapper/000:25:260
16749952,3cyclictest10152-21fschecks_count19:30:130
16749952,2cyclictest27348-21cat20:10:210
16839943,1cyclictest762-21ntpd20:00:032
16839940,3cyclictest8029-21awk20:40:222
16749943,1cyclictest171ktimers/021:20:020
16749942,2cyclictest2664-21ntpq21:25:150
16749942,2cyclictest13287-21sed19:35:210
16749941,3cyclictest13998-21apt-get19:40:130
16749940,3cyclictest8194-21fschecks_time19:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional