You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 09:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Sep 04, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59759910521049,3cyclictest5767-21turbostat00:04:553
59659910471043,4cyclictest10453-21kworker/1:2+events22:18:281
59709910461044,2cyclictest29759-21kworker/2:0+events23:54:002
59609910451043,2cyclictest4311-21kworker/0:2+events21:26:520
59609910441042,2cyclictest32044-21kworker/0:1+events21:00:200
59609910441042,2cyclictest30738-21kworker/0:1+events21:19:020
59659910411040,1cyclictest10453-21kworker/1:2+events00:11:511
59609910391037,2cyclictest32044-21kworker/0:1+events20:55:220
59759910381037,1cyclictest11469-21kworker/3:1+events23:36:083
59609910381036,2cyclictest32044-21kworker/0:1+events19:22:510
59659910371036,1cyclictest10453-21kworker/1:2+events22:32:561
59609910331030,3cyclictest20064-21kworker/0:0+events21:07:150
59759910301029,1cyclictest18070-21kworker/3:0+events19:36:513
59609910291026,3cyclictest32044-21kworker/0:1+events20:50:210
59609910261024,2cyclictest20064-21kworker/0:0+events21:11:500
59759910251024,1cyclictest10859-21kworker/3:0+events22:50:233
59609910251021,4cyclictest24500-21turbostat22:49:550
59609910231018,3cyclictest20064-21kworker/0:0+events21:20:210
59759910211020,1cyclictest1890-21kworker/3:1+events20:27:353
59659910201019,1cyclictest12184-21kworker/1:1+events00:20:231
59659910191018,1cyclictest12184-21kworker/1:1+events00:33:181
59609910161013,3cyclictest5851-21turbostat19:14:550
59759910091008,1cyclictest27318-21kworker/3:0+events23:25:213
59659910081007,1cyclictest10453-21kworker/1:2+events22:14:521
59759910031001,2cyclictest5200-21kworker/3:2+events22:57:133
597099999998,1cyclictest29759-21kworker/2:0+events23:58:592
597599997996,1cyclictest9521-21kworker/3:1+events21:33:433
597599997995,2cyclictest11945-21kworker/3:1+events19:34:483
597099997994,2cyclictest23346-21kworker/2:2+events19:50:212
596599997996,1cyclictest8768-21kworker/1:0+events00:38:301
597099995994,1cyclictest22724-21kworker/2:1+events19:55:222
596099994993,1cyclictest1746-21turbostat23:29:550
597599992992,0cyclictest16276-21kworker/3:2+events23:34:043
597099990988,2cyclictest22724-21kworker/2:1+events23:49:512
597599989987,1cyclictest31540-21kworker/3:1+events21:49:483
596099987984,3cyclictest10652-21turbostat00:39:560
597599982980,2cyclictest9521-21kworker/3:1+events21:36:063
596099980978,2cyclictest11330-21turbostat21:34:550
597599976975,1cyclictest20594-21kworker/3:2+events22:40:453
597599975974,1cyclictest10673-21kworker/3:0+events23:12:133
597599970969,1cyclictest1890-21kworker/3:1+events20:17:353
596599970969,1cyclictest10453-21kworker/1:2+events00:05:211
597599969968,1cyclictest6063-21kworker/3:0+events20:33:383
597599969968,1cyclictest20594-21kworker/3:2+events22:37:363
597099968965,3cyclictest9937-21turbostat19:24:552
596599967966,1cyclictest30194-21kworker/1:0+events22:02:101
596599967966,1cyclictest12184-21kworker/1:1+events00:28:071
597599965964,1cyclictest20594-21kworker/3:2+events21:42:453
597599965963,2cyclictest31540-21kworker/3:1+events21:51:283
597599965963,2cyclictest12364-21turbostat20:49:543
596599965963,1cyclictest12184-21kworker/1:1+events00:16:391
597599962961,1cyclictest16276-21kworker/3:2+events23:24:433
597599962961,1cyclictest11945-21kworker/3:1+events19:27:583
596099962959,3cyclictest8909-21turbostat22:34:550
597599961960,1cyclictest31540-21kworker/3:1+events21:55:223
597599960959,1cyclictest6063-21kworker/3:0+events20:43:403
597599960959,1cyclictest5200-21kworker/3:2+events23:00:223
597599960959,1cyclictest17088-21kworker/3:0+events23:40:223
597599959958,1cyclictest20134-21kworker/3:2+events20:14:023
597599959958,1cyclictest18782-21kworker/3:0+events19:15:213
597599959957,2cyclictest10673-21kworker/3:0+events23:09:543
597599958957,1cyclictest27318-21kworker/3:0+events23:19:473
597599958957,1cyclictest11945-21kworker/3:1+events19:41:063
597599958957,1cyclictest10859-21kworker/3:0+events22:48:293
597599957956,1cyclictest26493-21kworker/3:1+events20:02:123
597599957956,1cyclictest1890-21kworker/3:1+events20:35:453
596599957956,1cyclictest3133-21kworker/1:1+events22:28:481
597599956955,1cyclictest22185-21kworker/3:0+events19:47:003
597599956955,1cyclictest1890-21kworker/3:1+events20:20:453
596599950948,1cyclictest18317-21kworker/1:1+events22:08:581
596599949948,1cyclictest10453-21kworker/1:2+events22:22:111
596599946945,1cyclictest32076-21kworker/1:2+events19:13:511
597599944944,0cyclictest26493-21kworker/3:1+events20:05:233
596099930928,2cyclictest2234-21turbostat20:24:550
597599890888,2cyclictest27441-21turbostat00:24:553
596099878876,2cyclictest24500-21turbostat19:59:540
597099874871,3cyclictest20475-21turbostat19:49:552
596599863861,2cyclictest502-21turbostat23:59:551
596099856854,2cyclictest10107-21turbostat22:04:550
597599691690,1cyclictest5851-21turbostat19:14:543
597099684683,1cyclictest17363-21turbostat23:44:552
597599681678,3cyclictest6141-21turbostat21:29:553
596599680677,3cyclictest4889-21turbostat21:59:551
597599674673,1cyclictest9937-21turbostat19:24:553
597599637634,3cyclictest8909-21turbostat22:34:553
597599620618,2cyclictest502-21turbostat23:59:553
596599604601,3cyclictest5767-21turbostat00:04:551
596099599596,3cyclictest12364-21turbostat20:49:550
597599555553,2cyclictest24500-21turbostat19:59:553
596099533531,2cyclictest7909-21turbostat19:19:540
597099511508,3cyclictest10652-21turbostat00:39:552
5975991918,1cyclictest67750irq/123-lan21:23:153
5975991918,1cyclictest67750irq/123-lan21:12:123
5975991817,1cyclictest67750irq/123-lan23:53:363
5975991817,1cyclictest67750irq/123-lan22:17:553
5975991817,1cyclictest67750irq/123-lan22:05:213
5975991817,1cyclictest67750irq/123-lan20:55:143
5975991817,1cyclictest67750irq/123-lan00:35:503
5970991818,0cyclictest784-21snmpd23:36:332
5970991818,0cyclictest784-21snmpd22:12:032
5970991818,0cyclictest784-21snmpd20:40:332
5975991717,0cyclictest67750irq/123-lan22:20:113
5975991717,0cyclictest67750irq/123-lan20:50:013
5975991717,0cyclictest67750irq/123-lan00:12:183
5975991717,0cyclictest67750irq/123-lan00:06:033
5975991716,1cyclictest67750irq/123-lan23:47:543
5975991716,1cyclictest67750irq/123-lan22:00:203
5975991716,1cyclictest67750irq/123-lan21:15:213
5975991716,1cyclictest67750irq/123-lan00:30:183
5970991717,0cyclictest22724-21kworker/2:1+events21:39:252
5970991716,1cyclictest2930-21kworker/2:2+events00:07:372
5970991716,1cyclictest22724-21kworker/2:1+events22:36:212
5975991616,0cyclictest67750irq/123-lan22:25:363
5975991616,0cyclictest67750irq/123-lan19:50:123
5975991615,1cyclictest67750irq/123-lan21:05:133
5975991615,1cyclictest67750irq/123-lan00:25:133
5975991615,1cyclictest67750irq/123-lan00:17:493
5970991616,0cyclictest784-21snmpd20:23:052
5975991514,1cyclictest67750irq/123-lan22:11:093
5975991313,0cyclictest67750irq/123-lan21:00:203
5970991211,1cyclictest2930-21kworker/2:2+events00:10:512
5970991211,1cyclictest22724-21kworker/2:1+events21:59:032
597099120,12cyclictest0-21swapper/200:27:222
5970991110,1cyclictest22724-21kworker/2:1+events22:20:322
59709998,1cyclictest782-21lldpd22:04:232
59709998,1cyclictest22724-21kworker/2:1+events23:30:512
59659998,1cyclictest784-21snmpd23:09:351
59659998,1cyclictest782-21lldpd21:09:431
59609996,3cyclictest784-21snmpd23:16:050
59709988,0cyclictest784-21snmpd23:00:502
59709988,0cyclictest784-21snmpd00:32:232
59709988,0cyclictest784-21snmpd00:04:222
59709988,0cyclictest782-21lldpd23:16:542
59709988,0cyclictest782-21lldpd19:13:042
59709987,1cyclictest572-21in:imuxsock22:50:592
59709987,1cyclictest526-21avahi-daemon21:48:562
59709987,1cyclictest507-21systemd-resolve22:43:172
59709986,2cyclictest784-21snmpd21:34:562
59709986,2cyclictest762-21ntpd20:05:322
59709986,2cyclictest762-21ntpd20:02:382
59709986,2cyclictest22724-21kworker/2:1+events21:18:072
59659988,0cyclictest784-21snmpd19:47:221
59659988,0cyclictest782-21lldpd23:34:291
59659988,0cyclictest782-21lldpd23:11:481
59659988,0cyclictest782-21lldpd23:04:481
59659988,0cyclictest782-21lldpd20:43:421
59659988,0cyclictest782-21lldpd20:35:321
59659988,0cyclictest782-21lldpd19:34:191
59659987,1cyclictest782-21lldpd21:32:051
59659987,1cyclictest593-21gmain23:27:401
59659987,1cyclictest526-21avahi-daemon22:41:141
59659987,1cyclictest526-21avahi-daemon19:15:111
59659987,1cyclictest507-21systemd-resolve23:18:431
59659986,2cyclictest784-21snmpd23:46:241
59659986,2cyclictest784-21snmpd21:29:131
59659986,2cyclictest784-21snmpd20:24:471
59609988,0cyclictest784-21snmpd23:06:500
59609988,0cyclictest784-21snmpd20:06:170
59609988,0cyclictest784-21snmpd19:44:130
59609988,0cyclictest782-21lldpd20:42:360
59609988,0cyclictest782-21lldpd00:21:070
59609988,0cyclictest782-21lldpd00:16:470
59609987,1cyclictest1433-21ntp_kernel_pll_00:25:160
59609986,2cyclictest784-21snmpd22:38:460
59609986,2cyclictest784-21snmpd00:34:110
59609986,2cyclictest495-21cat21:50:170
59709977,0cyclictest784-21snmpd20:55:312
59709976,1cyclictest2930-21kworker/2:2+events00:20:132
59709976,1cyclictest2930-21kworker/2:2+events00:15:152
59709976,1cyclictest23346-21kworker/2:2+events19:40:172
59709976,1cyclictest23346-21kworker/2:2+events19:35:002
59709976,1cyclictest23346-21kworker/2:2+events19:30:012
59709976,1cyclictest23346-21kworker/2:2+events19:25:312
59709976,1cyclictest23346-21kworker/2:2+events19:15:142
59709976,1cyclictest22724-21kworker/2:1+events23:25:132
59709976,1cyclictest22724-21kworker/2:1+events23:20:012
59709976,1cyclictest22724-21kworker/2:1+events23:10:072
59709976,1cyclictest22724-21kworker/2:1+events23:05:172
59709976,1cyclictest22724-21kworker/2:1+events22:55:272
59709976,1cyclictest22724-21kworker/2:1+events22:45:032
59709976,1cyclictest22724-21kworker/2:1+events22:30:212
59709976,1cyclictest22724-21kworker/2:1+events22:25:092
59709976,1cyclictest22724-21kworker/2:1+events22:15:132
59709976,1cyclictest22724-21kworker/2:1+events22:05:132
59709976,1cyclictest22724-21kworker/2:1+events21:50:092
59709976,1cyclictest22724-21kworker/2:1+events21:40:072
59709976,1cyclictest22724-21kworker/2:1+events21:25:122
59709976,1cyclictest22724-21kworker/2:1+events21:20:032
59709976,1cyclictest22724-21kworker/2:1+events21:10:012
59709976,1cyclictest22724-21kworker/2:1+events21:07:142
59709976,1cyclictest22724-21kworker/2:1+events21:00:152
59709976,1cyclictest22724-21kworker/2:1+events20:50:112
59709976,1cyclictest22724-21kworker/2:1+events20:35:212
59709976,1cyclictest22724-21kworker/2:1+events20:30:182
59709976,1cyclictest22724-21kworker/2:1+events20:25:052
59709976,1cyclictest22724-21kworker/2:1+events20:15:152
59709976,1cyclictest22724-21kworker/2:1+events20:10:322
59659977,0cyclictest784-21snmpd21:22:101
59659977,0cyclictest784-21snmpd19:21:511
59659977,0cyclictest782-21lldpd22:36:321
59659977,0cyclictest27182-21gltestperf20:00:131
59659976,1cyclictest526-21avahi-daemon20:17:351
59659976,1cyclictest16907-21fschecks_time20:55:131
59609977,0cyclictest784-21snmpd20:18:310
59609977,0cyclictest784-21snmpd19:28:580
59609977,0cyclictest782-21lldpd23:52:250
59609977,0cyclictest782-21lldpd19:38:040
59609977,0cyclictest526-21avahi-daemon00:06:240
59609976,1cyclictest784-21snmpd22:06:570
59609976,1cyclictest23188-21fschecks_count23:45:120
59609975,2cyclictest8996-21cat20:35:140
59609975,2cyclictest784-21snmpd22:52:070
59609974,3cyclictest547-21NetworkManager23:57:200
59609970,0cyclictest5230-21ntp_192.168.11420:25:160
59709965,1cyclictest22724-21kworker/2:1+events20:45:152
59659966,0cyclictest784-21snmpd23:22:111
59659966,0cyclictest784-21snmpd21:41:351
59659966,0cyclictest784-21snmpd20:12:231
59659966,0cyclictest782-21lldpd20:32:341
59659966,0cyclictest782-21lldpd20:08:061
59659966,0cyclictest526-21avahi-daemon20:27:071
59659965,1cyclictest30700-21cpuspeed_turbos22:50:171
59659965,1cyclictest27595-21gltestperf21:45:131
59659964,2cyclictest784-21snmpd20:48:541
59659963,2cyclictest30013-21ssh22:49:521
59659963,2cyclictest29903-21sh23:50:461
59659963,2cyclictest245-20systemd-journal22:58:071
59659963,2cyclictest17695-21ssh21:35:161
59659963,2cyclictest16720-21ssh23:39:091
59659962,3cyclictest245-20systemd-journal19:27:301
59659962,3cyclictest16554-21cat20:55:001
59609965,1cyclictest784-21snmpd22:19:360
59609965,1cyclictest784-21snmpd20:12:380
59609965,1cyclictest784-21snmpd19:45:130
59609965,1cyclictest547-21NetworkManager23:10:210
59609965,1cyclictest526-21avahi-daemon21:38:380
59609964,2cyclictest784-21snmpd21:44:260
59609963,3cyclictest784-21snmpd22:25:100
59609963,2cyclictest8014-21ssh22:59:520
59609963,2cyclictest32560-21ssh23:22:490
59609963,2cyclictest10621-21ssh00:03:550
59609962,3cyclictest245-20systemd-journal23:40:040
59659954,1cyclictest0-21swapper/121:00:151
59659952,3cyclictest23594-21ld19:50:191
59659952,2cyclictest30043-21sh21:16:051
59659952,2cyclictest25542-21ssh21:12:051
59659952,2cyclictest20026-21rm23:41:281
59659952,2cyclictest16468-21cmp19:34:591
59659952,2cyclictest1324-21grep21:50:231
59659950,4cyclictest19535-21ntpq19:40:181
59609955,0cyclictest784-21snmpd22:23:120
59609954,1cyclictest14421-21df_inode19:30:130
59609953,2cyclictest784-21snmpd22:11:330
59609953,2cyclictest507-21systemd-resolve23:02:350
59609952,2cyclictest245-20systemd-journal23:30:460
59609952,2cyclictest20773-21cut22:40:200
59609952,2cyclictest13678-21ssh23:35:220
59609951,3cyclictest7284-21ssh21:56:070
59609950,4cyclictest27539-21ntpq20:00:160
59609950,4cyclictest27286-21apt-get21:45:100
59659941,2cyclictest25631-21ldconfig19:55:181
59609942,2cyclictest17865-21cat00:10:130
59609940,3cyclictest22751-21apt-get19:50:130
59609940,2cyclictest7214-21grep20:30:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional