You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 16:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Aug 24, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137499910541050,2cyclictest19381-21kworker/0:2+events07:24:360
137499910541049,3cyclictest5298-21kworker/0:1+events09:11:280
137499910531050,2cyclictest5298-21kworker/0:1+events08:59:040
137499910531050,2cyclictest21785-21kworker/0:2+events10:13:270
137499910531049,2cyclictest5298-21kworker/0:1+events08:54:250
137499910531049,2cyclictest24104-21kworker/0:1+events11:10:430
137499910531049,2cyclictest14007-21kworker/0:1+events10:01:400
137499910531049,2cyclictest11271-21kworker/0:2+events07:11:500
137499910531048,3cyclictest21785-21kworker/0:2+events10:31:510
137499910521049,2cyclictest7208-21kworker/0:0+events12:18:350
137499910521049,2cyclictest24104-21kworker/0:1+events11:08:180
137499910521048,2cyclictest28162-21kworker/0:2+events12:03:070
137499910521048,2cyclictest21785-21kworker/0:2+events10:37:130
137499910511049,2cyclictest5298-21kworker/0:1+events09:05:220
137499910511049,2cyclictest28162-21kworker/0:2+events12:07:210
137499910511049,2cyclictest22381-21kworker/0:2+events09:02:320
137499910511048,3cyclictest24104-21kworker/0:1+events11:59:500
137499910511048,3cyclictest21611-21turbostat10:49:550
137659910501048,2cyclictest4281-21kworker/2:2+events09:41:042
137499910501048,2cyclictest5298-21kworker/0:1+events09:23:040
137499910501048,2cyclictest5298-21kworker/0:1+events09:16:270
137499910501048,2cyclictest21785-21kworker/0:2+events10:41:480
137699910491047,2cyclictest26144-21kworker/3:2+events10:53:373
137499910491047,2cyclictest7767-21kworker/0:0+events09:57:100
137499910491047,2cyclictest16391-21kworker/0:0+events07:15:460
137699910481046,2cyclictest12216-21kworker/3:1+events12:20:423
137499910481046,2cyclictest24104-21kworker/0:1+events11:54:330
137699910461044,2cyclictest18725-21kworker/3:1+events10:15:423
137589910461045,1cyclictest30735-21kworker/1:0+events12:14:051
137699910451044,1cyclictest21776-21kworker/3:0+events11:34:423
137699910451044,1cyclictest12094-21kworker/3:2+events09:25:323
137659910421040,2cyclictest4281-21kworker/2:2+events09:46:502
137699910411039,2cyclictest15179-21kworker/3:0+events12:37:473
137659910391035,4cyclictest3362-21kworker/2:2+events11:02:452
137659910381035,3cyclictest5165-21kworker/2:0+events09:53:592
137589910321031,1cyclictest23192-21kworker/1:2+events10:06:531
137499910201018,2cyclictest15656-21turbostat08:39:550
137499910191016,3cyclictest16921-21turbostat12:29:550
137699910151014,1cyclictest16746-21kworker/3:1+events11:19:323
137659910141012,2cyclictest26108-21turbostat12:39:552
137499910091007,2cyclictest21367-21turbostat09:39:550
137659910041001,3cyclictest2674-21turbostat12:14:562
137699910031002,1cyclictest11601-21kworker/3:0+events08:29:443
13769991000999,1cyclictest5424-21kworker/3:2+events08:34:363
1376599995993,2cyclictest17732-21turbostat07:24:552
1375899995993,2cyclictest7264-21turbostat12:19:551
1376999994993,1cyclictest4647-21kworker/3:2+events10:26:513
1376999993992,1cyclictest5424-21kworker/3:2+events08:09:473
1376999983982,1cyclictest447-21kworker/3:2+events11:48:203
1375899982980,2cyclictest11429-21kworker/1:0+events09:39:021
1375899978977,1cyclictest17169-21kworker/1:1+events10:56:381
1376999976975,1cyclictest16746-21kworker/3:1+events11:28:383
1376999975973,2cyclictest5369-21kworker/3:1+events11:41:253
1376999975973,2cyclictest5369-21kworker/3:1+events11:41:253
1376999970969,1cyclictest27565-21kworker/3:2+events07:50:223
1376999965964,1cyclictest25764-21kworker/3:0+events07:44:303
1374999962959,3cyclictest30637-21turbostat11:34:550
1376999959957,2cyclictest11601-21kworker/3:0+events08:36:073
1376599959955,2cyclictest11998-21turbostat10:04:562
1376999956954,2cyclictest16763-21turbostat09:34:553
1376999953952,1cyclictest18725-21kworker/3:1+events10:23:413
1376999946945,1cyclictest447-21kworker/3:2+events11:38:463
1376999946944,2cyclictest5424-21kworker/3:2+events08:20:433
1376999943942,1cyclictest16746-21kworker/3:1+events11:24:023
1376999940939,1cyclictest27565-21kworker/3:2+events08:00:443
1376999939938,1cyclictest25764-21kworker/3:0+events07:49:483
1376999938937,1cyclictest19729-21kworker/3:1+events07:29:233
1376999937937,0cyclictest17259-21kworker/3:2+events12:34:313
1376999937936,1cyclictest19729-21kworker/3:1+events07:38:403
1376999937936,1cyclictest15179-21kworker/3:0+events12:27:313
1376999934933,1cyclictest27565-21kworker/3:2+events07:55:233
1376999931930,1cyclictest5424-21kworker/3:2+events08:19:023
1376999931930,1cyclictest19821-21kworker/3:1+events08:43:083
1376999929928,1cyclictest19821-21kworker/3:1+events08:46:043
1376999928927,1cyclictest3377-21kworker/3:1+events08:10:233
1376999928927,1cyclictest19729-21kworker/3:1+events07:34:093
1375899906905,1cyclictest13643-21turbostat08:34:551
1375899876871,3cyclictest2685-21turbostat10:29:551
1376599869867,2cyclictest9600-21turbostat08:24:542
1376999864863,1cyclictest2799-21turbostat09:54:553
1376999853851,2cyclictest16641-21turbostat10:09:553
1375899690689,1cyclictest26108-21turbostat12:39:551
1376999672671,1cyclictest21611-21turbostat10:49:553
1376999644643,1cyclictest21250-21turbostat10:14:553
1376999640637,3cyclictest12222-21turbostat11:14:543
1376999633632,1cyclictest17732-21turbostat07:24:553
1375899631630,1cyclictest11998-21turbostat10:04:561
1375899624622,2cyclictest26216-21turbostat10:54:551
1375899599596,3cyclictest30485-21turbostat12:09:561
1374999596595,1cyclictest20122-21turbostat08:49:540
1376599595592,3cyclictest30800-21turbostat10:59:552
1374999572571,1cyclictest2674-21turbostat12:14:560
1374999569566,3cyclictest12025-21turbostat11:49:550
1374999552549,3cyclictest2799-21turbostat09:54:550
1375899548546,2cyclictest16763-21turbostat09:34:551
1376599547545,2cyclictest21367-21turbostat09:39:542
1374999537537,0cyclictest16641-21turbostat10:09:550
1374999520518,2cyclictest2685-21turbostat10:29:550
1374999515512,3cyclictest3000-21turbostat11:04:550
1376999512509,3cyclictest7264-21turbostat12:19:553
1376999404403,1cyclictest7532-21turbostat09:24:553
13749991920,191cyclictest19706-21taskset09:32:140
13758991919,0cyclictest67750irq/123-lan12:29:371
13758991919,0cyclictest67750irq/123-lan11:52:091
13758991918,1cyclictest67750irq/123-lan10:35:151
13758991918,1cyclictest67750irq/123-lan10:30:191
13758991818,0cyclictest67750irq/123-lan09:54:461
13758991818,0cyclictest67750irq/123-lan07:34:431
13758991817,1cyclictest67750irq/123-lan12:30:181
13758991817,1cyclictest67750irq/123-lan11:26:001
13758991817,1cyclictest67750irq/123-lan11:15:181
13758991817,1cyclictest67750irq/123-lan11:04:031
13758991817,1cyclictest67750irq/123-lan10:20:131
13758991817,1cyclictest67750irq/123-lan10:12:161
13758991817,1cyclictest67750irq/123-lan09:45:191
13758991717,0cyclictest67750irq/123-lan11:44:121
13758991717,0cyclictest67750irq/123-lan11:44:121
13758991717,0cyclictest67750irq/123-lan11:39:291
13758991717,0cyclictest67750irq/123-lan09:55:131
13758991717,0cyclictest67750irq/123-lan09:16:101
13758991717,0cyclictest67750irq/123-lan08:20:141
13758991717,0cyclictest67750irq/123-lan07:55:211
13758991717,0cyclictest67750irq/123-lan07:25:141
13758991716,1cyclictest67750irq/123-lan11:21:231
13758991716,1cyclictest67750irq/123-lan11:10:201
13758991716,1cyclictest67750irq/123-lan10:47:211
13758991716,1cyclictest67750irq/123-lan10:40:191
13758991716,1cyclictest67750irq/123-lan10:18:421
13758991716,1cyclictest67750irq/123-lan09:20:421
13758991716,1cyclictest67750irq/123-lan09:10:171
13758991716,1cyclictest67750irq/123-lan08:00:161
13758991616,0cyclictest67750irq/123-lan09:40:061
13758991616,0cyclictest67750irq/123-lan08:25:171
13758991616,0cyclictest67750irq/123-lan07:18:101
13758991616,0cyclictest67750irq/123-lan07:12:271
13758991615,1cyclictest67750irq/123-lan12:20:111
13758991615,1cyclictest67750irq/123-lan11:55:381
13758991615,1cyclictest67750irq/123-lan11:45:401
13758991615,1cyclictest67750irq/123-lan11:34:261
13758991615,1cyclictest67750irq/123-lan11:07:261
13758991615,1cyclictest67750irq/123-lan08:35:141
13758991515,0cyclictest67750irq/123-lan12:01:301
13758991515,0cyclictest67750irq/123-lan09:25:191
13758991515,0cyclictest67750irq/123-lan09:05:201
13758991515,0cyclictest67750irq/123-lan08:05:211
13758991514,1cyclictest67750irq/123-lan09:00:161
13758991514,1cyclictest67750irq/123-lan07:50:111
13758991413,1cyclictest67750irq/123-lan08:10:161
13758991313,0cyclictest67750irq/123-lan08:55:141
13758991313,0cyclictest67750irq/123-lan08:45:221
13758991312,1cyclictest67750irq/123-lan08:50:211
13758991312,1cyclictest67750irq/123-lan08:15:211
13758991312,1cyclictest67750irq/123-lan07:45:121
13758991211,1cyclictest67750irq/123-lan08:40:111
13758991010,0cyclictest67750irq/123-lan07:40:151
137699998,1cyclictest784-21snmpd09:02:333
137699998,1cyclictest507-21systemd-resolve09:15:533
137659998,1cyclictest784-21snmpd11:33:252
137659998,1cyclictest526-21avahi-daemon09:33:122
137659998,1cyclictest13141-21ntp_kernel_err11:45:152
137589998,1cyclictest67750irq/123-lan07:40:001
137499998,1cyclictest784-21snmpd11:18:130
137499998,1cyclictest784-21snmpd08:02:250
137499998,1cyclictest784-21snmpd07:32:170
137699988,0cyclictest784-21snmpd10:39:033
137699988,0cyclictest784-21snmpd08:58:093
137699986,2cyclictest784-21snmpd12:14:303
137699986,2cyclictest784-21snmpd11:05:403
137699983,5cyclictest547-21NetworkManager12:07:303
137659988,0cyclictest784-21snmpd10:52:392
137659988,0cyclictest782-21lldpd12:19:212
137659987,1cyclictest784-21snmpd10:07:322
137659987,1cyclictest784-21snmpd08:03:062
137659986,2cyclictest784-21snmpd12:30:342
137659986,2cyclictest784-21snmpd11:59:302
137589988,0cyclictest67750irq/123-lan07:21:101
137499988,0cyclictest784-21snmpd12:21:150
137499988,0cyclictest782-21lldpd10:53:380
137499986,2cyclictest784-21snmpd08:28:070
137499986,2cyclictest784-21snmpd07:59:580
137699977,0cyclictest784-21snmpd12:03:533
137699977,0cyclictest784-21snmpd09:37:213
137699977,0cyclictest782-21lldpd09:43:333
137699977,0cyclictest782-21lldpd08:53:583
137699976,1cyclictest784-21snmpd11:50:083
137699976,1cyclictest784-21snmpd10:57:433
137699976,1cyclictest526-21avahi-daemon10:44:213
137699976,1cyclictest3483-21cpuspeed_turbos11:00:133
137699975,2cyclictest8222-21cat09:55:143
137659977,0cyclictest784-21snmpd12:27:492
137659977,0cyclictest784-21snmpd12:20:302
137659977,0cyclictest784-21snmpd10:46:182
137659977,0cyclictest784-21snmpd10:17:312
137659977,0cyclictest784-21snmpd08:58:152
137659977,0cyclictest784-21snmpd08:12:342
137659977,0cyclictest782-21lldpd12:04:392
137659977,0cyclictest782-21lldpd11:18:082
137659977,0cyclictest782-21lldpd10:13:502
137659977,0cyclictest782-21lldpd09:05:152
137659977,0cyclictest782-21lldpd08:52:522
137659977,0cyclictest782-21lldpd08:16:302
137659977,0cyclictest782-21lldpd07:30:192
137659976,1cyclictest8772-21ntp_kernel_err11:05:172
137659976,1cyclictest526-21avahi-daemon09:25:242
137659976,1cyclictest507-21systemd-resolve09:23:462
137659975,2cyclictest784-21snmpd10:36:002
137659975,2cyclictest784-21snmpd08:08:342
137659975,2cyclictest784-21snmpd07:58:582
137659975,2cyclictest26501-21cut11:25:122
137659975,2cyclictest18810-21cat08:40:132
137659975,2cyclictest17842-21cat10:40:152
137659972,5cyclictest547-21NetworkManager09:10:562
137499977,0cyclictest784-21snmpd09:42:000
137499977,0cyclictest782-21lldpd09:46:010
137499977,0cyclictest782-21lldpd07:28:140
137499976,1cyclictest784-21snmpd08:13:400
137499976,1cyclictest784-21snmpd07:52:240
137499976,1cyclictest526-21avahi-daemon07:40:160
137499975,2cyclictest784-21snmpd08:21:100
137499975,2cyclictest784-21snmpd07:45:290
137699966,0cyclictest784-21snmpd09:06:153
137699966,0cyclictest782-21lldpd09:13:393
137699964,2cyclictest784-21snmpd11:55:213
137699964,2cyclictest784-21snmpd09:49:523
137699963,3cyclictest547-21NetworkManager07:16:243
137699963,2cyclictest7605-21ssh10:30:093
137659966,0cyclictest784-21snmpd07:17:382
137659965,1cyclictest784-21snmpd08:47:232
137659965,1cyclictest526-21avahi-daemon08:36:272
137659965,1cyclictest507-21systemd-resolve09:16:252
137659965,1cyclictest31306-21cat10:20:142
137659965,1cyclictest14303-21ssh11:10:462
137659964,2cyclictest784-21snmpd07:13:552
137659963,2cyclictest2410-21ssh12:09:362
137659963,2cyclictest11331-21ssh09:58:532
137659962,3cyclictest4123-21awk11:35:182
137499966,0cyclictest526-21avahi-daemon10:20:070
137499965,1cyclictest784-21snmpd10:18:110
137499964,2cyclictest784-21snmpd08:41:340
137499964,2cyclictest784-21snmpd07:38:420
137499963,2cyclictest574-21rs:main0
137499962,3cyclictest5728-21cat08:09:590
137499962,3cyclictest24899-21ssh11:23:060
137499962,3cyclictest16730-21ssh09:29:580
137499962,3cyclictest14354-21cat08:30:150
137499962,3cyclictest1148-21ssh10:56:550
137699955,0cyclictest784-21snmpd10:04:143
137659955,0cyclictest784-21snmpd07:35:242
137659955,0cyclictest526-21avahi-daemon08:31:392
137659952,3cyclictest784-21snmpd07:47:562
137659952,2cyclictest8914-21rm10:30:212
137659952,2cyclictest27462-21grep07:40:192
137659952,2cyclictest24529-21ssh11:22:282
137659952,2cyclictest21289-21grep07:25:202
137659952,2cyclictest17536-21sed11:50:152
137659951,3cyclictest7722-21sh11:40:102
137659951,3cyclictest7722-21sh11:40:102
137659951,3cyclictest3963-21ntpq10:25:182
137659950,4cyclictest30470-21gltestperf07:50:112
137659950,4cyclictest12616-21ntpq08:25:172
137499955,0cyclictest526-21avahi-daemon08:19:030
137499954,1cyclictest0-21swapper/011:35:130
137499952,2cyclictest8057-21fschecks_time11:40:140
137499952,2cyclictest8057-21fschecks_time11:40:140
137499952,2cyclictest26739-21expr11:25:140
137499952,2cyclictest24110-21ssh12:31:400
137699943,1cyclictest25764-21kworker/3:0+events_freezable_pwr_efficient07:10:053
137659941,2cyclictest245-20systemd-journal09:00:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional