You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 23:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Aug 25, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12539910521050,2cyclictest27230-21kworker/2:0+events10:18:252
12499910521050,2cyclictest29112-21kworker/1:1+events09:36:521
12499910511049,2cyclictest8969-21kworker/1:0+events09:49:231
12499910511049,2cyclictest8969-21kworker/1:0+events09:49:221
12499910511049,2cyclictest1654-21kworker/1:2+events09:28:201
12499910501048,2cyclictest14931-21kworker/1:2+events09:44:461
12499910501048,2cyclictest14931-21kworker/1:2+events09:44:461
12499910501047,3cyclictest885-21kworker/1:2+events09:12:341
12539910491047,2cyclictest27230-21kworker/2:0+events10:07:112
12539910491047,2cyclictest21182-21kworker/2:2+events10:23:182
12619910481046,2cyclictest7238-21kworker/3:1+events07:38:403
12539910481046,2cyclictest14314-21kworker/2:0+events12:38:122
12539910471045,2cyclictest27230-21kworker/2:0+events10:03:202
12539910451043,2cyclictest27230-21kworker/2:0+events10:11:502
12619910431040,3cyclictest31648-21turbostat09:29:553
12539910371035,2cyclictest27230-21kworker/2:0+events10:37:232
12499910351032,3cyclictest8969-21kworker/1:0+events09:51:071
12619910301029,1cyclictest3587-21kworker/3:2+events12:10:553
12619910301027,3cyclictest14503-21kworker/3:0+events12:05:213
12619910291028,1cyclictest4880-21kworker/3:3+events11:50:433
12619910291027,2cyclictest25771-21kworker/3:0+events08:16:053
12619910271025,2cyclictest8895-21kworker/3:0+events12:32:233
12619910271025,2cyclictest4324-21kworker/3:1+events11:05:433
12619910271025,2cyclictest4324-21kworker/3:1+events10:46:063
12619910271024,3cyclictest3217-21kworker/3:1+events08:32:093
12619910261024,2cyclictest30239-21kworker/3:2+events11:36:373
12499910261024,2cyclictest885-21kworker/1:2+events09:15:431
12619910251023,2cyclictest30239-21kworker/3:2+events11:12:443
12619910251021,2cyclictest4880-21kworker/3:3+events11:55:203
12619910241022,2cyclictest3217-21kworker/3:1+events08:36:163
12619910241022,2cyclictest13490-21kworker/3:2+events09:02:123
12619910231021,2cyclictest3587-21kworker/3:2+events12:27:173
12619910231021,2cyclictest25771-21kworker/3:0+events08:12:593
12619910221020,2cyclictest7238-21kworker/3:1+events07:26:463
12619910221020,2cyclictest25771-21kworker/3:0+events08:27:093
12619910211018,2cyclictest31480-21kworker/3:0+events12:20:213
12619910201018,2cyclictest26550-21kworker/3:1+events12:15:213
12619910201018,2cyclictest14503-21kworker/3:0+events12:02:103
12619910201017,3cyclictest15786-21kworker/3:0+events11:03:523
12619910201017,3cyclictest13490-21kworker/3:2+events08:58:173
12619910201016,3cyclictest9391-21kworker/3:1+events08:49:193
12539910201018,2cyclictest21182-21kworker/2:2+events10:29:242
12619910191017,2cyclictest25783-21kworker/3:1+events11:40:223
12619910191017,2cyclictest21652-21kworker/3:2+events08:09:263
12619910191016,3cyclictest4324-21kworker/3:1+events10:58:293
12619910191016,3cyclictest13490-21kworker/3:2+events09:05:213
12619910181016,2cyclictest5278-21kworker/3:2+events08:42:213
12619910181016,2cyclictest3799-21kworker/3:2+events09:34:113
12619910171015,2cyclictest3799-21kworker/3:2+events10:41:493
12619910171015,2cyclictest15500-21kworker/3:0+events07:47:573
12619910151013,2cyclictest21012-21kworker/3:0+events11:47:323
12619910151012,3cyclictest10911-21kworker/3:0+events07:34:503
12499910151013,2cyclictest21852-21turbostat08:04:551
12619910141012,2cyclictest9391-21kworker/3:1+events08:53:193
12499910101008,2cyclictest14380-21turbostat12:39:551
12619910091003,3cyclictest7238-21kworker/3:1+events07:40:233
12619910081006,2cyclictest19606-21kworker/3:1+events07:55:523
12619910081006,2cyclictest15500-21kworker/3:0+events07:50:223
12619910071005,2cyclictest15786-21kworker/3:0+events10:52:543
12619910071004,2cyclictest19606-21kworker/3:1+events08:01:293
12619910071003,2cyclictest29868-21kworker/3:1+events08:20:223
124799997995,2cyclictest18508-21turbostat11:34:540
124999993992,1cyclictest17701-21kworker/1:0+events09:22:131
124799993992,1cyclictest3293-21kworker/0:2+events11:21:040
124799993991,2cyclictest5233-21turbostat07:24:550
124799978975,3cyclictest3859-21turbostat09:34:550
126199975973,2cyclictest13900-21turbostat11:29:543
126199966963,3cyclictest22712-21turbostat09:54:553
124799961960,1cyclictest3293-21kworker/0:2+events11:15:440
124999960957,3cyclictest17937-21turbostat10:24:561
124799957956,1cyclictest3293-21kworker/0:2+events11:29:340
125399954952,2cyclictest27230-21kworker/2:0+events09:56:262
124799954952,2cyclictest14105-21turbostat12:04:540
124999950947,3cyclictest32163-21turbostat10:39:541
124799947946,1cyclictest27181-21kworker/0:1+events07:12:350
124799946945,1cyclictest27181-21kworker/0:1+events07:18:410
124999937935,2cyclictest20277-21kworker/1:1+events11:32:331
126199936934,2cyclictest8448-21turbostat09:39:553
124799920917,3cyclictest17818-21turbostat07:54:550
124999907906,1cyclictest7641-21turbostat08:49:551
124799887885,2cyclictest11672-21turbostat08:59:550
125399885884,1cyclictest21182-21kworker/2:2+events10:30:232
124999866863,3cyclictest19830-21turbostat07:59:551
124999666662,3cyclictest3859-21turbostat09:34:551
126199647644,3cyclictest32163-21turbostat10:39:553
124799632630,2cyclictest14380-21turbostat12:39:550
126199626624,2cyclictest18508-21turbostat11:34:553
126199623620,3cyclictest5233-21turbostat07:24:553
124999589585,4cyclictest13900-21turbostat11:29:541
125399586583,3cyclictest22712-21turbostat09:54:552
124999585584,1cyclictest15716-21turbostat09:09:551
124799570567,3cyclictest32450-21turbostat11:14:540
125399524523,1cyclictest9350-21turbostat12:34:552
1247992626,0cyclictest30679-21fwupd09:58:000
1249991918,1cyclictest67750irq/123-lan07:20:201
1249991818,0cyclictest67750irq/123-lan10:55:151
1249991817,1cyclictest67750irq/123-lan12:25:181
1249991817,1cyclictest67750irq/123-lan11:47:541
1249991817,1cyclictest67750irq/123-lan10:14:191
1249991817,1cyclictest67750irq/123-lan08:30:241
1249991717,0cyclictest67750irq/123-lan12:20:211
1249991717,0cyclictest67750irq/123-lan12:00:171
1249991717,0cyclictest67750irq/123-lan11:53:141
1249991717,0cyclictest67750irq/123-lan11:19:111
1249991717,0cyclictest67750irq/123-lan10:31:071
1249991717,0cyclictest67750irq/123-lan10:04:211
1249991717,0cyclictest67750irq/123-lan07:35:161
1249991716,1cyclictest67750irq/123-lan12:12:481
1249991716,1cyclictest67750irq/123-lan12:08:081
1249991716,1cyclictest67750irq/123-lan11:55:191
1249991716,1cyclictest67750irq/123-lan11:14:251
1249991716,1cyclictest67750irq/123-lan11:04:541
1249991716,1cyclictest67750irq/123-lan10:19:061
1249991716,1cyclictest67750irq/123-lan09:55:201
1249991716,1cyclictest67750irq/123-lan08:50:211
1249991616,0cyclictest67750irq/123-lan12:30:161
1249991616,0cyclictest67750irq/123-lan12:15:531
1249991616,0cyclictest67750irq/123-lan10:40:381
1249991616,0cyclictest67750irq/123-lan10:28:511
1249991616,0cyclictest67750irq/123-lan08:26:081
1249991615,1cyclictest67750irq/123-lan11:40:131
1249991615,1cyclictest67750irq/123-lan11:22:341
1249991615,1cyclictest67750irq/123-lan11:06:461
1249991615,1cyclictest67750irq/123-lan10:50:411
1249991615,1cyclictest67750irq/123-lan10:45:111
1249991615,1cyclictest67750irq/123-lan10:05:141
1249991615,1cyclictest67750irq/123-lan07:50:181
1249991615,1cyclictest67750irq/123-lan07:45:181
1249991615,1cyclictest67750irq/123-lan07:30:201
1249991615,1cyclictest67750irq/123-lan07:25:171
1249991515,0cyclictest67750irq/123-lan07:10:181
1249991514,1cyclictest67750irq/123-lan11:37:051
1249991514,1cyclictest67750irq/123-lan08:40:191
1249991514,1cyclictest67750irq/123-lan08:20:131
1249991514,1cyclictest67750irq/123-lan08:15:421
1249991414,0cyclictest67750irq/123-lan07:40:011
1249991414,0cyclictest67750irq/123-lan07:15:141
1249991312,1cyclictest67750irq/123-lan09:00:211
1249991312,1cyclictest67750irq/123-lan08:55:161
1249991312,1cyclictest67750irq/123-lan08:10:111
1249991212,0cyclictest67750irq/123-lan08:08:081
1249991211,1cyclictest67750irq/123-lan08:35:131
126199108,2cyclictest784-21snmpd09:56:083
126199108,2cyclictest782-21lldpd10:14:093
126199106,4cyclictest784-21snmpd07:13:113
126199105,2cyclictest784-21snmpd09:23:493
12619996,3cyclictest784-21snmpd11:22:173
12619994,2cyclictest784-21snmpd10:32:303
12619992,3cyclictest17472-21ssh10:19:173
12539998,1cyclictest784-21snmpd11:02:582
12539998,1cyclictest784-21snmpd10:40:062
12539998,1cyclictest784-21snmpd07:33:512
12539998,1cyclictest782-21lldpd11:50:462
12539998,1cyclictest782-21lldpd07:16:392
12539998,1cyclictest526-21avahi-daemon09:29:242
12479998,1cyclictest784-21snmpd12:34:230
12479998,1cyclictest784-21snmpd12:18:080
12479998,1cyclictest784-21snmpd09:24:070
12479998,1cyclictest784-21snmpd08:17:190
12479998,1cyclictest784-21snmpd07:43:450
12619988,0cyclictest782-21lldpd09:19:553
12619987,1cyclictest8895-21kworker/3:0+events_freezable_pwr_efficient12:38:253
12619986,2cyclictest784-21snmpd09:40:583
12619986,2cyclictest784-21snmpd09:40:583
12619983,3cyclictest23524-21df10:25:143
12539988,0cyclictest782-21lldpd09:32:552
12539988,0cyclictest782-21lldpd07:56:192
12539987,1cyclictest784-21snmpd11:44:592
12539987,1cyclictest782-21lldpd09:40:152
12539987,1cyclictest782-21lldpd09:40:152
12539987,1cyclictest15097-21ntp_kernel_pll_11:25:172
12539986,2cyclictest784-21snmpd10:56:532
12539986,2cyclictest784-21snmpd09:07:452
12539986,2cyclictest784-21snmpd08:37:502
12539986,2cyclictest784-21snmpd08:20:502
12479988,0cyclictest784-21snmpd12:22:340
12479988,0cyclictest784-21snmpd11:04:380
12479988,0cyclictest784-21snmpd08:37:020
12479988,0cyclictest782-21lldpd09:15:550
12479988,0cyclictest782-21lldpd08:07:460
12479987,1cyclictest784-21snmpd12:12:480
12479987,1cyclictest784-21snmpd09:05:390
12479987,1cyclictest784-21snmpd08:46:560
12479987,1cyclictest782-21lldpd11:48:530
12479987,1cyclictest16338-21fschecks_time07:45:150
12479986,2cyclictest784-21snmpd11:56:220
12479986,2cyclictest784-21snmpd08:02:550
12619977,0cyclictest784-21snmpd11:18:443
12619976,1cyclictest27268-21kworker/3:2+events_freezable_pwr_efficient07:19:543
12619972,2cyclictest2452-21ssh10:02:113
12619972,2cyclictest22466-21ssh10:24:093
12539977,0cyclictest784-21snmpd11:24:352
12539977,0cyclictest784-21snmpd08:10:042
12539977,0cyclictest784-21snmpd08:01:232
12539977,0cyclictest782-21lldpd11:12:122
12539977,0cyclictest782-21lldpd10:50:282
12539977,0cyclictest782-21lldpd09:18:262
12539977,0cyclictest782-21lldpd09:10:252
12539977,0cyclictest782-21lldpd07:38:472
12539976,1cyclictest784-21snmpd08:28:292
12539976,1cyclictest784-21snmpd07:40:032
12539976,1cyclictest782-21lldpd12:14:302
12539976,1cyclictest782-21lldpd11:57:442
12539976,1cyclictest526-21avahi-daemon11:48:302
12539976,1cyclictest507-21systemd-resolve11:32:222
12539975,2cyclictest784-21snmpd07:25:362
12539975,2cyclictest19574-21cat12:05:152
12479977,0cyclictest784-21snmpd11:39:000
12479977,0cyclictest784-21snmpd10:28:240
12479977,0cyclictest784-21snmpd08:25:410
12479977,0cyclictest784-21snmpd08:14:580
12479977,0cyclictest782-21lldpd12:07:090
12479977,0cyclictest782-21lldpd10:34:280
12479977,0cyclictest782-21lldpd09:36:580
12479976,1cyclictest782-21lldpd10:38:320
12479976,1cyclictest782-21lldpd10:10:370
12479976,1cyclictest526-21avahi-daemon11:44:280
12479975,2cyclictest784-21snmpd08:52:230
12479975,2cyclictest23514-21cat09:50:140
12539966,0cyclictest784-21snmpd09:03:002
12539966,0cyclictest782-21lldpd08:16:582
12539965,1cyclictest784-21snmpd08:08:582
12539965,1cyclictest593-21gmain11:08:372
12539964,2cyclictest784-21snmpd09:48:172
12539964,2cyclictest784-21snmpd09:48:162
12539963,2cyclictest8811-21dpkg09:35:122
12539963,2cyclictest7461-21ssh12:26:502
12539962,3cyclictest32211-21ssh12:19:312
12539962,3cyclictest245-20systemd-journal11:16:122
12479966,0cyclictest784-21snmpd11:52:480
12479966,0cyclictest784-21snmpd08:21:380
12479966,0cyclictest782-21lldpd08:33:520
12479965,1cyclictest784-21snmpd07:55:070
12479965,1cyclictest526-21avahi-daemon07:33:300
12479965,1cyclictest526-21avahi-daemon07:28:460
12479964,2cyclictest784-21snmpd08:43:060
12479964,2cyclictest19198-21cat10:20:130
12479963,3cyclictest547-21NetworkManager11:06:430
12479962,3cyclictest6577-21users12:25:210
12479962,3cyclictest20682-21ssh10:56:280
12479962,3cyclictest15216-21ssh09:40:520
12479962,3cyclictest15216-21ssh09:40:520
12479961,5cyclictest547-21NetworkManager10:43:160
12619953,2cyclictest19926-21ssh09:10:583
12619952,2cyclictest20567-21ssh09:46:273
12619952,2cyclictest20567-21ssh09:46:263
12539955,0cyclictest784-21snmpd12:00:032
12539954,1cyclictest5583-21cpuspeed_turbos07:20:122
12539953,2cyclictest784-21snmpd08:44:142
12539953,2cyclictest18509-21cat07:50:142
12539953,2cyclictest12162-21ssh10:47:342
12539952,2cyclictest26318-21ssh11:37:442
12539952,2cyclictest1029-21irqstats12:20:152
12539951,3cyclictest9687-21ls08:50:002
12479955,0cyclictest782-21lldpd09:27:410
12479954,1cyclictest526-21avahi-daemon09:10:320
12479954,1cyclictest32670-21gltestperf10:00:140
12479953,2cyclictest547-21NetworkManager10:45:510
12479952,2cyclictest6064-21ssh10:05:300
12479952,2cyclictest574-21rs:main0
12479952,2cyclictest574-21rs:main0
12479952,2cyclictest245-20systemd-journal07:36:000
12479952,2cyclictest16062-21ssh10:16:540
12479952,0cyclictest14729-21ssh10:50:170
12539942,2cyclictest784-21snmpd08:51:052
12539942,2cyclictest16074-21apt-get07:45:122
12539941,2cyclictest27894-21if_lan09:20:142
12539941,2cyclictest12221-21cat08:55:142
12539940,4cyclictest0-21swapper/207:10:212
12539940,3cyclictest1800-21runrttasks08:30:022
12479940,3cyclictest14520-21memory09:00:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional