You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 00:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Sep 16, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
174409910511050,1cyclictest9042-21kworker/3:0+events09:25:233
174409910511048,2cyclictest2913-21kworker/3:1+events11:45:213
174319910501049,1cyclictest8961-21kworker/1:2+events08:11:511
174259910501047,2cyclictest19813-21kworker/0:0+events10:13:170
174259910481046,2cyclictest13223-21kworker/0:1+events11:20:330
174409910471046,1cyclictest13853-21kworker/3:2+events09:38:153
174319910461043,2cyclictest19635-21kworker/1:1+events12:37:321
174259910461045,1cyclictest27080-21kworker/0:1+events07:36:150
174319910441043,1cyclictest5006-21kworker/1:0+events12:15:451
174319910431040,3cyclictest10172-21turbostat09:59:541
174409910351034,1cyclictest13259-21kworker/3:0+events08:26:053
174409910341033,1cyclictest2913-21kworker/3:1+events11:42:173
174389910311029,2cyclictest2378-21turbostat09:14:552
174319910281026,2cyclictest27170-21kworker/1:1+events12:08:081
174389910271024,3cyclictest4746-21turbostat10:29:552
174319910261024,2cyclictest19335-21kworker/1:1+events07:18:361
174409910251024,1cyclictest13853-21kworker/3:2+events09:43:163
174409910231021,2cyclictest12890-21turbostat11:14:563
174259910221021,1cyclictest27080-21kworker/0:1+events08:49:470
174319910191015,4cyclictest26563-21turbostat11:29:551
174409910181017,1cyclictest21370-21kworker/3:2+events08:38:283
174319910181016,2cyclictest4845-21kworker/1:0+events08:00:451
174409910171016,1cyclictest5119-21kworker/3:1+events10:36:373
174319910171015,2cyclictest27170-21kworker/1:1+events12:01:261
174319910161014,2cyclictest27170-21kworker/1:1+events12:12:551
174409910151013,2cyclictest4054-21turbostat11:04:563
174319910151014,1cyclictest16571-21kworker/1:1+events11:53:401
174319910151013,2cyclictest17237-21kworker/1:0+events07:13:261
174319910151013,2cyclictest13058-21kworker/1:2+events08:59:331
174319910141013,1cyclictest29594-21kworker/1:1+events10:51:491
174319910141012,2cyclictest29594-21kworker/1:1+events10:55:441
174259910121010,2cyclictest19813-21kworker/0:0+events10:07:540
174409910091007,2cyclictest26266-21turbostat08:54:553
174259910091007,2cyclictest23295-21turbostat10:49:560
174319910051003,2cyclictest14372-21kworker/1:2+events12:30:231
174319910041002,2cyclictest22537-21kworker/1:0+events11:56:491
174319910041000,4cyclictest23623-21kworker/1:2+events10:45:451
174409910031002,1cyclictest9674-21kworker/3:0+events09:57:583
174409910031002,1cyclictest2913-21kworker/3:1+events11:36:473
174319910031001,2cyclictest19335-21kworker/1:1+events07:54:451
174319910031000,3cyclictest5006-21kworker/1:0+events12:28:181
17440991002999,3cyclictest8487-21turbostat11:09:563
174409910021001,1cyclictest9042-21kworker/3:0+events09:20:213
174409910021001,1cyclictest21370-21kworker/3:2+events09:00:213
174259910021000,2cyclictest15316-21turbostat08:29:540
174409910011000,1cyclictest5119-21kworker/3:1+events10:03:373
17431991001998,2cyclictest4845-21kworker/1:0+events08:05:221
17431991001997,2cyclictest19335-21kworker/1:1+events08:15:211
17425991000999,1cyclictest30443-21kworker/0:1+events10:27:540
1744099999998,1cyclictest13259-21kworker/3:0+events08:20:433
1743199999997,2cyclictest4845-21kworker/1:0+events07:59:341
1744099998997,1cyclictest8012-21kworker/3:1+events07:21:373
1744099998997,1cyclictest13853-21kworker/3:2+events09:51:053
1744099997996,1cyclictest9508-21kworker/3:2+events10:31:283
1744099997996,1cyclictest9042-21kworker/3:0+events09:34:543
1744099997996,1cyclictest13259-21kworker/3:0+events08:30:423
1743199997996,1cyclictest5006-21kworker/1:0+events12:20:441
1742599997995,2cyclictest19813-21kworker/0:0+events10:15:420
1744099994993,1cyclictest14808-21kworker/3:0+events10:44:133
1743899994993,1cyclictest22475-21kworker/2:1+events11:31:042
1744099992991,1cyclictest13853-21kworker/3:2+events09:49:323
1744099992990,1cyclictest30696-21kworker/3:1+events09:05:213
1742599992990,2cyclictest18828-21turbostat10:44:550
1744099989988,1cyclictest9042-21kworker/3:0+events09:19:243
1744099988987,1cyclictest4307-21kworker/3:2+events09:11:043
1742599988986,2cyclictest13223-21kworker/0:1+events11:11:140
1743899987987,0cyclictest13497-21kworker/2:2+events08:42:432
1742599987986,1cyclictest24487-21kworker/0:2+events10:22:560
1742599986985,1cyclictest13223-21kworker/0:1+events11:25:210
1744099970968,2cyclictest27454-21turbostat07:39:553
1744099966964,2cyclictest21802-21turbostat08:44:543
1742599965964,1cyclictest23660-21kworker/0:0+events07:26:260
1742599964961,3cyclictest16221-21turbostat11:54:550
1742599962961,1cyclictest27080-21kworker/0:1+events07:42:340
1742599959958,1cyclictest27080-21kworker/0:1+events08:53:290
1744099957954,3cyclictest3188-21turbostat07:59:553
1742599936934,2cyclictest23660-21kworker/0:0+events07:30:200
1743899930926,4cyclictest11270-21turbostat08:19:552
1744099928925,3cyclictest21703-21turbostat11:24:563
1744099911909,2cyclictest31562-21turbostat07:49:543
1744099908906,2cyclictest29456-21turbostat12:09:553
1743899908906,2cyclictest32052-21turbostat10:59:562
1742599896895,1cyclictest915-21kworker/0:0+events07:49:370
1742599895894,1cyclictest13223-21kworker/0:1+events11:18:250
1742599891889,2cyclictest28712-21turbostat08:59:550
1744099686685,1cyclictest11270-21turbostat08:19:553
1743199685683,2cyclictest31562-21turbostat07:49:551
1744099671666,4cyclictest32052-21turbostat10:59:563
1742599656652,4cyclictest8487-21turbostat11:09:560
1743899655653,2cyclictest19786-21turbostat08:39:552
1742599639637,2cyclictest15007-21turbostat10:04:550
1742599619616,3cyclictest21802-21turbostat08:44:550
1744099585584,1cyclictest4746-21turbostat10:29:553
1743199583580,3cyclictest26266-21turbostat08:54:551
1742599550547,3cyclictest21410-21turbostat07:24:550
1744099549546,3cyclictest28712-21turbostat08:59:553
1743899549546,3cyclictest26563-21turbostat11:29:542
1743899547545,2cyclictest23466-21turbostat12:39:552
1743199528526,2cyclictest11822-21turbostat11:49:541
1744099498497,1cyclictest30964-21turbostat11:34:553
1744099447445,2cyclictest19385-21turbostat07:19:553
1743199365364,1cyclictest18828-21turbostat10:44:551
17438992910,290cyclictest29787-21acpi07:40:112
17431992018,2cyclictest67750irq/123-lan11:11:301
17431991918,1cyclictest67750irq/123-lan10:25:141
17431991918,1cyclictest67750irq/123-lan09:44:061
17431991918,1cyclictest67750irq/123-lan07:35:141
17431991917,2cyclictest67750irq/123-lan11:40:171
17431991917,2cyclictest67750irq/123-lan10:00:121
17431991818,0cyclictest67750irq/123-lan11:31:581
17431991818,0cyclictest67750irq/123-lan10:30:581
17431991818,0cyclictest67750irq/123-lan09:50:151
17431991818,0cyclictest67750irq/123-lan09:15:191
17431991817,1cyclictest67750irq/123-lan11:00:141
17431991817,1cyclictest67750irq/123-lan10:11:491
17431991817,1cyclictest67750irq/123-lan09:35:181
17431991817,1cyclictest67750irq/123-lan09:25:181
17431991816,2cyclictest67750irq/123-lan11:20:011
17431991816,2cyclictest67750irq/123-lan11:17:131
17431991816,2cyclictest67750irq/123-lan07:25:181
17431991717,0cyclictest67750irq/123-lan11:09:181
17431991717,0cyclictest67750irq/123-lan07:44:211
17431991716,1cyclictest67750irq/123-lan10:20:551
17431991716,1cyclictest67750irq/123-lan10:16:481
17431991716,1cyclictest67750irq/123-lan10:05:131
17431991716,1cyclictest67750irq/123-lan09:05:121
17431991716,1cyclictest67750irq/123-lan08:45:201
17431991715,2cyclictest67750irq/123-lan09:20:221
17431991616,0cyclictest67750irq/123-lan09:11:431
17431991615,1cyclictest67750irq/123-lan11:35:151
17431991615,1cyclictest67750irq/123-lan09:31:291
17431991615,1cyclictest67750irq/123-lan09:00:121
17431991614,2cyclictest67750irq/123-lan09:48:471
17431991514,1cyclictest67750irq/123-lan10:35:171
17431991514,1cyclictest67750irq/123-lan08:40:221
17431991514,1cyclictest67750irq/123-lan08:20:141
17431991514,1cyclictest67750irq/123-lan07:30:181
17431991413,1cyclictest67750irq/123-lan08:35:221
17431991413,1cyclictest67750irq/123-lan08:25:131
17440991313,0cyclictest784-21snmpd10:46:393
17440991212,0cyclictest784-21snmpd11:18:163
17440991212,0cyclictest784-21snmpd10:17:083
17440991212,0cyclictest784-21snmpd10:13:353
17440991111,0cyclictest784-21snmpd08:11:203
17440991111,0cyclictest21426-21cat11:55:123
1743199109,1cyclictest67750irq/123-lan07:20:151
174409998,1cyclictest13748-21kworker/3:0+events12:10:443
174389998,1cyclictest784-21snmpd12:17:512
174259998,1cyclictest782-21lldpd12:28:510
174409987,1cyclictest26528-21ntp_offset07:30:173
174409986,2cyclictest762-21ntpd12:18:113
174409986,2cyclictest762-21ntpd08:45:043
174409986,2cyclictest762-21ntpd07:14:343
174389988,0cyclictest784-21snmpd10:17:462
174389988,0cyclictest784-21snmpd09:27:522
174389988,0cyclictest784-21snmpd07:48:092
174389988,0cyclictest782-21lldpd12:05:272
174389988,0cyclictest782-21lldpd11:04:042
174389988,0cyclictest782-21lldpd10:24:522
174389988,0cyclictest782-21lldpd09:35:012
174389988,0cyclictest782-21lldpd08:11:502
174389988,0cyclictest782-21lldpd07:51:422
174389987,1cyclictest784-21snmpd07:26:182
174389987,1cyclictest526-21avahi-daemon10:02:582
174389986,2cyclictest784-21snmpd09:52:472
174389986,2cyclictest762-21ntpd11:08:282
174389986,2cyclictest762-21ntpd10:33:182
174389986,2cyclictest762-21ntpd09:47:532
174259988,0cyclictest784-21snmpd10:54:180
174259988,0cyclictest784-21snmpd10:32:270
174259988,0cyclictest782-21lldpd09:07:150
174259988,0cyclictest782-21lldpd08:05:350
174259987,1cyclictest784-21snmpd09:38:070
174259987,1cyclictest784-21snmpd08:21:050
174259987,1cyclictest782-21lldpd11:58:310
174259986,2cyclictest784-21snmpd09:24:210
174259986,2cyclictest784-21snmpd08:38:230
174259985,3cyclictest547-21NetworkManager10:38:000
174409977,0cyclictest782-21lldpd12:24:353
174409975,2cyclictest762-21ntpd08:05:053
174409975,2cyclictest762-21ntpd08:01:343
174389977,0cyclictest784-21snmpd11:55:232
174389977,0cyclictest784-21snmpd09:21:332
174389977,0cyclictest784-21snmpd08:50:062
174389977,0cyclictest784-21snmpd08:02:102
174389977,0cyclictest784-21snmpd07:30:292
174389977,0cyclictest782-21lldpd12:14:352
174389977,0cyclictest782-21lldpd09:40:092
174389977,0cyclictest782-21lldpd08:21:222
174389977,0cyclictest782-21lldpd07:36:592
174389977,0cyclictest20254-21cat10:05:132
174389976,1cyclictest784-21snmpd11:50:112
174389976,1cyclictest784-21snmpd09:03:202
174389976,1cyclictest762-21ntpd11:39:272
174389976,1cyclictest762-21ntpd10:11:182
174389976,1cyclictest526-21avahi-daemon08:56:492
174389975,2cyclictest784-21snmpd11:43:322
174389975,2cyclictest784-21snmpd10:45:542
174389975,2cyclictest762-21ntpd09:05:152
174389973,3cyclictest22894-21ssh09:32:082
174319970,3cyclictest18177-21df08:30:101
174259977,0cyclictest784-21snmpd09:19:490
174259977,0cyclictest784-21snmpd09:01:330
174259977,0cyclictest784-21snmpd07:17:440
174259977,0cyclictest782-21lldpd11:30:580
174259977,0cyclictest782-21lldpd07:59:400
174259977,0cyclictest782-21lldpd07:11:360
174259976,1cyclictest784-21snmpd09:48:250
174259976,1cyclictest782-21lldpd12:12:070
174259976,1cyclictest526-21avahi-daemon11:41:080
174259976,1cyclictest526-21avahi-daemon09:25:040
174259975,2cyclictest784-21snmpd11:02:370
174259975,2cyclictest784-21snmpd09:59:530
174259975,2cyclictest784-21snmpd08:16:140
174259975,2cyclictest784-21snmpd08:10:160
174259975,2cyclictest784-21snmpd08:03:280
174259975,2cyclictest12645-21cat11:45:140
174409966,0cyclictest784-21snmpd12:36:253
174409965,1cyclictest31553-21dump-pmu-power07:45:003
174409964,2cyclictest784-21snmpd07:50:193
174409964,2cyclictest784-21snmpd07:26:423
174409963,3cyclictest547-21NetworkManager11:52:183
174409962,3cyclictest26274-21ntpq12:00:153
174409962,3cyclictest22432-21ssh12:33:093
174389966,0cyclictest784-21snmpd10:40:092
174389966,0cyclictest784-21snmpd08:30:412
174389966,0cyclictest784-21snmpd07:58:132
174389966,0cyclictest784-21snmpd07:15:122
174389966,0cyclictest784-21snmpd07:11:112
174389966,0cyclictest782-21lldpd10:36:022
174389966,0cyclictest782-21lldpd08:26:072
174389966,0cyclictest782-21lldpd08:08:092
174389966,0cyclictest28466-21cat10:50:122
174389966,0cyclictest13684-21cat11:10:142
174389965,1cyclictest762-21ntpd09:55:282
174389965,1cyclictest20153-21needreboot12:30:152
174389965,1cyclictest13016-21ntp_kernel_pll_11:45:172
174389964,2cyclictest784-21snmpd12:22:542
174389964,2cyclictest784-21snmpd09:18:582
174389964,2cyclictest784-21snmpd07:22:542
174259966,0cyclictest784-21snmpd08:30:110
174259966,0cyclictest782-21lldpd12:37:010
174259966,0cyclictest782-21lldpd12:09:530
174259966,0cyclictest526-21avahi-daemon09:14:080
174259965,1cyclictest784-21snmpd12:21:330
174259963,3cyclictest784-21snmpd11:36:080
174259963,2cyclictest8538-21ssh09:52:060
174259963,2cyclictest22053-21ssh12:32:260
174409954,1cyclictest14808-21kworker/3:0+events10:51:023
174409954,1cyclictest13748-21kworker/3:0+events12:25:463
174409952,3cyclictest20108-21fw_forwarded_lo10:05:133
174409952,2cyclictest2361-21rm10:20:483
174409950,3cyclictest27275-21tail11:25:133
174389955,0cyclictest15520-21cat12:25:132
174389953,2cyclictest0-21swapper/212:05:002
174389952,2cyclictest245-20systemd-journal08:47:182
174389950,4cyclictest17574-21ssh11:15:102
174389950,3cyclictest22015-21gpg-connect-age11:20:012
174259954,1cyclictest845-21ntpq10:55:170
174259954,1cyclictest782-21lldpd07:52:180
174259953,2cyclictest547-21NetworkManager12:01:060
174259952,2cyclictest962-21ssh09:44:590
174259952,2cyclictest6708-21ssh12:15:160
174259950,5cyclictest0-21swapper/009:30:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional