You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-06 - 23:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot6s.osadl.org (updated Fri Nov 06, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
162479910551051,2cyclictest1333-21kworker/0:0+events09:16:050
162479910531049,3cyclictest1333-21kworker/0:0+events09:14:210
162479910521050,2cyclictest8536-21kworker/0:0+events10:56:050
162479910521050,2cyclictest25691-21kworker/0:1+events09:25:210
162479910521050,2cyclictest15925-21kworker/0:0+events07:18:250
162479910521049,3cyclictest7658-21kworker/0:0+events10:05:420
162479910511049,2cyclictest30037-21kworker/0:1+events11:28:020
162479910511049,2cyclictest15925-21kworker/0:0+events07:20:420
162479910511048,3cyclictest19113-21kworker/0:0+events07:32:140
162479910511048,3cyclictest16615-21kworker/0:1+events10:11:070
162479910511048,3cyclictest1333-21kworker/0:0+events09:32:310
162479910501049,1cyclictest25691-21kworker/0:1+events09:21:080
162479910501048,2cyclictest8536-21kworker/0:0+events10:53:140
162479910501048,2cyclictest30037-21kworker/0:1+events11:21:150
162479910501048,2cyclictest19113-21kworker/0:0+events08:10:220
162479910501047,3cyclictest25161-21kworker/0:0+events10:30:460
162479910491047,2cyclictest25691-21kworker/0:1+events08:18:440
162479910491047,2cyclictest16615-21kworker/0:1+events09:36:300
162599910481045,3cyclictest29729-21kworker/2:1+events08:50:212
162479910481046,2cyclictest5221-21kworker/0:2+events11:36:480
162479910481045,3cyclictest30037-21kworker/0:1+events11:33:490
162479910481045,3cyclictest28891-21kworker/0:2+events10:40:440
162479910471046,1cyclictest22003-21kworker/0:2+events11:17:180
162479910471045,2cyclictest28891-21kworker/0:2+events10:37:330
162599910461044,2cyclictest5837-21kworker/2:0+events12:36:462
162599910451042,3cyclictest29729-21kworker/2:1+events09:05:442
162599910451042,3cyclictest14122-21turbostat12:34:552
162479910451043,2cyclictest4559-21kworker/0:1+events11:11:050
162479910451043,2cyclictest17319-21kworker/0:1+events07:27:540
162479910451042,3cyclictest19938-21kworker/0:2+events07:10:210
162649910441043,1cyclictest26076-21kworker/3:2+events08:36:373
162599910441042,2cyclictest29729-21kworker/2:1+events09:04:512
162479910441041,3cyclictest25161-21kworker/0:0+events10:45:230
162599910391036,3cyclictest29729-21kworker/2:1+events08:58:422
162649910311030,1cyclictest18356-21kworker/3:0+events11:53:033
162599910311029,2cyclictest29729-21kworker/2:1+events08:45:442
162649910301029,1cyclictest21876-21kworker/3:2+events07:55:453
162649910271026,1cyclictest32686-21kworker/3:2+events12:14:323
162649910271026,1cyclictest22647-21kworker/3:2+events09:45:213
162559910261025,1cyclictest21764-21kworker/1:1+events11:57:431
162559910231022,1cyclictest23486-21kworker/1:1+events08:07:111
162649910161016,0cyclictest11763-21kworker/3:1+events12:30:443
162649910161015,1cyclictest18356-21kworker/3:0+events11:48:043
162649910151015,0cyclictest4028-21kworker/3:1+events12:16:053
162649910121011,1cyclictest18356-21kworker/3:0+events11:43:063
162649910111010,1cyclictest19803-21kworker/3:1+events07:45:423
162649910091008,1cyclictest26991-21kworker/3:0+events08:29:263
162649910091008,1cyclictest22647-21kworker/3:2+events09:44:233
162649910091007,2cyclictest32739-21turbostat09:09:553
162649910071007,0cyclictest28382-21kworker/3:0+events12:24:203
162649910061005,1cyclictest32064-21kworker/3:1+events09:59:473
162649910051004,1cyclictest29103-21turbostat08:44:553
162649910051004,1cyclictest14210-21kworker/3:2+events11:04:433
162649910031003,0cyclictest28382-21kworker/3:0+events12:07:533
162649910031002,1cyclictest32064-21kworker/3:1+events10:02:573
162649910031002,1cyclictest26991-21kworker/3:0+events08:30:233
162649910031002,1cyclictest23223-21kworker/3:1+events08:24:013
162649910031002,1cyclictest18356-21kworker/3:0+events11:05:443
16264991002999,3cyclictest21314-21turbostat10:29:563
162649910011000,1cyclictest19803-21kworker/3:1+events07:36:303
1626499995994,1cyclictest7864-21kworker/3:2+events12:25:223
1626499995994,1cyclictest13991-21kworker/3:0+events07:40:453
1626499994994,0cyclictest28749-21kworker/3:0+events09:53:493
1625599991990,1cyclictest21764-21kworker/1:1+events12:03:401
1625599991990,1cyclictest14274-21kworker/1:0+events10:22:441
1626499989988,1cyclictest22545-21kworker/3:0+events07:51:293
1625999987985,2cyclictest3451-21turbostat12:19:552
1625599965964,1cyclictest23486-21kworker/1:1+events10:19:311
1626499958956,1cyclictest10863-21turbostat10:14:563
1626499957955,2cyclictest986-21turbostat09:14:553
1625599955954,1cyclictest23486-21kworker/1:1+events10:29:361
1625599955954,1cyclictest23486-21kworker/1:1+events08:02:441
1624799946944,2cyclictest28453-21turbostat12:09:550
1626499942940,2cyclictest24181-21turbostat08:09:553
1626499938935,3cyclictest4506-21turbostat09:19:563
1624799931928,3cyclictest17914-21turbostat11:54:550
1624799922920,2cyclictest22261-21turbostat09:44:560
1626499913910,3cyclictest24904-21turbostat12:04:553
1624799910907,3cyclictest25775-21turbostat09:49:550
1626499906902,4cyclictest6989-21turbostat10:54:553
1626499872869,3cyclictest16137-21turbostat07:14:563
1625599694691,3cyclictest22870-21turbostat07:59:551
1625599668663,4cyclictest10863-21turbostat10:14:561
1624799663660,3cyclictest18005-21turbostat11:09:540
1626499625622,3cyclictest18794-21turbostat09:39:563
1624799617615,2cyclictest32739-21turbostat09:09:560
1626499612610,2cyclictest19191-21turbostat07:34:553
1625999612609,3cyclictest29103-21turbostat08:44:552
1624799608607,1cyclictest21314-21turbostat10:29:560
1626499555554,1cyclictest25452-21turbostat08:19:563
1624799551548,3cyclictest24181-21turbostat08:09:550
1624799535532,3cyclictest3800-21turbostat10:04:550
1626499506503,3cyclictest7280-21turbostat11:39:543
1626499497497,0cyclictest10585-21turbostat10:59:553
1625599383381,2cyclictest17914-21turbostat11:54:551
16259992727,0cyclictest24108-21fwupd08:04:232
16247991918,1cyclictest67350irq/124-lan12:13:410
16247991918,1cyclictest67350irq/124-lan11:55:010
16247991817,1cyclictest67350irq/124-lan09:55:010
16247991717,0cyclictest67350irq/124-lan12:35:040
16247991717,0cyclictest67350irq/124-lan11:46:570
16247991716,1cyclictest67350irq/124-lan12:24:010
16247991716,1cyclictest67350irq/124-lan11:01:190
16247991716,1cyclictest67350irq/124-lan10:24:310
16247991716,1cyclictest67350irq/124-lan10:15:330
16247991716,1cyclictest67350irq/124-lan08:37:360
16247991716,1cyclictest67350irq/124-lan07:54:230
16264991616,0cyclictest780-21snmpd10:47:383
16247991616,0cyclictest67350irq/124-lan12:30:370
16247991616,0cyclictest67350irq/124-lan12:00:430
16247991616,0cyclictest67350irq/124-lan11:40:050
16247991616,0cyclictest67350irq/124-lan09:52:040
16247991616,0cyclictest67350irq/124-lan07:45:030
16247991615,1cyclictest67350irq/124-lan12:25:130
16247991615,1cyclictest67350irq/124-lan12:18:090
16247991615,1cyclictest67350irq/124-lan08:33:460
16264991515,0cyclictest780-21snmpd11:25:383
16264991515,0cyclictest780-21snmpd09:31:303
16264991515,0cyclictest780-21snmpd08:47:293
16264991515,0cyclictest780-21snmpd07:21:253
16264991515,0cyclictest780-21snmpd07:16:343
16247991514,1cyclictest67350irq/124-lan09:00:000
16264991414,0cyclictest780-21snmpd11:18:403
16264991414,0cyclictest780-21snmpd09:01:243
16264991414,0cyclictest780-21snmpd08:50:493
16247991414,0cyclictest67350irq/124-lan08:04:050
16264991313,0cyclictest780-21snmpd11:10:343
16264991313,0cyclictest780-21snmpd09:21:333
16259991311,2cyclictest4506-21turbostat09:19:562
16247991312,1cyclictest67350irq/124-lan08:50:240
16247991212,0cyclictest67350irq/124-lan08:23:240
16247991110,1cyclictest67350irq/124-lan08:49:230
16247991110,1cyclictest67350irq/124-lan07:56:230
16247991010,0cyclictest67350irq/124-lan07:40:000
162599998,1cyclictest780-21snmpd09:45:242
162479998,1cyclictest780-21snmpd07:37:260
162649988,0cyclictest778-21lldpd10:07:213
162649987,1cyclictest520-21avahi-daemon11:32:273
162649987,1cyclictest496-21systemd-resolve11:23:443
162599988,0cyclictest780-21snmpd11:36:012
162599988,0cyclictest780-21snmpd09:55:072
162599988,0cyclictest778-21lldpd12:02:362
162599988,0cyclictest778-21lldpd11:57:232
162599988,0cyclictest778-21lldpd11:26:322
162599988,0cyclictest778-21lldpd10:46:202
162599988,0cyclictest778-21lldpd10:27:372
162599988,0cyclictest778-21lldpd08:31:592
162599987,1cyclictest780-21snmpd07:30:562
162599987,1cyclictest496-21systemd-resolve09:30:242
162599986,2cyclictest780-21snmpd11:04:362
162599986,2cyclictest780-21snmpd10:51:232
162559988,0cyclictest780-21snmpd12:35:281
162559988,0cyclictest780-21snmpd11:46:351
162559988,0cyclictest780-21snmpd11:17:311
162559988,0cyclictest780-21snmpd10:39:471
162559988,0cyclictest780-21snmpd10:06:281
162559988,0cyclictest780-21snmpd08:14:001
162559988,0cyclictest780-21snmpd07:35:261
162559988,0cyclictest778-21lldpd11:10:121
162559988,0cyclictest778-21lldpd10:53:081
162559988,0cyclictest778-21lldpd08:49:221
162559987,1cyclictest780-21snmpd09:19:381
162559987,1cyclictest780-21snmpd07:21:431
162559987,1cyclictest778-21lldpd09:45:471
162559987,1cyclictest520-21avahi-daemon08:15:021
162559987,1cyclictest496-21systemd-resolve12:31:581
162559986,2cyclictest780-21snmpd12:23:401
162559986,2cyclictest780-21snmpd11:08:361
162479988,0cyclictest780-21snmpd08:41:190
162649977,0cyclictest778-21lldpd10:40:433
162649977,0cyclictest778-21lldpd10:17:163
162649977,0cyclictest778-21lldpd08:56:173
162649977,0cyclictest778-21lldpd07:28:093
162649976,1cyclictest780-21snmpd12:36:163
162649975,2cyclictest780-21snmpd08:02:073
162599977,0cyclictest780-21snmpd10:32:292
162599977,0cyclictest780-21snmpd10:17:102
162599977,0cyclictest778-21lldpd12:21:312
162599977,0cyclictest778-21lldpd11:54:072
162599977,0cyclictest778-21lldpd11:31:062
162599977,0cyclictest778-21lldpd11:23:012
162599977,0cyclictest778-21lldpd10:03:262
162599977,0cyclictest778-21lldpd09:25:292
162599977,0cyclictest520-21avahi-daemon10:11:522
162599976,1cyclictest778-21lldpd09:39:342
162599975,2cyclictest780-21snmpd07:16:402
162599974,3cyclictest496-21systemd-resolve12:08:082
162559977,0cyclictest780-21snmpd10:41:091
162559977,0cyclictest780-21snmpd08:39:341
162559975,2cyclictest780-21snmpd10:32:261
162649966,0cyclictest780-21snmpd08:11:303
162649965,1cyclictest561-21in:imuxsock10:38:383
162649962,3cyclictest27762-21ssh10:34:113
162649962,3cyclictest21872-21ssh11:55:233
162649962,3cyclictest18978-21ssh10:21:283
162599966,0cyclictest780-21snmpd12:10:232
162599966,0cyclictest780-21snmpd11:11:522
162599966,0cyclictest780-21snmpd08:17:102
162599966,0cyclictest780-21snmpd07:27:172
162599966,0cyclictest778-21lldpd11:41:102
162599966,0cyclictest778-21lldpd10:44:472
162599966,0cyclictest778-21lldpd08:09:202
162599966,0cyclictest520-21avahi-daemon07:54:292
162599965,1cyclictest780-21snmpd10:35:382
162599965,1cyclictest780-21snmpd09:14:172
162599965,1cyclictest520-21avahi-daemon09:43:042
162559966,0cyclictest780-21snmpd11:25:431
162559966,0cyclictest778-21lldpd12:05:251
162559966,0cyclictest778-21lldpd11:20:391
162559966,0cyclictest778-21lldpd08:32:231
162559966,0cyclictest520-21avahi-daemon09:10:561
162559965,1cyclictest780-21snmpd07:43:141
162559965,1cyclictest520-21avahi-daemon10:45:331
162559965,1cyclictest520-21avahi-daemon09:23:271
162559964,2cyclictest780-21snmpd09:05:061
162559964,2cyclictest780-21snmpd09:00:331
162559963,3cyclictest546-21NetworkManager11:30:111
162559963,2cyclictest6656-21ssh10:04:011
162649952,2cyclictest13335-21ssh09:26:533
162599955,0cyclictest778-21lldpd10:06:572
162599955,0cyclictest520-21avahi-daemon08:14:272
162599954,1cyclictest520-21avahi-daemon11:05:242
162599953,2cyclictest780-21snmpd08:23:242
162599953,2cyclictest780-21snmpd07:56:502
162599953,2cyclictest780-21snmpd07:47:592
162599953,2cyclictest780-21snmpd07:35:172
162599953,2cyclictest546-21NetworkManager10:55:082
162599952,2cyclictest563-21rs:main2
162599952,2cyclictest28282-21rm11:19:182
162599952,2cyclictest18142-21ssh10:20:092
162599952,2cyclictest14760-21ssh11:45:152
162599952,2cyclictest12233-21ssh12:27:102
162599952,2cyclictest10448-21ssh09:22:482
162599951,3cyclictest16859-21cat07:15:012
162559955,0cyclictest780-21snmpd08:53:261
162559955,0cyclictest780-21snmpd07:46:271
162559955,0cyclictest778-21lldpd08:27:181
162559955,0cyclictest520-21avahi-daemon09:40:131
162559954,1cyclictest780-21snmpd11:40:491
162559954,1cyclictest520-21avahi-daemon09:56:021
162559954,1cyclictest520-21avahi-daemon07:10:111
162559954,1cyclictest331ktimers/111:04:581
162559953,2cyclictest780-21snmpd09:52:191
162559953,2cyclictest546-21NetworkManager12:26:371
162559952,3cyclictest537-21systemd-logind09:25:481
162559952,3cyclictest276-21systemd-udevd11:35:481
162559952,2cyclictest21689-21sh09:39:101
162559951,3cyclictest6545-21ssh12:19:191
162559950,4cyclictest243-20systemd-journal08:22:551
162479954,1cyclictest67350irq/124-lan08:26:180
162479953,2cyclictest780-21snmpd08:58:280
162599944,0cyclictest520-21avahi-daemon07:20:022
162599942,2cyclictest563-21rs:main2
162599941,3cyclictest546-21NetworkManager09:50:022
162599941,3cyclictest546-21NetworkManager07:42:502
162559944,0cyclictest520-21avahi-daemon07:15:381
162559942,2cyclictest780-21snmpd08:41:281
162559941,2cyclictest781-21ssh12:10:561
162559941,2cyclictest563-21rs:main1
162559941,2cyclictest563-21rs:main1
162559941,2cyclictest243-20systemd-journal10:55:001
162559941,2cyclictest19451-21seq07:30:341
162559941,2cyclictest16182-21ssh09:30:571
162559931,2cyclictest18580-21awk07:25:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional