You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-17 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Nov 17, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
242479910541048,4cyclictest10855-21kworker/3:0+events21:19:443
242479910531049,4cyclictest26741-21turbostat19:34:543
242479910521050,2cyclictest29590-21kworker/3:0+events22:41:083
242479910521050,2cyclictest25039-21kworker/3:1+events19:29:133
242479910521050,2cyclictest18078-21kworker/3:2+events22:59:203
242479910511049,2cyclictest26725-21kworker/3:2+events23:58:263
242479910511049,2cyclictest18078-21kworker/3:2+events23:03:143
242479910511049,2cyclictest18069-21kworker/3:1+events00:33:263
242479910511049,2cyclictest13862-21kworker/3:2+events00:23:253
242479910511048,3cyclictest2047-21kworker/3:1+events00:18:383
242479910511048,3cyclictest14817-21kworker/3:2+events23:37:123
242479910501048,2cyclictest29590-21kworker/3:0+events21:41:273
242479910501048,2cyclictest2047-21kworker/3:1+events00:05:413
242479910501048,2cyclictest10855-21kworker/3:0+events21:26:383
242479910501047,3cyclictest7910-21kworker/3:1+events23:26:053
242479910501047,3cyclictest5201-21kworker/3:2+events20:50:213
242479910501047,3cyclictest25608-21kworker/3:0+events00:37:523
242479910501047,3cyclictest2047-21kworker/3:1+events00:03:373
242479910501046,3cyclictest10855-21kworker/3:0+events21:22:013
242409910501049,1cyclictest4859-21kworker/1:0+events21:56:471
242479910491047,2cyclictest7910-21kworker/3:1+events23:34:103
242479910491047,2cyclictest26725-21kworker/3:2+events23:54:063
242479910491047,2cyclictest2047-21kworker/3:1+events00:10:213
242479910491047,2cyclictest18069-21kworker/3:1+events00:28:273
242479910491046,3cyclictest7910-21kworker/3:1+events23:40:213
242479910491046,3cyclictest7243-21kworker/3:0+events21:08:213
242479910491046,3cyclictest457-21kworker/3:1+events20:27:323
242479910491046,3cyclictest3834-21kworker/3:1+events21:10:223
242479910491046,3cyclictest3834-21kworker/3:1+events20:59:563
242479910481045,3cyclictest15079-21kworker/3:0+events19:24:283
242479910471045,2cyclictest3834-21kworker/3:1+events20:45:223
242479910471045,2cyclictest1831-21kworker/3:0+events20:40:223
242479910471044,3cyclictest3896-21kworker/3:2+events22:36:283
242479910471044,3cyclictest1831-21kworker/3:0+events20:35:213
242479910461043,3cyclictest30034-21kworker/3:2+events20:15:543
242479910461043,2cyclictest15079-21kworker/3:0+events19:16:493
242479910461042,4cyclictest29355-21kworker/3:0+events19:51:063
242479910451043,2cyclictest28697-21kworker/3:2+events19:40:433
242479910451042,3cyclictest14817-21kworker/3:2+events23:46:293
242409910451044,1cyclictest12165-21kworker/1:1+events22:03:381
242479910441041,3cyclictest6550-21kworker/3:2+events21:01:073
242479910441041,2cyclictest29355-21kworker/3:0+events19:46:303
242409910391038,1cyclictest20766-21kworker/1:1+events20:02:221
242409910371036,1cyclictest32657-21kworker/1:0+events20:23:511
242359910371035,2cyclictest21787-21kworker/0:1+events22:19:100
242359910351032,3cyclictest22513-21kworker/0:1+events21:32:420
242409910301029,1cyclictest32657-21kworker/1:0+events20:13:421
242409910291027,2cyclictest18639-21turbostat21:29:541
242359910281027,1cyclictest21787-21kworker/0:1+events22:32:110
242479910271024,3cyclictest11102-21turbostat22:49:553
242409910261023,3cyclictest3357-21turbostat23:24:551
242409910251021,4cyclictest25156-21turbostat23:09:551
242359910221019,2cyclictest32552-21kworker/0:0+events23:17:070
242359910201019,1cyclictest21787-21kworker/0:1+events23:14:030
242359910201019,1cyclictest21787-21kworker/0:1+events22:51:370
242359910181017,1cyclictest3151-21kworker/0:0+events20:32:010
242359910181017,1cyclictest25958-21kworker/0:0+events22:24:100
242359910151012,3cyclictest24134-21turbostat19:14:550
242409910141011,3cyclictest32456-21turbostat22:34:541
242359910121011,1cyclictest3950-21kworker/0:2+events23:20:530
242359910101009,1cyclictest3151-21kworker/0:0+events21:38:540
242359910061005,1cyclictest27401-21kworker/0:2+events19:34:320
242449910041002,2cyclictest15124-21turbostat21:24:562
242359910031001,1cyclictest25958-21kworker/0:0+events22:25:450
242449910021001,1cyclictest32526-21kworker/2:2+events22:45:202
242359910021000,2cyclictest32302-21turbostat20:14:560
242449910011000,1cyclictest27783-21kworker/2:0+events19:39:402
2424499999998,1cyclictest11029-21kworker/2:1+events23:07:332
2424099987985,2cyclictest21142-21kworker/1:2+events22:14:171
2423599985982,3cyclictest4853-21turbostat20:49:560
2424099984981,3cyclictest21619-21turbostat23:04:551
2424099951949,2cyclictest28541-21turbostat23:59:551
2423599928927,1cyclictest27803-21turbostat19:39:540
2424099919917,2cyclictest4859-21kworker/1:0+events22:09:511
2423599919916,3cyclictest29658-21turbostat21:44:550
2423599912909,3cyclictest1199-21turbostat20:24:560
2423599911910,1cyclictest29100-21turbostat19:49:550
2423599900898,2cyclictest3225-21turbostat00:09:550
2424099898896,2cyclictest14612-21turbostat22:54:551
2424099896893,3cyclictest3565-21turbostat20:39:561
2423599896894,2cyclictest6773-21turbostat21:04:560
2424099895894,1cyclictest1146-21kworker/1:1+events21:49:201
2424099894893,1cyclictest30611-21kworker/1:2+events20:06:041
2424099894893,1cyclictest1146-21kworker/1:1+events21:50:211
2423599893891,2cyclictest10456-21turbostat23:34:550
2424099889888,1cyclictest20766-21kworker/1:1+events19:57:351
2424799885883,1cyclictest18309-21turbostat22:14:553
2424099882879,3cyclictest2495-21turbostat20:34:561
2424099672670,2cyclictest477-21turbostat20:19:561
2424799666664,2cyclictest25693-21turbostat21:39:553
2424499650648,2cyclictest21619-21turbostat23:04:542
2424799618615,3cyclictest14612-21turbostat22:54:553
2424799616615,1cyclictest24134-21turbostat19:14:553
2423599615613,2cyclictest1853-21turbostat20:29:550
2424499608605,3cyclictest24781-21turbostat00:39:552
2424799605602,3cyclictest32302-21turbostat20:14:563
2424799602599,3cyclictest2495-21turbostat20:34:563
2423599592589,3cyclictest18309-21turbostat22:14:550
2424099556553,3cyclictest29658-21turbostat21:44:551
2423599555553,2cyclictest26109-21turbostat19:29:550
2424499553552,1cyclictest7528-21turbostat22:44:552
2424499553552,1cyclictest26741-21turbostat19:34:552
2424799543542,1cyclictest3357-21turbostat23:24:553
2424799534531,3cyclictest32456-21turbostat22:34:553
2423599534531,3cyclictest11102-21turbostat22:49:550
2424799531529,2cyclictest27803-21turbostat19:39:553
2424099519517,2cyclictest29743-21turbostat19:54:541
2424799513512,1cyclictest1199-21turbostat20:24:553
2423599503499,4cyclictest18639-21turbostat21:29:550
2423599496493,3cyclictest25156-21turbostat23:09:550
24235991919,0cyclictest67350irq/124-lan22:57:120
24235991919,0cyclictest67350irq/124-lan00:35:480
24235991818,0cyclictest67350irq/124-lan22:38:080
24235991818,0cyclictest67350irq/124-lan21:22:530
24235991818,0cyclictest67350irq/124-lan00:23:290
24235991817,1cyclictest67350irq/124-lan22:41:010
24235991817,1cyclictest67350irq/124-lan00:26:360
24235991717,0cyclictest67350irq/124-lan23:41:480
24235991717,0cyclictest67350irq/124-lan23:26:060
24235991717,0cyclictest67350irq/124-lan23:02:230
24235991717,0cyclictest67350irq/124-lan22:05:490
24235991717,0cyclictest67350irq/124-lan22:01:450
24235991717,0cyclictest67350irq/124-lan21:16:090
24235991717,0cyclictest67350irq/124-lan20:37:470
24235991717,0cyclictest67350irq/124-lan00:30:050
24235991717,0cyclictest67350irq/124-lan00:10:030
24235991717,0cyclictest67350irq/124-lan00:01:370
24235991716,1cyclictest67350irq/124-lan21:59:320
24235991716,1cyclictest67350irq/124-lan21:48:250
24235991616,0cyclictest67350irq/124-lan23:48:100
24235991616,0cyclictest67350irq/124-lan21:51:070
24235991616,0cyclictest67350irq/124-lan21:10:570
24235991616,0cyclictest67350irq/124-lan00:16:070
24235991615,1cyclictest67350irq/124-lan23:50:450
24235991515,0cyclictest67350irq/124-lan23:55:170
24235991515,0cyclictest67350irq/124-lan20:15:180
24235991515,0cyclictest67350irq/124-lan20:07:290
24235991515,0cyclictest67350irq/124-lan19:24:400
24235991514,1cyclictest67350irq/124-lan23:38:030
24235991414,0cyclictest67350irq/124-lan21:06:210
24235991414,0cyclictest67350irq/124-lan20:58:190
24235991212,0cyclictest67350irq/124-lan20:54:460
2424499109,1cyclictest496-21systemd-resolve22:32:342
242449998,1cyclictest780-21snmpd20:57:452
242409998,1cyclictest780-21snmpd22:40:461
242479988,0cyclictest778-21lldpd23:15:003
242479988,0cyclictest778-21lldpd22:20:063
242479987,0cyclictest780-21snmpd21:48:593
242479986,2cyclictest780-21snmpd22:01:503
242479985,3cyclictest780-21snmpd21:58:233
242479985,3cyclictest780-21snmpd20:05:393
242449988,0cyclictest780-21snmpd23:21:232
242449988,0cyclictest778-21lldpd23:39:012
242449988,0cyclictest778-21lldpd23:26:232
242449988,0cyclictest778-21lldpd21:56:342
242449988,0cyclictest778-21lldpd21:06:032
242449988,0cyclictest778-21lldpd19:45:462
242449987,1cyclictest780-21snmpd23:45:122
242449986,2cyclictest780-21snmpd22:23:422
242449986,2cyclictest780-21snmpd21:15:312
242449986,2cyclictest780-21snmpd20:27:442
242449984,3cyclictest243-20systemd-journal22:07:412
242409988,0cyclictest780-21snmpd19:44:041
242409988,0cyclictest778-21lldpd00:31:501
242409987,1cyclictest780-21snmpd22:25:091
242409987,1cyclictest780-21snmpd19:14:421
242409986,2cyclictest780-21snmpd23:37:451
242409986,2cyclictest780-21snmpd19:30:061
242409986,2cyclictest780-21snmpd19:24:441
242409985,2cyclictest780-21snmpd23:50:271
242479977,0cyclictest780-21snmpd22:29:153
242479977,0cyclictest520-21avahi-daemon21:34:363
242479977,0cyclictest520-21avahi-daemon19:56:013
242479976,1cyclictest520-21avahi-daemon22:06:493
242449977,0cyclictest780-21snmpd23:11:472
242449977,0cyclictest780-21snmpd21:41:112
242449977,0cyclictest780-21snmpd19:27:572
242449977,0cyclictest778-21lldpd23:34:132
242449977,0cyclictest778-21lldpd22:03:162
242449977,0cyclictest778-21lldpd21:47:212
242449977,0cyclictest778-21lldpd21:31:232
242449977,0cyclictest778-21lldpd20:48:412
242449977,0cyclictest778-21lldpd20:31:022
242449977,0cyclictest778-21lldpd20:24:152
242449976,1cyclictest780-21snmpd23:55:302
242449976,1cyclictest780-21snmpd21:10:242
242449976,1cyclictest780-21snmpd00:05:282
242449975,2cyclictest780-21snmpd20:03:372
242449975,2cyclictest780-21snmpd19:55:402
242449975,2cyclictest780-21snmpd00:21:012
242449975,2cyclictest780-21snmpd00:11:402
242449974,0cyclictest191rcu_preempt22:50:022
242449973,1cyclictest191rcu_preempt21:29:402
242409977,0cyclictest780-21snmpd22:55:311
242409977,0cyclictest780-21snmpd21:14:151
242409977,0cyclictest780-21snmpd20:50:271
242409977,0cyclictest778-21lldpd22:46:011
242409977,0cyclictest778-21lldpd22:16:191
242409977,0cyclictest778-21lldpd19:26:171
242409977,0cyclictest778-21lldpd00:22:281
242409976,1cyclictest780-21snmpd21:30:191
242409976,1cyclictest778-21lldpd23:48:491
242409976,1cyclictest520-21avahi-daemon23:41:101
242409976,1cyclictest520-21avahi-daemon21:38:161
242409976,1cyclictest520-21avahi-daemon00:07:521
242409975,2cyclictest780-21snmpd21:08:281
242409973,3cyclictest780-21snmpd22:21:181
242359977,0cyclictest780-21snmpd20:43:320
242359977,0cyclictest778-21lldpd19:59:120
242359975,2cyclictest780-21snmpd20:04:250
242359970,4cyclictest25343-21runrttasks19:18:550
242479966,0cyclictest780-21snmpd23:09:473
242479966,0cyclictest778-21lldpd20:04:483
242449966,0cyclictest780-21snmpd21:04:392
242449966,0cyclictest780-21snmpd20:41:092
242449966,0cyclictest780-21snmpd00:32:112
242449966,0cyclictest778-21lldpd22:38:082
242449966,0cyclictest778-21lldpd21:53:462
242449965,0cyclictest191rcu_preempt23:18:002
242449964,2cyclictest780-21snmpd00:26:222
242449964,2cyclictest780-21snmpd00:16:462
242449963,2cyclictest29498-21ssh22:25:322
242449963,0cyclictest191rcu_preempt23:54:452
242449963,0cyclictest191rcu_preempt19:23:182
242449962,1cyclictest0-21swapper/222:17:072
242449961,2cyclictest26797-21ssh21:35:422
242409966,0cyclictest778-21lldpd23:10:471
242409966,0cyclictest520-21avahi-daemon21:02:001
242409966,0cyclictest520-21avahi-daemon00:25:351
242409965,1cyclictest780-21snmpd00:00:521
242409965,1cyclictest561-21in:imuxsock21:20:441
242409964,2cyclictest780-21snmpd22:37:191
242409964,2cyclictest780-21snmpd19:48:401
242409962,3cyclictest2571-21ls20:30:011
242409961,5cyclictest546-21NetworkManager19:39:181
242359960,3cyclictest28987-21runrttasks19:43:450
242479952,2cyclictest29813-21ssh23:11:213
242479952,2cyclictest243-20systemd-journal21:50:593
242479952,2cyclictest23693-21ssh22:17:273
242449955,0cyclictest780-21snmpd20:07:032
242449955,0cyclictest778-21lldpd19:41:102
242449953,2cyclictest780-21snmpd20:38:472
242449953,1cyclictest11365-21kworker/u16:1+nfsiod23:44:102
242449952,2cyclictest243-20systemd-journal20:18:332
242449952,0cyclictest191rcu_preempt22:56:122
242449951,2cyclictest0-21swapper/222:10:432
242449951,2cyclictest0-21swapper/219:50:192
242449951,1cyclictest191rcu_preempt19:15:002
242449950,3cyclictest352-21ssh00:00:492
242409955,0cyclictest520-21avahi-daemon19:18:501
242409955,0cyclictest520-21avahi-daemon00:15:071
242409953,2cyclictest8594-21ssh00:12:351
242409953,2cyclictest546-21NetworkManager23:27:281
242409952,2cyclictest971-21ssh23:16:241
242409952,2cyclictest25377-21ssh00:35:351
242409952,2cyclictest12480-21ssh23:32:491
242409952,2cyclictest12151-21ssh21:15:341
242409951,4cyclictest546-21NetworkManager20:56:071
242359950,2cyclictest16-21ksoftirqd/019:50:190
242449944,0cyclictest778-21lldpd20:11:482
242449943,0cyclictest191rcu_preempt19:15:362
242449940,2cyclictest54650NetworkManager20:50:052
242409942,2cyclictest780-21snmpd20:45:151
242409930,3cyclictest0-21swapper/120:40:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional