You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-15 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun Nov 15, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258769910511049,2cyclictest29496-21kworker/2:1+events00:14:032
258809910481047,1cyclictest12635-21kworker/3:1+events00:28:363
258769910481046,2cyclictest27707-21kworker/2:1+events22:49:462
258809910471046,1cyclictest28982-21kworker/3:2+events19:44:383
258769910471045,2cyclictest20045-21kworker/2:2+events00:16:042
258769910461043,3cyclictest20045-21kworker/2:2+events22:57:512
258769910441042,2cyclictest27707-21kworker/2:1+events19:32:132
258689910441041,3cyclictest11238-21turbostat23:34:550
258769910431041,2cyclictest29496-21kworker/2:1+events23:59:332
258769910431040,3cyclictest20045-21kworker/2:2+events00:02:332
258769910411038,3cyclictest16158-21kworker/2:0+events22:51:392
258769910401038,2cyclictest27707-21kworker/2:1+events19:26:592
258729910401039,1cyclictest15312-21kworker/1:2+events21:31:471
258769910391037,2cyclictest20045-21kworker/2:2+events00:05:442
258809910381036,2cyclictest12264-21turbostat22:04:563
258689910381035,3cyclictest4237-21turbostat23:24:540
258809910321031,1cyclictest12635-21kworker/3:1+events00:31:363
258689910241024,0cyclictest21562-21kworker/0:0+events22:24:550
258689910231020,1cyclictest9823-21kworker/0:1+events21:59:220
258689910221021,1cyclictest21562-21kworker/0:0+events22:13:490
258689910211017,4cyclictest15450-21turbostat22:54:540
258729910191017,2cyclictest9420-21kworker/1:1+events21:16:291
258689910151014,1cyclictest30999-21kworker/0:2+events21:41:460
258689910151014,1cyclictest17785-21kworker/0:2+events22:09:510
258689910131009,2cyclictest2204-21kworker/0:1+events21:49:230
258689910111010,1cyclictest736-21kworker/0:1+events22:32:320
258689910101008,1cyclictest30999-21kworker/0:2+events21:54:550
258689910101008,1cyclictest25455-21kworker/0:2+events22:26:060
258689910071007,0cyclictest4464-21kworker/0:2+events22:39:240
258689910061006,0cyclictest9823-21kworker/0:1+events22:02:350
258689910061005,1cyclictest21562-21kworker/0:0+events22:15:430
258809910031002,1cyclictest1989-21kworker/3:0+events20:23:453
25868991000999,1cyclictest25523-21kworker/0:0+events19:10:220
25868991000998,1cyclictest25580-21kworker/0:0+events00:35:440
2586899997996,1cyclictest24855-21kworker/0:1+events19:15:220
2587299992991,1cyclictest8802-21kworker/1:1+events22:42:551
2587299990989,1cyclictest22498-21kworker/1:2+events21:06:511
2586899990989,1cyclictest29958-21kworker/0:0+events23:12:080
2588099988987,1cyclictest12635-21kworker/3:1+events23:36:053
2586899988985,3cyclictest8376-21turbostat21:04:560
2588099987985,2cyclictest27184-21turbostat21:39:553
2587699987985,2cyclictest2811-21turbostat20:24:552
2587299986984,1cyclictest18997-21turbostat22:59:541
2588099972971,1cyclictest1325-21kworker/3:2+events20:11:273
2588099970968,2cyclictest621-21kworker/3:1+events23:17:103
2588099961960,1cyclictest4681-21kworker/3:2+events23:31:373
2588099961959,2cyclictest25258-21turbostat23:54:553
2587299961960,1cyclictest9420-21kworker/1:1+events21:10:431
2587699958955,3cyclictest1538-21turbostat20:14:552
2587299958957,1cyclictest15312-21kworker/1:2+events21:25:211
2587299958954,3cyclictest22498-21kworker/1:2+events20:56:061
2587299957956,1cyclictest6706-21kworker/1:0+events20:48:391
2587299957956,1cyclictest22498-21kworker/1:2+events20:52:541
2587299956955,1cyclictest9420-21kworker/1:1+events21:22:021
2588099951950,1cyclictest1989-21kworker/3:0+events20:16:263
2587299949948,1cyclictest15312-21kworker/1:2+events21:35:321
2587299945944,1cyclictest22498-21kworker/1:2+events21:03:431
2588099935934,1cyclictest4681-21kworker/3:2+events23:28:453
2588099935934,1cyclictest26409-21kworker/3:2+events23:07:113
2588099933932,1cyclictest12635-21kworker/3:1+events00:21:043
2588099932931,1cyclictest22417-21kworker/3:1+events23:02:003
2588099932931,1cyclictest20316-21kworker/3:2+events23:49:193
2588099930929,1cyclictest4466-21kworker/3:0+events23:41:073
2588099930929,1cyclictest2680-21kworker/3:2+events20:39:203
2588099929927,2cyclictest2680-21kworker/3:2+pm20:26:593
2588099928927,1cyclictest2680-21kworker/3:2+events20:34:443
2588099927926,1cyclictest28982-21kworker/3:2+events19:52:123
2586899927923,4cyclictest5810-21turbostat20:44:550
2588099925924,1cyclictest4681-21kworker/3:2+events23:23:363
2588099925924,1cyclictest30574-21kworker/3:1+events20:02:423
2588099925924,1cyclictest28982-21kworker/3:2+events19:38:403
2588099923922,1cyclictest28982-21kworker/3:2+events19:56:343
2586899923922,1cyclictest14232-21turbostat00:24:550
2588099921920,1cyclictest4466-21kworker/3:0+events20:41:593
2588099918917,1cyclictest30574-21kworker/3:1+events19:47:283
2588099917916,1cyclictest1325-21kworker/3:2+events20:09:443
2588099914913,1cyclictest15995-21kworker/3:0+events19:20:543
2586899914911,3cyclictest23711-21turbostat21:34:550
2587699885883,2cyclictest8431-21turbostat22:44:552
2586899884882,2cyclictest28374-21turbostat19:34:550
2587699883880,3cyclictest31578-21turbostat19:59:552
2587699854852,2cyclictest5171-21turbostat20:39:552
2586899854852,2cyclictest10704-21turbostat00:19:550
2588099673670,3cyclictest26438-21turbostat19:19:553
2587699638634,4cyclictest25258-21turbostat23:54:552
2587299635633,2cyclictest5810-21turbostat20:44:551
2586899618615,3cyclictest27184-21turbostat21:39:550
2588099614613,1cyclictest29613-21turbostat23:14:543
2586899613612,1cyclictest21268-21turbostat00:34:550
2587699585584,1cyclictest27078-21turbostat19:24:552
2587299580577,3cyclictest4886-21turbostat22:39:561
2588099562561,1cyclictest28374-21turbostat19:34:553
2586899536535,1cyclictest26063-21turbostat23:09:540
2588099534531,3cyclictest10704-21turbostat00:19:553
2588099510507,3cyclictest18997-21turbostat22:59:543
25868992019,1cyclictest4464-21kworker/0:2+events_freezable23:56:590
25868991918,1cyclictest67350irq/124-lan00:11:580
25868991818,0cyclictest67350irq/124-lan23:39:030
25868991818,0cyclictest32653-21kworker/0:3+events_freezable00:25:240
25868991818,0cyclictest25523-21kworker/0:0+events_freezable21:10:550
25868991817,1cyclictest67350irq/124-lan21:24:100
25868991817,1cyclictest4464-21kworker/0:2+events_freezable23:50:580
25868991817,1cyclictest25523-21kworker/0:0+events21:15:130
25868991717,0cyclictest67350irq/124-lan23:46:060
25868991717,0cyclictest67350irq/124-lan23:00:030
25868991717,0cyclictest67350irq/124-lan19:56:010
25868991716,1cyclictest25523-21kworker/0:0+events_freezable21:25:520
25868991616,0cyclictest67350irq/124-lan22:55:370
25868991616,0cyclictest67350irq/124-lan22:45:340
25868991616,0cyclictest67350irq/124-lan20:18:100
25868991615,1cyclictest780-21snmpd23:19:100
25868991615,1cyclictest67350irq/124-lan23:42:200
25868991615,1cyclictest67350irq/124-lan23:25:250
25868991615,1cyclictest67350irq/124-lan20:06:480
25868991615,1cyclictest67350irq/124-lan00:00:140
25868991515,0cyclictest67350irq/124-lan20:36:460
25868991515,0cyclictest67350irq/124-lan20:21:300
25868991514,1cyclictest67350irq/124-lan22:40:520
25868991514,1cyclictest67350irq/124-lan00:05:100
25868991414,0cyclictest67350irq/124-lan20:47:400
25868991414,0cyclictest67350irq/124-lan20:33:100
25868991312,1cyclictest67350irq/124-lan19:24:100
25868991212,0cyclictest67350irq/124-lan19:51:430
25868991212,0cyclictest67350irq/124-lan19:39:510
2586899109,1cyclictest67350irq/124-lan19:41:420
25868991010,0cyclictest25523-21kworker/0:0+events_freezable20:52:480
25868991010,0cyclictest25523-21kworker/0:0+events_freezable20:01:110
258809998,1cyclictest780-21snmpd19:26:203
258809998,1cyclictest520-21avahi-daemon00:36:403
258769998,1cyclictest780-21snmpd22:27:212
258769996,2cyclictest780-21snmpd22:15:172
258729998,1cyclictest780-21snmpd23:23:251
258729998,1cyclictest780-21snmpd00:30:131
258729998,1cyclictest754-21ntpd22:30:501
258729998,1cyclictest520-21avahi-daemon00:38:121
258689999,0cyclictest25523-21kworker/0:0+events_freezable21:07:010
258689999,0cyclictest25523-21kworker/0:0+events_freezable20:55:000
258689999,0cyclictest25523-21kworker/0:0+events_freezable20:26:430
258689999,0cyclictest25523-21kworker/0:0+events_freezable20:15:000
258689999,0cyclictest25523-21kworker/0:0+events_freezable19:48:360
258689999,0cyclictest25523-21kworker/0:0+events_freezable19:27:470
258809988,0cyclictest780-21snmpd20:56:413
258809988,0cyclictest778-21lldpd22:48:063
258809987,1cyclictest780-21snmpd21:55:163
258809987,1cyclictest780-21snmpd00:00:393
258809987,1cyclictest520-21avahi-daemon00:08:303
258809986,2cyclictest780-21snmpd22:14:173
258809986,2cyclictest780-21snmpd21:52:373
258769988,0cyclictest780-21snmpd23:36:352
258769988,0cyclictest780-21snmpd22:37:272
258769988,0cyclictest778-21lldpd19:45:592
258769988,0cyclictest778-21lldpd19:38:352
258769987,1cyclictest780-21snmpd21:44:582
258769987,1cyclictest778-21lldpd23:03:522
258769986,2cyclictest780-21snmpd21:55:372
258769986,2cyclictest780-21snmpd21:35:312
258729988,0cyclictest780-21snmpd20:06:581
258729988,0cyclictest780-21snmpd19:49:211
258729988,0cyclictest778-21lldpd22:10:391
258729988,0cyclictest778-21lldpd00:13:141
258729987,1cyclictest780-21snmpd20:00:361
258729987,1cyclictest520-21avahi-daemon22:01:181
258729986,2cyclictest780-21snmpd19:51:121
258729986,2cyclictest754-21ntpd23:12:401
258729986,2cyclictest754-21ntpd23:02:301
258729986,2cyclictest754-21ntpd22:24:421
258729986,2cyclictest754-21ntpd00:22:471
258809977,0cyclictest780-21snmpd22:06:383
258809977,0cyclictest778-21lldpd22:39:253
258809977,0cyclictest778-21lldpd22:33:453
258809977,0cyclictest520-21avahi-daemon21:41:243
258809977,0cyclictest520-21avahi-daemon21:11:153
258809976,1cyclictest780-21snmpd22:51:273
258809975,2cyclictest780-21snmpd22:19:083
258809974,2cyclictest563-21rs:main3
258809973,4cyclictest546-21NetworkManager21:26:413
258809973,3cyclictest243-20systemd-journal22:28:483
258769977,0cyclictest780-21snmpd21:31:112
258769977,0cyclictest780-21snmpd21:26:242
258769977,0cyclictest780-21snmpd21:11:542
258769977,0cyclictest778-21lldpd23:32:502
258769977,0cyclictest778-21lldpd23:08:372
258769977,0cyclictest778-21lldpd21:46:362
258769977,0cyclictest778-21lldpd20:50:002
258769977,0cyclictest778-21lldpd00:25:262
258769976,1cyclictest778-21lldpd23:27:222
258769976,1cyclictest520-21avahi-daemon20:31:592
258769975,2cyclictest780-21snmpd21:52:042
258769975,2cyclictest780-21snmpd20:16:432
258769975,2cyclictest780-21snmpd00:30:372
258729977,0cyclictest780-21snmpd19:23:351
258729977,0cyclictest778-21lldpd19:44:491
258729976,1cyclictest780-21snmpd20:30:551
258729976,1cyclictest780-21snmpd20:23:101
258729975,2cyclictest780-21snmpd19:13:591
258729975,2cyclictest754-21ntpd23:46:011
258729975,2cyclictest754-21ntpd23:34:491
258729975,2cyclictest754-21ntpd23:08:251
258729975,2cyclictest754-21ntpd22:29:041
258729975,2cyclictest754-21ntpd21:46:331
258729975,2cyclictest754-21ntpd20:20:001
258729975,2cyclictest754-21ntpd00:16:551
258729973,3cyclictest6523-21ssh21:51:331
258809966,0cyclictest778-21lldpd23:56:483
258809966,0cyclictest778-21lldpd22:40:313
258809966,0cyclictest778-21lldpd22:21:073
258809965,1cyclictest496-21systemd-resolve00:11:523
258769966,0cyclictest780-21snmpd21:24:272
258769966,0cyclictest778-21lldpd19:41:572
258769966,0cyclictest520-21avahi-daemon23:46:272
258769966,0cyclictest520-21avahi-daemon21:15:152
258769965,1cyclictest780-21snmpd22:13:262
258769965,1cyclictest780-21snmpd20:51:202
258769965,1cyclictest520-21avahi-daemon19:52:002
258769964,2cyclictest780-21snmpd00:23:272
258769963,3cyclictest780-21snmpd21:09:332
258769963,2cyclictest243-20systemd-journal22:00:022
258769962,3cyclictest243-20systemd-journal23:21:302
258729966,0cyclictest778-21lldpd22:06:171
258729966,0cyclictest778-21lldpd00:04:211
258729966,0cyclictest28750-21http23:55:001
258729965,1cyclictest780-21snmpd23:17:191
258729965,1cyclictest780-21snmpd19:15:531
258729964,2cyclictest780-21snmpd20:39:501
258729964,2cyclictest780-21snmpd20:11:551
258729964,2cyclictest780-21snmpd19:59:031
258729964,2cyclictest780-21snmpd19:28:141
258729964,2cyclictest754-21ntpd23:41:441
258729964,2cyclictest754-21ntpd23:25:191
258729964,2cyclictest754-21ntpd22:17:401
258729964,2cyclictest546-21NetworkManager21:56:421
258729963,3cyclictest546-21NetworkManager19:33:181
258809955,0cyclictest520-21avahi-daemon20:52:533
258809955,0cyclictest520-21avahi-daemon20:47:013
258809954,1cyclictest780-21snmpd21:07:273
258809953,2cyclictest780-21snmpd21:01:023
258809952,3cyclictest780-21snmpd21:15:243
258809951,3cyclictest2883-21ssh21:46:173
258809951,3cyclictest17405-21ssh21:20:423
258769955,0cyclictest780-21snmpd20:44:082
258769955,0cyclictest520-21avahi-daemon21:01:032
258769955,0cyclictest496-21systemd-resolve19:16:342
258769954,1cyclictest520-21avahi-daemon23:41:352
258769953,2cyclictest546-21NetworkManager22:21:182
258769952,3cyclictest780-21snmpd23:11:252
258769952,2cyclictest26015-21ssh00:35:522
258769952,2cyclictest243-20systemd-journal20:55:312
258769952,2cyclictest2238-21ssh22:30:542
258769952,2cyclictest18139-21ssh22:07:392
258769952,2cyclictest1741-21ssh23:16:122
258729955,0cyclictest778-21lldpd00:25:201
258729954,1cyclictest780-21snmpd21:41:221
258729953,2cyclictest780-21snmpd23:38:381
258729953,2cyclictest780-21snmpd19:38:001
258729952,2cyclictest563-21rs:main1
258729952,2cyclictest4671-21ssh00:06:051
258729952,2cyclictest17680-21ssh22:53:011
258769942,2cyclictest780-21snmpd20:28:312
258769942,2cyclictest780-21snmpd19:10:532
258769942,2cyclictest546-21NetworkManager20:07:102
258769942,2cyclictest420-21sshd20:00:102
258729943,1cyclictest331ktimers/122:46:301
258729941,3cyclictest546-21NetworkManager20:25:081
258809930,3cyclictest26024-21runrttasks19:10:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional