You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-05 - 23:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot6s.osadl.org (updated Fri Dec 05, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27593992525,0cyclictest17704-21fwupd08:42:290
27598992019,1cyclictest66850irq/125-lan09:45:161
27598991919,0cyclictest66850irq/125-lan10:31:081
27598991918,1cyclictest66850irq/125-lan11:00:121
27598991918,1cyclictest66850irq/125-lan09:51:261
27598991918,1cyclictest66850irq/125-lan07:45:451
27598991818,0cyclictest771-21snmpd09:40:521
27598991818,0cyclictest66850irq/125-lan12:13:281
27598991818,0cyclictest66850irq/125-lan11:46:311
27598991818,0cyclictest66850irq/125-lan10:57:371
27598991818,0cyclictest66850irq/125-lan10:45:201
27598991818,0cyclictest66850irq/125-lan10:40:131
27598991818,0cyclictest66850irq/125-lan10:20:301
27598991818,0cyclictest66850irq/125-lan10:11:101
27598991818,0cyclictest66850irq/125-lan09:10:181
27598991817,1cyclictest66850irq/125-lan12:15:181
27598991817,1cyclictest66850irq/125-lan11:37:031
27598991817,1cyclictest66850irq/125-lan11:27:081
27598991817,1cyclictest66850irq/125-lan11:09:101
27598991817,1cyclictest66850irq/125-lan10:50:161
27598991817,1cyclictest66850irq/125-lan09:35:141
27598991817,1cyclictest66850irq/125-lan08:54:291
27598991717,0cyclictest66850irq/125-lan12:28:451
27598991717,0cyclictest66850irq/125-lan12:06:451
27598991717,0cyclictest66850irq/125-lan11:34:161
27598991717,0cyclictest66850irq/125-lan11:13:241
27598991717,0cyclictest66850irq/125-lan07:36:121
27598991717,0cyclictest66850irq/125-lan07:34:121
27598991716,1cyclictest66850irq/125-lan12:32:051
27598991716,1cyclictest66850irq/125-lan12:32:051
27598991716,1cyclictest66850irq/125-lan11:59:431
27598991716,1cyclictest66850irq/125-lan11:44:351
27598991716,1cyclictest66850irq/125-lan10:37:591
27598991716,1cyclictest66850irq/125-lan10:06:191
27598991716,1cyclictest66850irq/125-lan09:55:431
27598991716,1cyclictest66850irq/125-lan09:30:151
27598991716,1cyclictest66850irq/125-lan09:15:351
27598991716,1cyclictest66850irq/125-lan07:10:081
27598991716,1cyclictest1548-21kworker/1:2+events10:17:261
27598991616,0cyclictest66850irq/125-lan11:16:241
27598991616,0cyclictest66850irq/125-lan10:01:181
27598991616,0cyclictest66850irq/125-lan09:26:071
27598991616,0cyclictest66850irq/125-lan08:59:141
27598991616,0cyclictest66850irq/125-lan07:40:171
27598991615,1cyclictest66850irq/125-lan12:36:031
27598991615,1cyclictest66850irq/125-lan12:20:511
27598991615,1cyclictest66850irq/125-lan12:02:211
27598991615,1cyclictest66850irq/125-lan10:25:111
27598991615,1cyclictest66850irq/125-lan09:25:001
27598991515,0cyclictest66850irq/125-lan11:50:081
27598991515,0cyclictest66850irq/125-lan11:20:591
27598991515,0cyclictest66850irq/125-lan08:44:121
27598991515,0cyclictest66850irq/125-lan08:09:291
27598991515,0cyclictest66850irq/125-lan07:52:371
27598991414,0cyclictest66850irq/125-lan08:35:001
27598991414,0cyclictest66850irq/125-lan08:25:401
27598991414,0cyclictest66850irq/125-lan08:21:461
27598991414,0cyclictest66850irq/125-lan08:16:001
27598991414,0cyclictest66850irq/125-lan08:10:121
27598991413,1cyclictest66850irq/125-lan07:55:121
27598991313,0cyclictest66850irq/125-lan08:00:291
27598991313,0cyclictest66850irq/125-lan07:25:131
27598991313,0cyclictest66850irq/125-lan07:17:011
27598991212,0cyclictest66850irq/125-lan09:01:211
27598991212,0cyclictest66850irq/125-lan07:10:001
27598991111,0cyclictest66850irq/125-lan09:09:291
2759399108,1cyclictest771-21snmpd11:34:440
276029998,1cyclictest771-21snmpd12:30:552
276029998,1cyclictest771-21snmpd12:30:552
276029998,1cyclictest771-21snmpd09:53:112
276029998,1cyclictest771-21snmpd08:42:202
276029998,1cyclictest584-21in:imuxsock10:59:442
276029998,1cyclictest584-21in:imuxsock09:14:062
276029996,3cyclictest771-21snmpd12:17:012
276029996,2cyclictest771-21snmpd07:33:382
275939998,1cyclictest517-21systemd-resolve11:15:500
276059988,0cyclictest771-21snmpd12:38:353
276059988,0cyclictest771-21snmpd12:10:553
276059988,0cyclictest771-21snmpd07:20:203
276059988,0cyclictest769-21lldpd12:27:183
276059988,0cyclictest769-21lldpd11:58:223
276059988,0cyclictest769-21lldpd11:01:453
276059988,0cyclictest769-21lldpd10:23:583
276059988,0cyclictest769-21lldpd08:16:283
276059988,0cyclictest769-21lldpd07:55:263
276059987,1cyclictest771-21snmpd10:19:573
276059987,1cyclictest771-21snmpd10:11:013
276059987,1cyclictest771-21snmpd10:00:383
276059987,1cyclictest771-21snmpd09:16:093
276059987,1cyclictest769-21lldpd10:05:483
276059987,1cyclictest769-21lldpd07:51:483
276059987,1cyclictest6215-21fschecks_time11:50:143
276059987,1cyclictest524-21avahi-daemon12:22:053
276059987,1cyclictest524-21avahi-daemon11:40:203
276059987,1cyclictest524-21avahi-daemon09:48:293
276059987,1cyclictest524-21avahi-daemon09:24:563
276059986,2cyclictest771-21snmpd11:31:443
276059986,2cyclictest771-21snmpd08:52:503
276059986,2cyclictest771-21snmpd08:35:353
276029988,0cyclictest771-21snmpd12:25:222
276029988,0cyclictest771-21snmpd10:29:302
276029988,0cyclictest771-21snmpd08:48:502
276029988,0cyclictest769-21lldpd11:01:132
276029988,0cyclictest769-21lldpd08:35:572
276029987,1cyclictest771-21snmpd12:04:362
276029987,1cyclictest771-21snmpd10:33:392
276029987,1cyclictest524-21avahi-daemon11:41:022
276029986,2cyclictest771-21snmpd10:46:092
276029986,2cyclictest771-21snmpd10:42:062
276029986,2cyclictest771-21snmpd09:19:422
276029986,2cyclictest771-21snmpd08:52:472
276029986,2cyclictest771-21snmpd07:15:352
275989988,0cyclictest66850irq/125-lan08:49:041
275989988,0cyclictest66850irq/125-lan07:23:211
275939988,0cyclictest771-21snmpd11:24:590
275939988,0cyclictest771-21snmpd08:22:580
275939988,0cyclictest769-21lldpd11:51:440
275939988,0cyclictest769-21lldpd10:26:120
275939988,0cyclictest769-21lldpd08:59:010
275939988,0cyclictest769-21lldpd07:33:280
275939987,1cyclictest771-21snmpd10:37:210
275939987,1cyclictest771-21snmpd09:50:490
275939987,1cyclictest769-21lldpd11:40:270
275939987,1cyclictest769-21lldpd09:48:480
275939987,1cyclictest586-21rs:main0
275939987,1cyclictest524-21avahi-daemon12:04:270
275939987,1cyclictest524-21avahi-daemon11:36:120
275939987,1cyclictest524-21avahi-daemon10:40:330
275939987,1cyclictest524-21avahi-daemon10:06:310
275939987,1cyclictest31499-21munin-plugin-st09:20:000
275939986,2cyclictest771-21snmpd12:06:270
275939986,2cyclictest771-21snmpd07:21:290
275939985,2cyclictest8985-21grep08:10:130
275939983,5cyclictest550-21NetworkManager11:05:580
276059977,0cyclictest771-21snmpd12:31:193
276059977,0cyclictest771-21snmpd12:31:193
276059977,0cyclictest771-21snmpd09:28:213
276059977,0cyclictest771-21snmpd08:08:433
276059977,0cyclictest769-21lldpd11:25:453
276059977,0cyclictest769-21lldpd07:30:563
276059976,1cyclictest771-21snmpd12:16:103
276059976,1cyclictest771-21snmpd12:06:003
276059976,1cyclictest584-21in:imuxsock09:00:323
276059976,1cyclictest524-21avahi-daemon08:57:233
276059975,2cyclictest771-21snmpd11:16:503
276059975,2cyclictest771-21snmpd08:44:223
276059975,2cyclictest771-21snmpd08:26:273
276059975,2cyclictest771-21snmpd07:40:233
276059975,2cyclictest771-21snmpd07:39:333
276059974,3cyclictest550-21NetworkManager11:20:583
276029977,0cyclictest771-21snmpd07:39:572
276029977,0cyclictest769-21lldpd12:20:042
276029977,0cyclictest769-21lldpd07:20:352
276029976,1cyclictest771-21snmpd09:42:522
276029976,1cyclictest771-21snmpd09:23:422
276029976,1cyclictest771-21snmpd09:01:272
276029976,1cyclictest771-21snmpd08:07:252
276029976,1cyclictest769-21lldpd11:56:302
276029976,1cyclictest584-21in:imuxsock11:24:402
276029976,1cyclictest4739-21gltestperf10:00:172
276029975,2cyclictest771-21snmpd10:53:012
276029975,2cyclictest771-21snmpd10:35:542
276029975,2cyclictest771-21snmpd10:21:152
276029975,2cyclictest771-21snmpd09:09:512
276029975,2cyclictest771-21snmpd07:27:462
276029972,5cyclictest550-21NetworkManager09:46:352
275989977,0cyclictest66850irq/125-lan08:39:111
275939977,0cyclictest771-21snmpd10:01:050
275939977,0cyclictest771-21snmpd09:42:280
275939977,0cyclictest771-21snmpd08:29:170
275939977,0cyclictest769-21lldpd09:56:280
275939977,0cyclictest769-21lldpd09:33:050
275939977,0cyclictest769-21lldpd08:05:440
275939976,1cyclictest771-21snmpd12:10:490
275939976,1cyclictest3898-21sh12:21:550
275939976,1cyclictest255-20systemd-journal07:26:070
275939975,2cyclictest771-21snmpd12:19:400
275939975,2cyclictest771-21snmpd11:47:390
275939975,2cyclictest771-21snmpd09:35:190
275939975,2cyclictest771-21snmpd07:36:360
275939973,3cyclictest27781-21apt-get07:10:100
276059966,0cyclictest769-21lldpd09:05:173
276059965,1cyclictest771-21snmpd11:39:443
276059965,1cyclictest771-21snmpd11:13:133
276059965,1cyclictest771-21snmpd10:50:283
276059965,1cyclictest27326-21cpuspeed_turbos09:50:113
276059964,2cyclictest771-21snmpd10:47:103
276059964,2cyclictest771-21snmpd08:45:173
276059964,2cyclictest771-21snmpd08:23:313
276059963,3cyclictest550-21NetworkManager10:55:403
276059963,3cyclictest4319-21perl10:35:143
276059963,2cyclictest29412-21ssh10:26:253
276059963,2cyclictest255-20systemd-journal07:28:283
276059962,3cyclictest23949-21grep09:10:163
276059962,3cyclictest14971-21cat08:35:003
276029966,0cyclictest584-21in:imuxsock08:27:532
276029965,1cyclictest524-21avahi-daemon07:13:392
276029965,1cyclictest517-21systemd-resolve11:30:462
276029965,1cyclictest0-21swapper/211:45:172
276029964,2cyclictest771-21snmpd09:59:292
276029964,2cyclictest771-21snmpd09:36:102
276029964,2cyclictest771-21snmpd07:44:182
276029963,3cyclictest550-21NetworkManager11:05:042
276029963,3cyclictest255-20systemd-journal09:31:122
276029963,3cyclictest23891-21fw_conntrack11:35:112
276029963,2cyclictest586-21rs:main2
276029963,2cyclictest255-20systemd-journal12:37:352
276029962,3cyclictest255-20systemd-journal09:28:402
276029962,3cyclictest12085-21ssh10:08:232
275939966,0cyclictest771-21snmpd11:55:120
275939965,1cyclictest769-21lldpd08:50:370
275939965,1cyclictest2507-21cat07:40:130
275939964,2cyclictest771-21snmpd11:11:010
275939964,2cyclictest771-21snmpd09:09:540
275939963,3cyclictest6333-21apt-get12:25:130
275939963,3cyclictest255-20systemd-journal09:20:520
275939963,2cyclictest5723-21ssh09:25:490
275939963,2cyclictest255-20systemd-journal10:51:180
275939963,2cyclictest2009-21ssh10:32:120
275939961,5cyclictest550-21NetworkManager10:20:170
276059954,1cyclictest771-21snmpd07:46:273
276059953,2cyclictest771-21snmpd08:13:393
276059952,2cyclictest9295-21ssh10:40:153
276059952,2cyclictest8058-21dpkg09:30:003
276059952,2cyclictest255-20systemd-journal10:31:033
276059952,2cyclictest17574-21ssh09:39:483
276059952,2cyclictest16496-21ssh12:01:043
276059950,5cyclictest31484-21turbostat09:59:553
276029955,0cyclictest769-21lldpd11:14:132
276029954,1cyclictest771-21snmpd08:20:552
276029954,1cyclictest6358-21gltestperf11:50:142
276029954,1cyclictest421ktimers/211:27:192
276029954,1cyclictest421ktimers/211:17:062
276029953,2cyclictest771-21snmpd08:33:562
276029953,2cyclictest771-21snmpd07:55:542
276029952,3cyclictest550-21NetworkManager07:45:592
276029952,2cyclictest25356-21ssh12:10:492
276029952,2cyclictest20570-21ssh10:17:222
276029951,3cyclictest19424-21memory12:05:172
275939955,0cyclictest771-21snmpd08:38:110
275939955,0cyclictest584-21in:imuxsock09:03:060
275939954,1cyclictest771-21snmpd08:31:040
275939954,1cyclictest517-21systemd-resolve07:55:130
275939954,1cyclictest22561-21needreboot10:55:160
275939953,2cyclictest550-21NetworkManager10:17:310
275939953,2cyclictest24398-21sshd09:10:290
275939953,2cyclictest17040-21ssh11:27:200
275939952,3cyclictest550-21NetworkManager08:00:000
275939952,2cyclictest17213-21cat10:50:000
275939952,2cyclictest14912-21ssh10:10:370
275939951,4cyclictest550-21NetworkManager07:54:190
276059944,0cyclictest0-21swapper/311:45:133
276059942,2cyclictest771-21snmpd07:16:563
276059942,2cyclictest771-21snmpd07:14:053
276059942,2cyclictest550-21NetworkManager08:01:293
276059941,2cyclictest30477-21fschecks_time11:05:143
276059940,3cyclictest18551-21irqstats09:40:133
276029944,0cyclictest771-21snmpd08:55:052
276029943,1cyclictest421ktimers/208:16:452
276029942,2cyclictest9078-21cat08:10:142
276029942,2cyclictest771-21snmpd07:52:212
275939943,1cyclictest16455-21df12:35:090
275939942,2cyclictest550-21NetworkManager07:17:500
275939942,2cyclictest0-21swapper/008:16:250
275939942,0cyclictest0-21swapper/008:47:290
275939941,2cyclictest771-21snmpd12:32:140
275939941,2cyclictest771-21snmpd12:32:130
276029930,3cyclictest775-21runrttasks08:01:062
275939931,2cyclictest771-21snmpd07:45:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional