You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 22:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Thu Dec 11, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21315994242,0cyclictest11603-21fwupd11:39:083
21311992019,1cyclictest66850irq/125-lan11:00:172
21311991918,1cyclictest66850irq/125-lan11:40:142
21311991918,1cyclictest66850irq/125-lan11:37:332
21311991918,1cyclictest66850irq/125-lan11:30:132
21311991918,1cyclictest66850irq/125-lan11:17:132
21311991918,1cyclictest66850irq/125-lan10:45:122
21311991918,1cyclictest66850irq/125-lan09:40:192
21311991918,1cyclictest66850irq/125-lan09:22:402
21311991818,0cyclictest66850irq/125-lan12:15:122
21311991818,0cyclictest66850irq/125-lan12:10:522
21311991818,0cyclictest66850irq/125-lan11:26:292
21311991818,0cyclictest66850irq/125-lan10:35:182
21311991817,1cyclictest66850irq/125-lan12:36:402
21311991817,1cyclictest66850irq/125-lan12:31:142
21311991817,1cyclictest66850irq/125-lan12:25:142
21311991817,1cyclictest66850irq/125-lan12:20:152
21311991817,1cyclictest66850irq/125-lan12:04:152
21311991817,1cyclictest66850irq/125-lan11:55:172
21311991817,1cyclictest66850irq/125-lan10:40:172
21311991817,1cyclictest66850irq/125-lan10:31:062
21311991817,1cyclictest66850irq/125-lan10:28:362
21311991817,1cyclictest66850irq/125-lan10:07:272
21311991817,1cyclictest66850irq/125-lan10:04:092
21311991817,1cyclictest66850irq/125-lan09:45:062
21311991817,1cyclictest66850irq/125-lan09:34:352
21311991817,1cyclictest66850irq/125-lan09:00:272
21311991717,0cyclictest66850irq/125-lan11:24:132
21311991717,0cyclictest66850irq/125-lan10:50:502
21311991717,0cyclictest66850irq/125-lan10:10:142
21311991717,0cyclictest66850irq/125-lan08:10:192
21311991717,0cyclictest66850irq/125-lan07:40:132
21311991717,0cyclictest66850irq/125-lan07:20:202
21311991716,1cyclictest66850irq/125-lan12:05:192
21311991716,1cyclictest66850irq/125-lan11:50:162
21311991716,1cyclictest66850irq/125-lan11:45:512
21311991716,1cyclictest66850irq/125-lan11:10:152
21311991716,1cyclictest66850irq/125-lan11:06:352
21311991716,1cyclictest66850irq/125-lan09:12:412
21311991716,1cyclictest20809-21kworker/2:1+events09:28:002
21311991616,0cyclictest66850irq/125-lan10:57:312
21311991616,0cyclictest66850irq/125-lan10:20:002
21311991616,0cyclictest66850irq/125-lan09:50:342
21311991616,0cyclictest66850irq/125-lan09:36:042
21311991615,1cyclictest66850irq/125-lan10:15:172
21311991615,1cyclictest66850irq/125-lan09:56:582
21311991615,1cyclictest66850irq/125-lan09:15:332
21311991615,1cyclictest66850irq/125-lan08:15:192
21311991615,1cyclictest66850irq/125-lan07:45:172
21311991515,0cyclictest66850irq/125-lan09:05:212
21311991515,0cyclictest66850irq/125-lan08:55:162
21311991515,0cyclictest66850irq/125-lan08:45:162
21311991515,0cyclictest66850irq/125-lan08:30:172
21311991515,0cyclictest66850irq/125-lan07:35:012
21311991514,1cyclictest66850irq/125-lan08:39:282
21311991514,1cyclictest66850irq/125-lan07:55:222
21311991413,1cyclictest66850irq/125-lan08:25:142
21311991313,0cyclictest66850irq/125-lan08:00:152
21311991313,0cyclictest66850irq/125-lan07:35:212
21311991212,0cyclictest66850irq/125-lan08:50:202
21311991211,1cyclictest66850irq/125-lan07:25:132
21311991111,0cyclictest66850irq/125-lan08:20:192
21311991110,1cyclictest66850irq/125-lan07:19:352
2131199109,1cyclictest66850irq/125-lan07:10:202
213159998,1cyclictest771-21snmpd08:39:463
213159998,1cyclictest769-21lldpd11:32:273
213119999,0cyclictest66850irq/125-lan07:50:192
213029998,1cyclictest769-21lldpd11:45:130
213029998,1cyclictest517-21systemd-resolve09:56:040
213159988,0cyclictest771-21snmpd09:57:543
213159988,0cyclictest771-21snmpd09:22:593
213159988,0cyclictest771-21snmpd08:26:333
213159988,0cyclictest771-21snmpd08:03:393
213159988,0cyclictest769-21lldpd11:45:233
213159988,0cyclictest769-21lldpd11:23:453
213159988,0cyclictest769-21lldpd10:08:263
213159988,0cyclictest769-21lldpd08:16:423
213159988,0cyclictest769-21lldpd07:43:543
213159987,1cyclictest771-21snmpd12:12:583
213159987,1cyclictest771-21snmpd09:32:203
213159987,1cyclictest771-21snmpd07:34:263
213159987,1cyclictest769-21lldpd12:23:063
213159987,1cyclictest769-21lldpd12:00:573
213159987,1cyclictest517-21systemd-resolve09:19:123
213079988,0cyclictest771-21snmpd10:52:351
213079988,0cyclictest769-21lldpd10:15:261
213079988,0cyclictest769-21lldpd09:23:411
213079988,0cyclictest769-21lldpd09:19:351
213079988,0cyclictest769-21lldpd08:48:031
213079987,1cyclictest771-21snmpd11:53:221
213079987,1cyclictest771-21snmpd08:13:331
213079987,1cyclictest524-21avahi-daemon10:39:551
213079987,1cyclictest517-21systemd-resolve12:12:241
213079987,1cyclictest517-21systemd-resolve11:42:241
213079987,1cyclictest16471-21fschecks_time08:15:141
213079986,2cyclictest771-21snmpd11:26:451
213079986,2cyclictest771-21snmpd09:47:061
213029988,0cyclictest771-21snmpd10:54:240
213029988,0cyclictest771-21snmpd09:23:530
213029988,0cyclictest771-21snmpd07:30:380
213029988,0cyclictest769-21lldpd10:16:560
213029988,0cyclictest769-21lldpd10:14:460
213029988,0cyclictest769-21lldpd07:48:240
213029987,1cyclictest771-21snmpd11:02:020
213029987,1cyclictest771-21snmpd09:18:140
213029987,1cyclictest771-21snmpd08:52:250
213029987,1cyclictest771-21snmpd07:52:200
213029987,1cyclictest769-21lldpd08:56:190
213029987,1cyclictest769-21lldpd07:41:400
213029987,1cyclictest21291-21cyclictest09:10:160
213029986,2cyclictest771-21snmpd10:37:200
213029986,2cyclictest771-21snmpd09:45:170
213029986,2cyclictest771-21snmpd09:07:190
213029986,2cyclictest771-21snmpd08:06:000
213159977,0cyclictest771-21snmpd08:55:403
213159977,0cyclictest771-21snmpd08:53:223
213159977,0cyclictest769-21lldpd10:36:383
213159977,0cyclictest769-21lldpd10:17:163
213159977,0cyclictest769-21lldpd08:40:043
213159977,0cyclictest769-21lldpd08:12:583
213159977,0cyclictest524-21avahi-daemon10:57:073
213159976,1cyclictest771-21snmpd11:19:203
213159976,1cyclictest771-21snmpd11:11:023
213159976,1cyclictest771-21snmpd10:20:583
213159976,1cyclictest771-21snmpd08:33:123
213159976,1cyclictest771-21snmpd07:18:293
213159976,1cyclictest771-21snmpd07:11:073
213159976,1cyclictest27796-21fschecks_time07:25:133
213159975,2cyclictest771-21snmpd12:25:293
213159975,2cyclictest771-21snmpd10:31:383
213159975,2cyclictest771-21snmpd09:02:553
213159975,2cyclictest771-21snmpd08:08:573
213159975,2cyclictest771-21snmpd07:51:293
213159975,2cyclictest20400-21cat09:25:143
213119976,1cyclictest66850irq/125-lan08:40:222
213079977,0cyclictest771-21snmpd07:26:111
213079977,0cyclictest771-21snmpd07:11:431
213079977,0cyclictest769-21lldpd11:39:001
213079977,0cyclictest769-21lldpd11:00:541
213079977,0cyclictest769-21lldpd09:30:411
213079977,0cyclictest769-21lldpd09:12:191
213079976,1cyclictest771-21snmpd08:36:341
213079976,1cyclictest771-21snmpd08:22:241
213079976,1cyclictest5538-21ntp_kernel_pll_10:20:171
213079976,1cyclictest524-21avahi-daemon12:17:491
213079976,1cyclictest524-21avahi-daemon12:09:071
213079976,1cyclictest524-21avahi-daemon11:11:321
213079976,1cyclictest524-21avahi-daemon10:58:411
213079976,1cyclictest524-21avahi-daemon10:33:471
213079976,1cyclictest524-21avahi-daemon10:09:071
213079976,1cyclictest517-21systemd-resolve10:29:491
213079976,1cyclictest26775-21fschecks_count11:20:131
213079975,2cyclictest771-21snmpd11:05:471
213079975,2cyclictest771-21snmpd10:12:421
213079975,2cyclictest771-21snmpd09:59:181
213079975,2cyclictest771-21snmpd08:00:451
213079975,2cyclictest771-21snmpd07:55:411
213079975,2cyclictest23326-21cat10:40:141
213079973,3cyclictest6580-21ntpq07:50:181
213079973,3cyclictest26483-21ssh12:28:021
213079970,7cyclictest18207-21wc11:45:211
213029977,0cyclictest771-21snmpd11:42:030
213029977,0cyclictest771-21snmpd09:26:200
213029977,0cyclictest769-21lldpd10:04:520
213029977,0cyclictest769-21lldpd08:48:110
213029977,0cyclictest769-21lldpd08:18:320
213029977,0cyclictest769-21lldpd08:04:060
213029977,0cyclictest769-21lldpd07:15:230
213029977,0cyclictest524-21avahi-daemon11:17:000
213029976,1cyclictest771-21snmpd11:33:210
213029976,1cyclictest771-21snmpd10:49:520
213029976,1cyclictest771-21snmpd09:30:200
213029976,1cyclictest771-21snmpd07:21:470
213029976,1cyclictest769-21lldpd10:44:280
213029976,1cyclictest524-21avahi-daemon12:33:590
213029976,1cyclictest524-21avahi-daemon12:05:010
213029976,1cyclictest2108-21cat12:35:180
213029976,1cyclictest18543-21fschecks_time11:10:130
213029976,1cyclictest14566-21gltestperf08:10:130
213029975,2cyclictest771-21snmpd10:21:320
213029975,2cyclictest771-21snmpd09:54:390
213029975,2cyclictest771-21snmpd07:57:170
213029974,2cyclictest749-21ntpd12:20:160
213029973,4cyclictest550-21NetworkManager10:09:350
213029973,3cyclictest28206-21ssh11:55:280
213029973,3cyclictest2089-21ssh11:28:120
213159966,0cyclictest771-21snmpd11:54:553
213159966,0cyclictest771-21snmpd09:54:453
213159966,0cyclictest524-21avahi-daemon07:38:093
213159965,1cyclictest771-21snmpd12:15:583
213159965,1cyclictest769-21lldpd11:25:293
213159965,1cyclictest769-21lldpd11:05:413
213159965,1cyclictest769-21lldpd10:52:543
213159964,2cyclictest771-21snmpd09:40:023
213159963,3cyclictest550-21NetworkManager11:01:103
213159963,2cyclictest255-20systemd-journal09:14:323
213159962,3cyclictest22162-21ssh10:04:213
213159961,5cyclictest550-21NetworkManager09:06:523
213079966,0cyclictest771-21snmpd11:16:111
213079966,0cyclictest771-21snmpd08:27:421
213079966,0cyclictest769-21lldpd07:38:241
213079965,1cyclictest771-21snmpd09:54:211
213079965,1cyclictest771-21snmpd09:40:261
213079965,1cyclictest524-21avahi-daemon08:56:561
213079965,1cyclictest524-21avahi-daemon07:30:041
213079965,1cyclictest255-20systemd-journal09:35:041
213079963,2cyclictest586-21rs:main1
213079963,2cyclictest255-20systemd-journal12:31:031
213079963,2cyclictest21005-21ssh10:02:251
213079962,3cyclictest6861-21sh11:33:121
213079962,3cyclictest4014-21ssh12:36:311
213079962,3cyclictest20895-21ssh12:23:001
213029965,1cyclictest524-21avahi-daemon09:03:280
213029965,1cyclictest24028-21mailstats12:25:210
213029964,2cyclictest771-21snmpd11:24:150
213029964,2cyclictest771-21snmpd08:33:330
213029964,2cyclictest771-21snmpd08:21:450
213029964,2cyclictest13177-21cat12:15:140
213029963,3cyclictest255-20systemd-journal09:38:060
213029963,2cyclictest771-21snmpd11:35:520
213029963,2cyclictest28374-21ntpq07:25:170
213029963,2cyclictest2228-21ssh12:03:450
213029962,3cyclictest5813-21ssh10:56:080
213159955,0cyclictest771-21snmpd07:55:023
213159955,0cyclictest16771-21turbostat.cron11:45:003
213159953,2cyclictest749-21ntpd10:45:133
213159953,2cyclictest550-21NetworkManager10:25:153
213159953,2cyclictest255-20systemd-journal10:42:153
213159953,2cyclictest22404-21kworker/u16:1+nfsiod12:36:373
213159952,3cyclictest550-21NetworkManager09:45:233
213159952,2cyclictest29612-21rm10:10:423
213159952,2cyclictest28334-21sh12:30:033
213159950,4cyclictest28970-21sed09:35:153
213119951,3cyclictest12516-21grep08:05:122
213079955,0cyclictest769-21lldpd08:30:501
213079955,0cyclictest524-21avahi-daemon08:53:341
213079954,1cyclictest584-21in:imuxsock12:01:081
213079952,3cyclictest550-21NetworkManager08:43:371
213079952,3cyclictest1705-21apt-get07:40:121
213079952,2cyclictest3294-21ntpq09:00:171
213079952,2cyclictest29371-21ssh10:46:371
213079952,2cyclictest255-20systemd-journal07:46:251
213079951,3cyclictest27675-21sed11:55:191
213079951,3cyclictest25944-21smartctl07:20:141
213029952,3cyclictest550-21NetworkManager08:40:230
213029952,3cyclictest25821-21sed08:35:210
213029952,2cyclictest255-20systemd-journal12:12:200
213029952,2cyclictest13723-21ssh10:30:100
213029951,3cyclictest1092-21sed09:40:150
213029950,4cyclictest22334-21ntpq07:10:170
213029950,4cyclictest10174-21ntpq10:25:190
213029950,2cyclictest1525950ssh11:05:400
213159943,1cyclictest511ktimers/312:05:153
213159942,2cyclictest771-21snmpd08:48:523
213159942,2cyclictest771-21snmpd08:20:033
213159941,2cyclictest586-21rs:main3
213159941,2cyclictest26389-21awk11:55:003
213159941,2cyclictest25773-21cut07:20:133
213079943,1cyclictest23586-21cpuspeed_turbos07:15:141
213079942,2cyclictest5246-21ntpq09:05:171
213079940,3cyclictest12072-21awk08:05:001
213029943,1cyclictest171ktimers/007:35:150
213029942,2cyclictest21225-21sed08:25:160
213029940,4cyclictest21849-21fschecks_time11:50:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional