You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 16:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun Apr 26, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17157991818,0cyclictest65850irq/126-lan11:25:413
17157991817,1cyclictest65850irq/126-lan12:25:213
17157991817,1cyclictest65850irq/126-lan07:40:223
17157991817,1cyclictest65850irq/126-lan07:20:143
17152991818,0cyclictest743-21snmpd10:44:242
17152991818,0cyclictest7175-21fwupd11:59:412
17152991817,1cyclictest743-21snmpd11:00:112
17157991717,0cyclictest65850irq/126-lan10:45:153
17157991717,0cyclictest65850irq/126-lan08:25:203
17157991717,0cyclictest65850irq/126-lan08:15:143
17157991717,0cyclictest65850irq/126-lan07:27:433
17157991716,1cyclictest65850irq/126-lan12:35:213
17157991716,1cyclictest65850irq/126-lan12:33:213
17157991716,1cyclictest65850irq/126-lan12:20:183
17157991716,1cyclictest65850irq/126-lan11:55:153
17157991716,1cyclictest65850irq/126-lan11:35:213
17157991716,1cyclictest65850irq/126-lan11:00:183
17157991716,1cyclictest65850irq/126-lan10:20:163
17157991716,1cyclictest65850irq/126-lan08:40:143
17157991716,1cyclictest65850irq/126-lan07:50:163
17157991716,1cyclictest65850irq/126-lan07:30:123
17152991717,0cyclictest743-21snmpd07:50:342
17152991717,0cyclictest743-21snmpd07:18:472
17152991717,0cyclictest1879-21cat11:45:152
17142991717,0cyclictest743-21snmpd11:21:540
17157991616,0cyclictest65850irq/126-lan12:11:423
17157991616,0cyclictest65850irq/126-lan12:05:063
17157991616,0cyclictest65850irq/126-lan11:50:113
17157991616,0cyclictest65850irq/126-lan11:15:203
17157991616,0cyclictest65850irq/126-lan10:34:463
17157991616,0cyclictest65850irq/126-lan10:25:433
17157991616,0cyclictest65850irq/126-lan09:50:423
17157991616,0cyclictest65850irq/126-lan09:02:433
17157991616,0cyclictest65850irq/126-lan08:50:583
17157991616,0cyclictest65850irq/126-lan08:49:223
17157991615,1cyclictest65850irq/126-lan10:55:203
17157991615,1cyclictest65850irq/126-lan10:15:183
17157991615,1cyclictest65850irq/126-lan08:55:173
17157991615,1cyclictest65850irq/126-lan08:10:133
17152991616,0cyclictest743-21snmpd10:34:252
17152991616,0cyclictest743-21snmpd09:26:522
17152991616,0cyclictest743-21snmpd09:23:212
17152991616,0cyclictest743-21snmpd09:06:302
17152991616,0cyclictest743-21snmpd07:44:582
17152991616,0cyclictest743-21snmpd07:21:302
17152991616,0cyclictest4771-21cat09:15:162
17152991616,0cyclictest25836-21cat07:30:132
17152991616,0cyclictest25388-21cat10:05:152
17152991616,0cyclictest11988-21cat12:10:152
17157991515,0cyclictest65850irq/126-lan09:25:203
17157991515,0cyclictest65850irq/126-lan09:15:123
17157991515,0cyclictest65850irq/126-lan09:10:123
17157991515,0cyclictest65850irq/126-lan09:05:213
17157991514,1cyclictest65850irq/126-lan11:44:593
17157991514,1cyclictest65850irq/126-lan11:06:553
17157991514,1cyclictest65850irq/126-lan10:50:143
17157991514,1cyclictest65850irq/126-lan10:40:123
17157991514,1cyclictest65850irq/126-lan07:35:153
17152991515,0cyclictest743-21snmpd11:51:102
17152991515,0cyclictest743-21snmpd11:43:572
17152991515,0cyclictest743-21snmpd08:09:412
17152991515,0cyclictest18056-21cat12:25:142
17157991414,0cyclictest65850irq/126-lan11:20:163
17157991414,0cyclictest65850irq/126-lan09:40:213
17157991414,0cyclictest65850irq/126-lan07:19:413
17157991413,1cyclictest65850irq/126-lan12:00:183
17157991413,1cyclictest65850irq/126-lan11:10:133
17157991413,1cyclictest65850irq/126-lan09:45:143
17157991413,1cyclictest65850irq/126-lan08:00:173
17157991313,0cyclictest65850irq/126-lan10:35:163
17157991313,0cyclictest65850irq/126-lan09:34:433
17157991313,0cyclictest65850irq/126-lan08:21:203
17157991313,0cyclictest65850irq/126-lan07:10:103
17157991312,1cyclictest65850irq/126-lan12:15:163
17157991312,1cyclictest65850irq/126-lan09:58:433
17157991312,1cyclictest65850irq/126-lan07:55:203
17157991212,0cyclictest65850irq/126-lan09:35:173
17157991212,0cyclictest65850irq/126-lan08:30:153
17157991211,1cyclictest65850irq/126-lan10:00:123
17157991110,1cyclictest65850irq/126-lan11:45:213
17157991110,1cyclictest65850irq/126-lan08:37:433
1715799109,1cyclictest65850irq/126-lan08:05:173
171579999,0cyclictest65850irq/126-lan10:10:193
171579999,0cyclictest65850irq/126-lan07:49:123
171489998,1cyclictest743-21snmpd09:25:281
171489996,3cyclictest743-21snmpd09:18:551
171429998,1cyclictest743-21snmpd11:42:330
171429998,1cyclictest743-21snmpd07:32:470
171579987,1cyclictest65850irq/126-lan10:05:173
171529988,0cyclictest743-21snmpd12:31:532
171529988,0cyclictest743-21snmpd11:32:302
171529988,0cyclictest743-21snmpd11:27:332
171529988,0cyclictest741-21lldpd10:12:352
171529988,0cyclictest741-21lldpd08:23:152
171529988,0cyclictest741-21lldpd07:49:252
171529987,1cyclictest743-21snmpd07:37:242
171529987,1cyclictest743-21snmpd07:29:442
171529986,2cyclictest743-21snmpd12:07:102
171529986,2cyclictest743-21snmpd10:57:462
171529986,2cyclictest743-21snmpd10:01:422
171529986,2cyclictest743-21snmpd09:33:262
171489988,0cyclictest743-21snmpd09:52:561
171489988,0cyclictest743-21snmpd08:07:111
171489988,0cyclictest741-21lldpd11:45:141
171489988,0cyclictest741-21lldpd09:36:351
171489988,0cyclictest741-21lldpd08:59:051
171489988,0cyclictest741-21lldpd08:12:321
171489988,0cyclictest741-21lldpd07:13:551
171489987,1cyclictest743-21snmpd12:35:531
171489987,1cyclictest743-21snmpd12:18:411
171489987,1cyclictest743-21snmpd11:59:071
171489987,1cyclictest743-21snmpd11:26:361
171489987,1cyclictest743-21snmpd09:32:501
171489986,2cyclictest743-21snmpd10:38:041
171489986,2cyclictest743-21snmpd10:21:481
171489986,2cyclictest743-21snmpd08:33:371
171489986,2cyclictest743-21snmpd07:25:451
171429988,0cyclictest743-21snmpd09:29:590
171429988,0cyclictest741-21lldpd11:52:160
171429988,0cyclictest741-21lldpd09:39:520
171429988,0cyclictest741-21lldpd08:34:090
171429987,1cyclictest743-21snmpd11:45:560
171429987,1cyclictest743-21snmpd11:38:030
171429987,1cyclictest743-21snmpd10:51:260
171429987,1cyclictest743-21snmpd07:38:360
171429987,1cyclictest741-21lldpd11:10:510
171429987,1cyclictest741-21lldpd08:38:200
171429987,1cyclictest3300-21fschecks_time10:30:140
171429987,1cyclictest2933-21needreboot09:10:160
171429986,2cyclictest743-21snmpd10:20:390
171429986,2cyclictest743-21snmpd09:54:230
171429986,2cyclictest743-21snmpd08:11:110
171429986,2cyclictest743-21snmpd07:57:250
171429986,2cyclictest743-21snmpd07:52:520
171429986,2cyclictest743-21snmpd07:47:540
171579977,0cyclictest65850irq/126-lan11:30:223
171579977,0cyclictest65850irq/126-lan09:20:153
171529977,0cyclictest741-21lldpd09:42:222
171529977,0cyclictest741-21lldpd09:12:432
171529977,0cyclictest741-21lldpd08:49:142
171529977,0cyclictest741-21lldpd08:00:212
171529976,1cyclictest741-21lldpd08:42:552
171529975,2cyclictest743-21snmpd08:52:172
171529974,3cyclictest717-21ntpd08:15:122
171489977,0cyclictest743-21snmpd12:26:591
171489977,0cyclictest743-21snmpd10:30:431
171489977,0cyclictest743-21snmpd10:09:481
171489977,0cyclictest743-21snmpd09:00:391
171489977,0cyclictest741-21lldpd10:54:211
171489977,0cyclictest741-21lldpd09:10:331
171489976,1cyclictest743-21snmpd08:50:111
171489976,1cyclictest743-21snmpd08:35:381
171489975,2cyclictest743-21snmpd12:30:291
171489975,2cyclictest743-21snmpd11:42:211
171489975,2cyclictest743-21snmpd10:47:491
171489975,2cyclictest743-21snmpd10:14:561
171489975,2cyclictest743-21snmpd09:59:261
171489975,2cyclictest743-21snmpd09:48:201
171489975,2cyclictest743-21snmpd09:05:361
171489975,2cyclictest743-21snmpd08:03:241
171429977,0cyclictest743-21snmpd11:15:100
171429977,0cyclictest743-21snmpd09:33:080
171429977,0cyclictest743-21snmpd08:02:060
171429977,0cyclictest741-21lldpd10:35:520
171429977,0cyclictest741-21lldpd08:58:210
171429977,0cyclictest590-21gmain07:22:170
171429976,1cyclictest743-21snmpd10:16:450
171429976,1cyclictest743-21snmpd08:49:330
171429976,1cyclictest14864-21cat09:40:140
171429975,2cyclictest743-21snmpd08:42:150
171429975,2cyclictest743-21snmpd08:16:130
171429975,2cyclictest743-21snmpd08:05:270
171429975,2cyclictest743-21snmpd07:28:300
171429974,3cyclictest743-21snmpd10:10:410
171529966,0cyclictest743-21snmpd08:32:072
171529966,0cyclictest741-21lldpd10:23:242
171529966,0cyclictest741-21lldpd09:04:212
171529966,0cyclictest741-21lldpd08:37:062
171529966,0cyclictest573-21in:imuxsock08:55:342
171529966,0cyclictest522-21avahi-daemon12:00:142
171529966,0cyclictest30089-21gltestperf11:35:142
171529965,1cyclictest743-21snmpd11:19:092
171529964,2cyclictest743-21snmpd10:29:002
171529964,2cyclictest743-21snmpd10:16:002
171529964,2cyclictest13980-21cat12:15:132
171529963,2cyclictest575-21rs:main2
171489966,0cyclictest743-21snmpd11:11:441
171489966,0cyclictest741-21lldpd12:00:451
171489966,0cyclictest741-21lldpd11:16:591
171489965,1cyclictest743-21snmpd09:20:001
171489965,1cyclictest743-21snmpd08:41:061
171489964,2cyclictest743-21snmpd11:53:071
171489964,2cyclictest743-21snmpd10:41:301
171489964,2cyclictest743-21snmpd10:04:241
171489963,3cyclictest30069-21grep11:35:141
171489962,4cyclictest14186-21grep10:55:191
171429966,0cyclictest743-21snmpd11:55:160
171429966,0cyclictest743-21snmpd10:06:570
171429966,0cyclictest743-21snmpd09:55:010
171429966,0cyclictest743-21snmpd09:49:050
171429966,0cyclictest741-21lldpd11:28:050
171429966,0cyclictest522-21avahi-daemon09:02:280
171429966,0cyclictest24681-21idleruntime-cro10:05:000
171429966,0cyclictest18262-21head12:25:150
171429965,1cyclictest522-21avahi-daemon11:07:020
171429965,1cyclictest0-21swapper/007:10:110
171429964,2cyclictest743-21snmpd12:05:340
171429964,2cyclictest743-21snmpd10:57:170
171429964,2cyclictest743-21snmpd10:48:130
171429964,2cyclictest743-21snmpd08:25:320
171429964,2cyclictest743-21snmpd07:42:370
171429962,3cyclictest20948-21sed12:30:210
171529954,1cyclictest743-21snmpd10:52:442
171529953,2cyclictest4008-21cat07:55:152
171529952,3cyclictest557-21NetworkManager12:36:412
171529952,3cyclictest19221-21grep09:50:142
171529952,2cyclictest21072-21forks09:55:132
171529951,3cyclictest9424-21fw_packets10:45:152
171529951,3cyclictest17369-21diskstats11:05:122
171529950,3cyclictest244-20systemd-journal11:21:102
171489955,0cyclictest741-21lldpd07:59:441
171489955,0cyclictest522-21avahi-daemon11:24:381
171489954,1cyclictest743-21snmpd11:30:301
171489954,1cyclictest12230-21df08:15:131
171489953,2cyclictest25878-21sshd08:49:271
171489953,1cyclictest522-21avahi-daemon12:10:071
171489952,3cyclictest557-21NetworkManager12:05:071
171489952,3cyclictest15945-21ntpq11:00:171
171489952,2cyclictest30324-21who10:15:221
171489952,2cyclictest244-20systemd-journal07:38:471
171489952,2cyclictest16314-21ntp_kernel_err12:20:171
171489952,2cyclictest15249-21wc08:20:211
171489951,3cyclictest19142-21ls11:10:001
171489950,5cyclictest1773-21ntpq10:25:161
171429955,0cyclictest7852-21gltestperf12:00:140
171429955,0cyclictest741-21lldpd08:53:120
171429954,1cyclictest0-21swapper/012:15:140
171429953,2cyclictest743-21snmpd12:24:290
171429952,3cyclictest1059-21apt-get10:25:130
171429952,2cyclictest7605-21latency10:40:130
171429952,2cyclictest4937-21cat09:15:170
171429952,2cyclictest15640-21irqstats11:00:140
171429952,2cyclictest12296-21ntpq12:10:170
171429951,3cyclictest743-21snmpd12:35:100
171529942,2cyclictest717-21ntpd08:25:092
171529941,2cyclictest5776-21awk10:35:162
171529941,2cyclictest17655-21expr07:10:132
171529940,4cyclictest747-21runrttasks09:35:112
171529940,3cyclictest19636-21apt-get11:10:112
171529940,3cyclictest15666-21/usr/sbin/munin12:20:132
171529940,3cyclictest10811-21ntpq08:10:162
171489943,1cyclictest14509-21cpuspeed_turbos09:40:131
171489942,2cyclictest717-21ntpd07:15:191
171489941,3cyclictest557-21NetworkManager07:40:011
171489941,2cyclictest32691-21awk07:45:151
171489941,2cyclictest2153-21missed_timers07:50:161
171489940,4cyclictest26203-21ntpq07:30:151
171489940,4cyclictest22146-21ntpq07:20:171
171489940,3cyclictest16288-21diskstats08:25:141
171429942,1cyclictest14537-21cat08:20:140
171429941,2cyclictest6861-21expr09:20:150
171429941,2cyclictest32645-21gpgv09:04:590
171429941,2cyclictest28542-21grep11:30:170
171429940,3cyclictest20062-21ntpq07:15:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional