You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 12:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Thu Mar 19, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17741991918,1cyclictest65850irq/126-lan22:54:171
17741991817,1cyclictest65850irq/126-lan23:05:121
17741991817,1cyclictest65850irq/126-lan22:56:371
17741991817,1cyclictest65850irq/126-lan20:00:181
17741991817,1cyclictest65850irq/126-lan00:00:211
17746991717,0cyclictest743-21snmpd23:34:582
17746991717,0cyclictest743-21snmpd19:41:562
17746991717,0cyclictest18502-21cat00:25:122
17741991717,0cyclictest65850irq/126-lan23:35:121
17741991717,0cyclictest65850irq/126-lan22:26:071
17741991716,1cyclictest65850irq/126-lan23:00:161
17741991716,1cyclictest65850irq/126-lan22:10:171
17741991716,1cyclictest65850irq/126-lan21:55:131
17741991716,1cyclictest65850irq/126-lan21:45:141
17741991716,1cyclictest65850irq/126-lan20:15:161
17746991616,0cyclictest836-21cat21:05:142
17746991616,0cyclictest743-21snmpd21:10:282
17746991616,0cyclictest743-21snmpd20:54:422
17746991616,0cyclictest743-21snmpd20:42:122
17746991616,0cyclictest743-21snmpd20:00:522
17746991616,0cyclictest743-21snmpd19:55:352
17746991616,0cyclictest743-21snmpd00:22:172
17746991616,0cyclictest27508-21cat22:10:142
17741991616,0cyclictest65850irq/126-lan23:23:361
17741991616,0cyclictest65850irq/126-lan22:05:171
17741991616,0cyclictest65850irq/126-lan21:03:351
17741991616,0cyclictest65850irq/126-lan20:59:361
17741991616,0cyclictest65850irq/126-lan00:11:361
17741991615,1cyclictest65850irq/126-lan23:25:141
17741991615,1cyclictest65850irq/126-lan23:15:121
17741991615,1cyclictest65850irq/126-lan23:10:111
17741991615,1cyclictest65850irq/126-lan21:35:191
17741991615,1cyclictest65850irq/126-lan19:59:161
17741991615,1cyclictest65850irq/126-lan19:20:101
17746991515,0cyclictest743-21snmpd23:11:352
17746991515,0cyclictest743-21snmpd22:34:552
17746991515,0cyclictest743-21snmpd22:02:012
17746991515,0cyclictest743-21snmpd22:02:002
17746991515,0cyclictest743-21snmpd21:35:052
17746991515,0cyclictest21771-21cat23:15:142
17746991515,0cyclictest10943-21cat21:30:142
17741991515,0cyclictest65850irq/126-lan23:30:141
17741991515,0cyclictest65850irq/126-lan22:48:341
17741991515,0cyclictest65850irq/126-lan20:45:121
17741991515,0cyclictest65850irq/126-lan20:10:161
17741991515,0cyclictest65850irq/126-lan00:05:111
17741991514,1cyclictest65850irq/126-lan22:15:121
17741991514,1cyclictest65850irq/126-lan21:15:151
17741991514,1cyclictest65850irq/126-lan21:10:151
17741991514,1cyclictest65850irq/126-lan21:05:171
17741991514,1cyclictest65850irq/126-lan20:50:211
17741991514,1cyclictest65850irq/126-lan20:25:181
17741991514,1cyclictest65850irq/126-lan20:20:111
17741991514,1cyclictest65850irq/126-lan20:05:111
17741991514,1cyclictest65850irq/126-lan00:30:141
17746991414,0cyclictest743-21snmpd22:41:522
17741991414,0cyclictest65850irq/126-lan22:30:201
17741991413,1cyclictest65850irq/126-lan23:55:171
17741991413,1cyclictest65850irq/126-lan21:25:171
17741991413,1cyclictest65850irq/126-lan21:20:141
17741991413,1cyclictest65850irq/126-lan20:30:141
17741991413,1cyclictest65850irq/126-lan19:50:121
17741991413,1cyclictest65850irq/126-lan19:40:051
17741991413,1cyclictest65850irq/126-lan00:20:121
17741991313,0cyclictest65850irq/126-lan22:35:191
17741991312,1cyclictest65850irq/126-lan23:40:201
17741991312,1cyclictest65850irq/126-lan21:30:121
17741991312,1cyclictest65850irq/126-lan20:40:091
17741991312,1cyclictest65850irq/126-lan19:30:161
17741991312,1cyclictest65850irq/126-lan19:25:181
17741991312,1cyclictest65850irq/126-lan19:15:111
17741991312,1cyclictest65850irq/126-lan00:35:211
17741991212,0cyclictest65850irq/126-lan22:00:111
17741991212,0cyclictest65850irq/126-lan22:00:101
17741991212,0cyclictest65850irq/126-lan21:50:181
17741991212,0cyclictest65850irq/126-lan21:44:121
17741991211,1cyclictest65850irq/126-lan23:50:171
17741991211,1cyclictest65850irq/126-lan22:20:121
17741991211,1cyclictest65850irq/126-lan19:45:161
17741991111,0cyclictest65850irq/126-lan00:18:371
1774199109,1cyclictest65850irq/126-lan19:10:181
1774199109,1cyclictest65850irq/126-lan00:25:181
17741991010,0cyclictest65850irq/126-lan20:35:151
177509998,1cyclictest743-21snmpd22:14:313
177509998,1cyclictest743-21snmpd20:42:313
177419999,0cyclictest65850irq/126-lan22:40:191
177419999,0cyclictest65850irq/126-lan19:35:121
177379998,1cyclictest743-21snmpd23:42:040
177509988,0cyclictest743-21snmpd22:02:073
177509988,0cyclictest743-21snmpd22:02:063
177509988,0cyclictest741-21lldpd21:10:353
177509988,0cyclictest741-21lldpd21:04:183
177509988,0cyclictest741-21lldpd00:11:053
177509988,0cyclictest741-21lldpd00:00:503
177509987,1cyclictest743-21snmpd23:36:123
177509987,1cyclictest743-21snmpd22:40:503
177509987,1cyclictest743-21snmpd00:38:063
177509987,1cyclictest743-21snmpd00:05:253
177509987,1cyclictest741-21lldpd00:32:403
177509986,2cyclictest743-21snmpd22:28:323
177509986,2cyclictest743-21snmpd21:08:163
177509986,2cyclictest29180-21cat20:55:143
177469988,0cyclictest741-21lldpd23:04:172
177469988,0cyclictest741-21lldpd22:57:362
177469988,0cyclictest741-21lldpd20:12:542
177469988,0cyclictest741-21lldpd19:30:212
177469987,1cyclictest743-21snmpd22:36:162
177469987,1cyclictest743-21snmpd00:01:562
177469987,1cyclictest741-21lldpd21:27:082
177469986,2cyclictest743-21snmpd21:59:332
177469986,2cyclictest743-21snmpd20:29:272
177469986,2cyclictest743-21snmpd19:47:252
177379988,0cyclictest741-21lldpd22:40:510
177379988,0cyclictest741-21lldpd00:23:140
177379987,1cyclictest743-21snmpd23:01:120
177379987,1cyclictest743-21snmpd21:50:080
177379987,1cyclictest743-21snmpd21:44:050
177379987,1cyclictest743-21snmpd20:22:260
177379987,1cyclictest741-21lldpd21:58:090
177379987,1cyclictest522-21avahi-daemon00:17:560
177379986,2cyclictest743-21snmpd23:21:270
177379986,2cyclictest743-21snmpd22:24:220
177379986,2cyclictest743-21snmpd20:52:000
177379986,2cyclictest743-21snmpd19:30:480
177509977,0cyclictest743-21snmpd23:17:583
177509977,0cyclictest743-21snmpd19:22:243
177509977,0cyclictest741-21lldpd23:40:153
177509977,0cyclictest741-21lldpd21:24:263
177509977,0cyclictest741-21lldpd20:53:003
177509977,0cyclictest741-21lldpd20:32:063
177509977,0cyclictest741-21lldpd20:27:223
177509977,0cyclictest741-21lldpd20:11:383
177509976,1cyclictest9102-21gltestperf22:45:143
177509976,1cyclictest743-21snmpd22:35:223
177509976,1cyclictest741-21lldpd19:52:273
177509976,1cyclictest522-21avahi-daemon21:58:083
177509975,2cyclictest743-21snmpd22:16:003
177509975,2cyclictest743-21snmpd20:45:183
177509975,2cyclictest743-21snmpd19:56:563
177509975,2cyclictest743-21snmpd19:49:523
177469977,0cyclictest743-21snmpd22:47:542
177469977,0cyclictest743-21snmpd20:47:332
177469977,0cyclictest743-21snmpd00:30:302
177469977,0cyclictest741-21lldpd19:52:532
177469976,1cyclictest741-21lldpd23:59:442
177469975,2cyclictest743-21snmpd23:28:182
177469972,5cyclictest557-21NetworkManager20:18:222
177419977,0cyclictest743-21snmpd23:46:201
177379977,0cyclictest743-21snmpd23:53:290
177379977,0cyclictest743-21snmpd22:58:410
177379977,0cyclictest743-21snmpd22:08:060
177379977,0cyclictest743-21snmpd21:18:590
177379977,0cyclictest743-21snmpd20:12:470
177379977,0cyclictest741-21lldpd23:45:270
177379977,0cyclictest741-21lldpd23:36:310
177379977,0cyclictest741-21lldpd23:18:110
177379977,0cyclictest741-21lldpd21:08:060
177379977,0cyclictest741-21lldpd20:46:290
177379977,0cyclictest741-21lldpd20:37:500
177379977,0cyclictest741-21lldpd19:21:010
177379976,1cyclictest743-21snmpd22:51:500
177379976,1cyclictest743-21snmpd20:40:240
177379976,1cyclictest743-21snmpd20:34:100
177379976,1cyclictest741-21lldpd22:32:480
177379976,1cyclictest741-21lldpd00:34:310
177379976,1cyclictest6900-21cat21:20:140
177379976,1cyclictest23133-21cut22:00:100
177379976,1cyclictest23133-21cut22:00:100
177379975,2cyclictest743-21snmpd22:16:400
177509966,0cyclictest743-21snmpd00:17:273
177509966,0cyclictest741-21lldpd23:13:553
177509966,0cyclictest741-21lldpd22:50:583
177509966,0cyclictest741-21lldpd19:12:123
177509966,0cyclictest506-21systemd-resolve22:24:223
177509965,1cyclictest573-21in:imuxsock22:31:423
177509965,1cyclictest522-21avahi-daemon21:50:143
177509965,1cyclictest522-21avahi-daemon19:30:423
177509965,1cyclictest13447-21needreboot22:55:163
177509964,2cyclictest743-21snmpd20:22:113
177509964,2cyclictest743-21snmpd20:09:563
177509964,2cyclictest743-21snmpd19:18:003
177509962,3cyclictest23366-21apt-get23:20:113
177509962,3cyclictest11335-21ntpq21:30:163
177469966,0cyclictest741-21lldpd21:53:232
177469966,0cyclictest741-21lldpd21:45:062
177469965,1cyclictest3136-21cpuspeed_turbos23:50:102
177469965,1cyclictest2808-21cut23:50:002
177469962,3cyclictest20233-21fw_forwarded_lo19:15:132
177469962,1cyclictest0-21swapper/221:00:142
177379966,0cyclictest522-21avahi-daemon19:38:020
177379965,1cyclictest743-21snmpd23:33:280
177379965,1cyclictest743-21snmpd00:26:230
177379965,1cyclictest743-21snmpd00:14:590
177379965,1cyclictest312-21gltestperf19:45:120
177379964,2cyclictest743-21snmpd20:58:150
177379964,2cyclictest743-21snmpd20:07:020
177379964,2cyclictest743-21snmpd20:03:260
177379964,2cyclictest743-21snmpd00:06:500
177509955,0cyclictest6271-21timerwakeupswit23:55:203
177509955,0cyclictest522-21avahi-daemon00:25:583
177509953,2cyclictest743-21snmpd19:41:463
177509952,3cyclictest743-21snmpd21:25:383
177509952,3cyclictest557-21NetworkManager23:53:033
177509952,3cyclictest12353-21diskstats20:15:123
177509952,2cyclictest26001-21grep22:05:173
177509952,2cyclictest244-20systemd-journal23:00:073
177509952,2cyclictest244-20systemd-journal20:00:463
177509951,3cyclictest17716-21ld23:05:173
177509950,4cyclictest16918-21ntpq00:20:163
177469955,0cyclictest741-21lldpd19:10:382
177469955,0cyclictest741-21lldpd00:36:412
177469955,0cyclictest522-21avahi-daemon23:21:492
177469955,0cyclictest522-21avahi-daemon21:21:112
177469954,1cyclictest506-21systemd-resolve22:54:272
177469954,1cyclictest421ktimers/220:55:162
177469954,1cyclictest21538-21ntpq20:35:172
177469953,2cyclictest743-21snmpd22:06:392
177469953,2cyclictest743-21snmpd21:43:592
177469953,2cyclictest717-21ntpd19:29:412
177469953,2cyclictest717-21ntpd19:20:532
177469952,3cyclictest743-21snmpd00:09:292
177469952,3cyclictest17454-21sed23:05:152
177469952,2cyclictest8162-21apt-get20:05:112
177469952,2cyclictest32511-21grep23:40:202
177469952,2cyclictest29317-21grep19:35:162
177469952,2cyclictest18636-21dpkg20:30:012
177469951,3cyclictest31114-21apt22:20:122
177469951,3cyclictest30134-21sed22:15:182
177469951,2cyclictest6304-21cat21:20:002
177469950,4cyclictest30193-21ntpq23:35:172
177379955,0cyclictest743-21snmpd20:17:270
177379955,0cyclictest741-21lldpd21:14:420
177379954,1cyclictest743-21snmpd21:46:540
177379954,1cyclictest743-21snmpd19:55:190
177379954,1cyclictest741-21lldpd22:39:430
177379953,2cyclictest743-21snmpd23:59:190
177379953,2cyclictest743-21snmpd23:05:110
177379953,2cyclictest16229-21apt-get20:25:110
177379953,2cyclictest0-21swapper/019:29:340
177379953,0cyclictest0-21swapper/021:35:100
177379952,2cyclictest8957-21cut21:25:130
177379952,2cyclictest3006-21pmu-power19:50:180
177379952,2cyclictest244-20systemd-journal22:48:460
177379951,3cyclictest18526-21cat19:10:140
177379950,4cyclictest8369-21ntpq00:00:170
177509942,2cyclictest29449-21awk19:35:183
177509942,2cyclictest27818-21cat23:30:153
177509942,1cyclictest24683-21nfs4_client19:25:153
177509941,2cyclictest5202-21ld21:15:153
177509941,2cyclictest22536-21ls20:40:003
177509941,2cyclictest13299-21ntpq21:35:153
177509940,4cyclictest15764-21ntpq21:40:163
177509940,3cyclictest25542-21diskstats23:25:123
177509940,3cyclictest1887-21ntp_states23:45:173
177469942,2cyclictest1993-21unixbench_multi22:25:222
177469941,2cyclictest15091-21ld20:20:162
177469941,2cyclictest14323-21head00:15:132
177469941,2cyclictest11650-21dpkg00:09:592
177379943,1cyclictest31234-21ntpq19:40:160
177379942,2cyclictest743-21snmpd23:25:000
177379942,2cyclictest743-21snmpd22:10:030
177379942,2cyclictest557-21NetworkManager19:15:010
177379942,0cyclictest0-21swapper/022:25:110
177379941,3cyclictest743-21snmpd21:30:120
177379941,2cyclictest30916-21expr21:00:120
177379941,2cyclictest19936-21needreboot23:10:140
177379940,3cyclictest22833-21ldconfig00:35:170
177509930,3cyclictest16977-21apt-get21:45:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional