You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 05:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sat Aug 01, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30287991918,1cyclictest65850irq/126-lan23:30:120
30287991918,1cyclictest65850irq/126-lan23:16:370
30287991918,1cyclictest65850irq/126-lan22:32:540
30287991918,1cyclictest65850irq/126-lan19:20:210
30287991817,1cyclictest65850irq/126-lan21:15:180
30287991817,1cyclictest65850irq/126-lan21:05:130
30287991817,1cyclictest65850irq/126-lan20:55:140
30287991717,0cyclictest65850irq/126-lan20:15:190
30287991717,0cyclictest65850irq/126-lan00:15:130
30287991716,1cyclictest65850irq/126-lan23:40:200
30287991716,1cyclictest65850irq/126-lan23:35:150
30287991716,1cyclictest65850irq/126-lan23:10:170
30287991716,1cyclictest65850irq/126-lan23:05:170
30287991716,1cyclictest65850irq/126-lan22:50:000
30287991716,1cyclictest65850irq/126-lan21:00:140
30287991716,1cyclictest65850irq/126-lan20:50:170
30287991716,1cyclictest65850irq/126-lan19:30:190
30287991716,1cyclictest65850irq/126-lan19:10:120
30287991716,1cyclictest65850irq/126-lan00:10:120
30287991616,0cyclictest65850irq/126-lan23:55:040
30287991616,0cyclictest65850irq/126-lan22:01:520
30287991616,0cyclictest65850irq/126-lan21:55:130
30287991616,0cyclictest65850irq/126-lan20:44:270
30287991616,0cyclictest65850irq/126-lan19:55:150
30287991616,0cyclictest65850irq/126-lan19:25:120
30287991615,1cyclictest65850irq/126-lan23:45:130
30287991615,1cyclictest65850irq/126-lan22:45:100
30287991615,1cyclictest65850irq/126-lan22:25:150
30287991615,1cyclictest65850irq/126-lan22:14:330
30287991615,1cyclictest65850irq/126-lan21:30:200
30287991615,1cyclictest65850irq/126-lan21:23:330
30287991615,1cyclictest65850irq/126-lan20:25:170
30287991615,1cyclictest65850irq/126-lan20:20:100
30287991615,1cyclictest65850irq/126-lan20:05:210
30287991615,1cyclictest65850irq/126-lan19:40:110
30287991615,1cyclictest65850irq/126-lan00:35:170
30287991615,1cyclictest65850irq/126-lan00:25:130
30287991515,0cyclictest65850irq/126-lan22:20:110
30287991515,0cyclictest65850irq/126-lan20:45:130
30287991515,0cyclictest65850irq/126-lan19:35:140
30287991514,1cyclictest65850irq/126-lan23:00:160
30287991514,1cyclictest65850irq/126-lan22:35:190
30287991514,1cyclictest65850irq/126-lan22:15:190
30287991514,1cyclictest65850irq/126-lan21:45:120
30287991514,1cyclictest65850irq/126-lan00:20:170
30287991514,1cyclictest65850irq/126-lan00:00:110
30287991414,0cyclictest65850irq/126-lan22:40:200
30287991413,1cyclictest65850irq/126-lan20:10:190
30287991413,1cyclictest65850irq/126-lan19:50:220
30287991313,0cyclictest65850irq/126-lan23:26:180
30287991313,0cyclictest65850irq/126-lan21:50:140
30287991212,0cyclictest65850irq/126-lan23:50:110
30287991212,0cyclictest65850irq/126-lan21:12:340
30287991212,0cyclictest65850irq/126-lan20:35:130
30287991212,0cyclictest65850irq/126-lan19:17:000
30287991211,1cyclictest65850irq/126-lan22:55:120
30287991211,1cyclictest65850irq/126-lan21:40:170
30287991211,1cyclictest65850irq/126-lan21:35:330
30287991211,1cyclictest65850irq/126-lan21:25:200
30287991110,1cyclictest65850irq/126-lan23:20:210
30287991110,1cyclictest65850irq/126-lan00:30:140
3028799109,1cyclictest65850irq/126-lan20:30:170
3028799109,1cyclictest65850irq/126-lan20:00:170
3028799109,1cyclictest65850irq/126-lan19:45:210
303029998,1cyclictest743-21snmpd21:07:153
303029998,1cyclictest743-21snmpd20:57:443
303029998,1cyclictest743-21snmpd19:58:003
303029998,1cyclictest743-21snmpd19:46:333
303029998,1cyclictest743-21snmpd19:33:183
302979998,1cyclictest743-21snmpd20:51:002
302909998,1cyclictest743-21snmpd21:16:051
302909998,1cyclictest743-21snmpd20:06:011
302909998,1cyclictest743-21snmpd00:38:051
302909998,1cyclictest743-21snmpd00:16:161
302909998,1cyclictest741-21lldpd00:14:001
303029988,0cyclictest743-21snmpd21:13:033
303029988,0cyclictest743-21snmpd21:01:093
303029988,0cyclictest743-21snmpd20:33:053
303029988,0cyclictest743-21snmpd00:06:573
303029988,0cyclictest741-21lldpd22:58:293
303029988,0cyclictest741-21lldpd20:06:313
303029987,1cyclictest743-21snmpd22:36:123
303029987,1cyclictest743-21snmpd20:38:023
303029987,1cyclictest741-21lldpd21:37:283
303029986,2cyclictest743-21snmpd22:33:203
303029986,2cyclictest743-21snmpd20:27:103
303029986,2cyclictest743-21snmpd00:36:313
303029986,2cyclictest743-21snmpd00:24:213
303029986,2cyclictest4916-21cat20:45:153
303029985,3cyclictest743-21snmpd22:14:423
302979988,0cyclictest743-21snmpd23:43:062
302979988,0cyclictest743-21snmpd21:46:222
302979988,0cyclictest743-21snmpd20:43:192
302979988,0cyclictest743-21snmpd19:51:062
302979988,0cyclictest743-21snmpd00:07:062
302979988,0cyclictest741-21lldpd22:00:532
302979988,0cyclictest741-21lldpd20:37:392
302979988,0cyclictest741-21lldpd19:36:182
302979988,0cyclictest741-21lldpd19:33:202
302979987,1cyclictest743-21snmpd00:35:052
302979987,1cyclictest743-21snmpd00:11:402
302979987,1cyclictest741-21lldpd21:16:072
302909988,0cyclictest743-21snmpd21:57:501
302909988,0cyclictest743-21snmpd21:01:501
302909987,1cyclictest741-21lldpd23:26:581
302909987,1cyclictest741-21lldpd19:14:371
302909987,1cyclictest522-21avahi-daemon21:25:211
302909986,2cyclictest743-21snmpd22:24:331
302909986,2cyclictest743-21snmpd21:07:571
302909986,2cyclictest743-21snmpd20:19:421
302879988,0cyclictest65850irq/126-lan00:07:440
303029977,0cyclictest743-21snmpd23:55:243
303029977,0cyclictest743-21snmpd23:36:323
303029977,0cyclictest743-21snmpd23:15:563
303029977,0cyclictest743-21snmpd22:16:143
303029977,0cyclictest743-21snmpd22:05:413
303029977,0cyclictest743-21snmpd21:28:043
303029977,0cyclictest743-21snmpd00:00:243
303029977,0cyclictest741-21lldpd20:54:053
303029977,0cyclictest741-21lldpd19:36:403
303029976,1cyclictest743-21snmpd23:26:263
303029976,1cyclictest743-21snmpd00:15:403
303029976,1cyclictest741-21lldpd23:53:093
303029976,1cyclictest741-21lldpd21:48:393
303029976,1cyclictest23044-21gltestperf20:10:193
303029975,2cyclictest743-21snmpd23:32:413
303029975,2cyclictest743-21snmpd23:21:043
303029975,2cyclictest743-21snmpd21:16:083
303029975,2cyclictest743-21snmpd19:42:263
302979977,0cyclictest743-21snmpd23:01:072
302979977,0cyclictest743-21snmpd20:55:422
302979977,0cyclictest743-21snmpd20:06:432
302979977,0cyclictest743-21snmpd00:22:062
302979977,0cyclictest741-21lldpd22:53:142
302979977,0cyclictest741-21lldpd00:04:482
302979976,1cyclictest743-21snmpd21:10:212
302979975,2cyclictest743-21snmpd22:22:002
302979975,2cyclictest743-21snmpd22:15:262
302979975,2cyclictest743-21snmpd20:32:372
302979975,2cyclictest743-21snmpd20:02:102
302979975,2cyclictest743-21snmpd19:42:592
302979975,2cyclictest21499-21cat21:25:142
302909977,0cyclictest741-21lldpd23:48:201
302909977,0cyclictest741-21lldpd23:16:491
302909977,0cyclictest741-21lldpd22:48:331
302909977,0cyclictest741-21lldpd22:31:391
302909977,0cyclictest741-21lldpd00:01:041
302909976,1cyclictest743-21snmpd23:04:071
302909976,1cyclictest743-21snmpd20:49:551
302909976,1cyclictest741-21lldpd20:57:071
302909976,1cyclictest522-21avahi-daemon22:05:091
302909976,1cyclictest19355-21gltestperf21:20:141
302909975,2cyclictest743-21snmpd22:27:391
302909975,2cyclictest743-21snmpd20:40:351
302909975,2cyclictest743-21snmpd19:17:291
302909975,2cyclictest15431-21cat21:10:151
302909975,2cyclictest0-21swapper/120:40:001
302879976,1cyclictest65850irq/126-lan22:05:150
303029966,0cyclictest741-21lldpd23:00:193
303029965,1cyclictest743-21snmpd21:21:583
303029965,1cyclictest743-21snmpd19:22:223
303029965,1cyclictest743-21snmpd19:15:023
303029965,1cyclictest741-21lldpd00:30:343
303029965,1cyclictest522-21avahi-daemon22:21:063
303029965,1cyclictest4230-21cpuspeed_turbos19:25:123
303029964,2cyclictest743-21snmpd21:44:283
303029964,2cyclictest743-21snmpd21:33:123
303029964,2cyclictest743-21snmpd20:22:503
303029964,2cyclictest743-21snmpd19:52:063
302979966,0cyclictest743-21snmpd22:08:082
302979966,0cyclictest743-21snmpd00:26:372
302979966,0cyclictest741-21lldpd23:35:532
302979966,0cyclictest522-21avahi-daemon22:48:082
302979966,0cyclictest522-21avahi-daemon20:24:402
302979966,0cyclictest506-21systemd-resolve21:21:432
302979966,0cyclictest2989-21apt-get22:00:002
302979965,1cyclictest522-21avahi-daemon00:33:302
302979964,2cyclictest743-21snmpd23:48:302
302979964,2cyclictest743-21snmpd22:29:362
302979962,3cyclictest25837-21ntpq21:35:162
302979962,3cyclictest24321-21sed21:30:202
302979962,3cyclictest23671-21sed20:10:252
302909966,0cyclictest743-21snmpd21:49:581
302909966,0cyclictest741-21lldpd23:21:351
302909966,0cyclictest741-21lldpd22:53:021
302909966,0cyclictest741-21lldpd22:03:021
302909966,0cyclictest741-21lldpd21:50:181
302909966,0cyclictest741-21lldpd20:21:231
302909966,0cyclictest522-21avahi-daemon00:23:571
302909966,0cyclictest522-21avahi-daemon00:05:111
302909964,2cyclictest743-21snmpd23:36:141
302909964,2cyclictest743-21snmpd21:36:221
302909964,2cyclictest743-21snmpd20:04:211
302909962,4cyclictest876-21cat00:35:011
302909962,3cyclictest8033-21apt-get23:30:121
302909962,3cyclictest7856-21diskstats22:10:121
302909962,3cyclictest32516-21diskstats23:10:131
303029955,0cyclictest741-21lldpd21:57:543
303029955,0cyclictest522-21avahi-daemon22:44:043
303029955,0cyclictest30281-21cyclictest22:50:013
303029954,1cyclictest743-21snmpd23:47:123
303029954,1cyclictest743-21snmpd00:27:253
303029952,2cyclictest19082-21ld20:00:183
303029952,2cyclictest14154-21smartctl22:25:133
303029951,3cyclictest23545-21fw_forwarded_lo00:10:093
303029950,4cyclictest31227-21ntpq19:10:153
302979955,0cyclictest522-21avahi-daemon22:14:502
302979955,0cyclictest522-21avahi-daemon21:07:152
302979954,1cyclictest16553-21cat23:50:132
302979953,2cyclictest958-21grep21:55:002
302979953,2cyclictest743-21snmpd23:16:292
302979953,2cyclictest743-21snmpd23:11:262
302979952,2cyclictest575-21rs:main2
302979952,2cyclictest512-21kernelversion19:15:152
302979952,2cyclictest26045-21unixbench_multi20:15:212
302979952,2cyclictest18634-21gcc22:35:162
302979952,1cyclictest0-21swapper/223:00:002
302979951,3cyclictest12509-21sed21:04:592
302979950,4cyclictest6816-21ntpq23:25:162
302909955,0cyclictest741-21lldpd19:24:101
302909955,0cyclictest741-21lldpd00:25:461
302909954,1cyclictest743-21snmpd19:32:541
302909954,1cyclictest522-21avahi-daemon23:55:211
302909954,1cyclictest27430-21gltestperf21:40:151
302909953,2cyclictest743-21snmpd21:33:001
302909953,2cyclictest6925-21cat20:50:151
302909953,2cyclictest244-20systemd-journal20:30:111
302909952,3cyclictest557-21NetworkManager23:09:411
302909952,3cyclictest557-21NetworkManager19:41:121
302909952,3cyclictest557-21NetworkManager19:38:511
302909952,2cyclictest4762-21cat19:25:151
302909952,2cyclictest23098-21grep20:10:201
302909952,2cyclictest18026-21grep22:35:111
302909952,2cyclictest16276-21diskstats23:50:121
302909952,2cyclictest13031-21ntpq19:45:171
302909951,3cyclictest20352-21sed22:40:141
302909950,5cyclictest557-21NetworkManager22:59:261
303029943,1cyclictest743-21snmpd21:52:323
303029943,1cyclictest557-21NetworkManager23:05:113
303029942,2cyclictest25527-21ntpq20:15:173
303029941,2cyclictest4066-21basename22:00:133
303029941,2cyclictest24541-21sort22:50:143
303029941,2cyclictest12829-21ntpq23:40:163
302979944,0cyclictest741-21lldpd19:56:322
302979944,0cyclictest741-21lldpd00:15:102
302979943,1cyclictest4230-21cpuspeed_turbos19:25:122
302979943,1cyclictest21941-21kworker/2:1+events_freezable_pwr_efficient22:42:432
302979942,2cyclictest557-21NetworkManager23:55:212
302979942,2cyclictest557-21NetworkManager19:10:122
302979942,2cyclictest4759-21ntpq23:20:152
302979942,2cyclictest4721-21cut20:45:132
302979942,2cyclictest31236-21pluginstate23:05:172
302979941,2cyclictest29533-21ntpq20:25:162
302979941,2cyclictest28512-21seq21:40:352
302979941,2cyclictest2311-21df_inode19:20:142
302979941,2cyclictest13073-21uname19:45:182
302979940,4cyclictest16487-21ntpq22:30:152
302909943,1cyclictest331ktimers/120:25:141
302909943,1cyclictest0-21swapper/123:40:131
302909942,2cyclictest16682-21cat19:55:131
302909941,2cyclictest14514-21fschecks_time19:50:181
303029930,3cyclictest32402-21cpuspeed_turbos23:10:133
302909930,3cyclictest557-21NetworkManager22:15:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional