You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 14:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Thu Jan 08, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13585991818,0cyclictest65850irq/126-lan23:14:270
13585991818,0cyclictest65850irq/126-lan21:05:160
13585991818,0cyclictest65850irq/126-lan19:44:310
13585991817,1cyclictest65850irq/126-lan23:50:120
13585991817,1cyclictest65850irq/126-lan20:33:170
13585991817,1cyclictest65850irq/126-lan00:30:120
13585991817,1cyclictest65850irq/126-lan00:15:160
13585991717,0cyclictest65850irq/126-lan23:23:280
13585991717,0cyclictest65850irq/126-lan19:30:150
13585991716,1cyclictest65850irq/126-lan23:45:150
13585991716,1cyclictest65850irq/126-lan23:40:120
13585991716,1cyclictest65850irq/126-lan23:35:190
13585991716,1cyclictest65850irq/126-lan23:25:450
13585991716,1cyclictest65850irq/126-lan22:55:100
13585991716,1cyclictest65850irq/126-lan22:40:170
13585991716,1cyclictest65850irq/126-lan22:10:100
13585991716,1cyclictest65850irq/126-lan21:50:110
13585991716,1cyclictest65850irq/126-lan20:55:130
13585991716,1cyclictest65850irq/126-lan20:45:130
13585991616,0cyclictest65850irq/126-lan22:39:320
13585991615,1cyclictest65850irq/126-lan23:15:170
13585991615,1cyclictest65850irq/126-lan23:05:170
13585991615,1cyclictest65850irq/126-lan22:01:160
13585991615,1cyclictest65850irq/126-lan20:25:130
13585991615,1cyclictest65850irq/126-lan20:17:130
13585991615,1cyclictest65850irq/126-lan20:05:130
13585991615,1cyclictest65850irq/126-lan19:38:110
13585991615,1cyclictest65850irq/126-lan19:25:160
13585991615,1cyclictest65850irq/126-lan19:10:110
13585991615,1cyclictest65850irq/126-lan00:35:110
13585991615,1cyclictest65850irq/126-lan00:25:190
13585991515,0cyclictest65850irq/126-lan22:30:110
13585991515,0cyclictest65850irq/126-lan21:55:000
13585991515,0cyclictest65850irq/126-lan20:20:140
13585991515,0cyclictest65850irq/126-lan19:17:130
13585991515,0cyclictest65850irq/126-lan00:00:250
13585991514,1cyclictest65850irq/126-lan22:25:160
13585991514,1cyclictest65850irq/126-lan22:15:170
13585991514,1cyclictest65850irq/126-lan22:15:170
13585991514,1cyclictest65850irq/126-lan21:40:150
13585991514,1cyclictest65850irq/126-lan20:50:110
13585991514,1cyclictest65850irq/126-lan20:35:090
13585991514,1cyclictest65850irq/126-lan00:20:120
13585991514,1cyclictest65850irq/126-lan00:08:190
13585991513,1cyclictest65850irq/126-lan20:10:110
13585991414,0cyclictest65850irq/126-lan19:50:180
13585991413,1cyclictest65850irq/126-lan21:10:150
13585991413,1cyclictest65850irq/126-lan19:20:150
1359099136,5cyclictest24297-21cat19:35:141
13585991313,0cyclictest65850irq/126-lan23:59:150
13585991313,0cyclictest65850irq/126-lan23:30:120
13585991313,0cyclictest65850irq/126-lan21:30:150
13585991313,0cyclictest65850irq/126-lan21:00:190
13585991313,0cyclictest65850irq/126-lan00:10:190
13585991312,1cyclictest65850irq/126-lan22:20:140
13585991312,1cyclictest65850irq/126-lan21:48:110
13585991312,1cyclictest65850irq/126-lan19:45:180
1359099123,7cyclictest557-21NetworkManager21:03:201
13585991212,0cyclictest65850irq/126-lan23:00:160
13585991212,0cyclictest65850irq/126-lan21:27:150
13585991212,0cyclictest65850irq/126-lan21:20:190
13585991212,0cyclictest65850irq/126-lan20:40:140
13585991211,1cyclictest65850irq/126-lan22:50:120
13585991211,1cyclictest65850irq/126-lan22:05:150
13585991211,1cyclictest65850irq/126-lan19:55:220
13585991111,0cyclictest65850irq/126-lan21:19:160
13585991110,1cyclictest65850irq/126-lan21:35:130
1359099108,2cyclictest743-21snmpd22:09:521
1359099107,3cyclictest16303-21idleruntime-cro20:35:001
1359099104,4cyclictest522-21avahi-daemon21:54:511
1359099100,7cyclictest0-21swapper/121:33:101
1359099100,6cyclictest22327-21chrt23:26:031
1359099100,6cyclictest18537-21cpu22:00:111
1359099100,6cyclictest14868-21cat19:10:191
135989998,1cyclictest743-21snmpd20:13:453
135989998,1cyclictest743-21snmpd19:45:043
135989998,1cyclictest743-21snmpd19:13:343
135939998,1cyclictest743-21snmpd22:05:072
135939998,1cyclictest741-21lldpd23:15:492
135939996,3cyclictest743-21snmpd00:32:202
135939996,2cyclictest743-21snmpd23:10:172
135909998,1cyclictest743-21snmpd22:33:141
135909998,1cyclictest741-21lldpd20:37:001
135909997,2cyclictest743-21snmpd22:42:311
135909997,2cyclictest743-21snmpd22:29:401
135909996,3cyclictest743-21snmpd21:16:321
135909996,3cyclictest743-21snmpd20:53:221
135909995,4cyclictest743-21snmpd20:57:101
135909995,4cyclictest743-21snmpd19:48:581
135909992,5cyclictest9818-21grep00:15:201
135909990,7cyclictest17913-21/usr/sbin/munin00:35:151
135909990,7cyclictest14648-21chrt00:26:281
135909990,6cyclictest747-21runrttasks21:08:171
135909990,6cyclictest747-21runrttasks20:46:011
135909990,6cyclictest17415-21taskset19:18:371
135909990,6cyclictest16282-21chrt23:11:181
135909990,6cyclictest14230-21seq20:29:261
135909990,5cyclictest6497-21expr20:10:171
135909990,5cyclictest5086-21ntpq21:25:151
135909990,4cyclictest18787-21ps19:20:171
135859998,1cyclictest743-21snmpd22:46:440
135989988,0cyclictest743-21snmpd23:03:063
135989988,0cyclictest743-21snmpd22:56:593
135989988,0cyclictest743-21snmpd21:23:023
135989988,0cyclictest743-21snmpd20:52:313
135989988,0cyclictest743-21snmpd20:07:413
135989988,0cyclictest743-21snmpd20:01:113
135989988,0cyclictest743-21snmpd19:17:073
135989988,0cyclictest741-21lldpd23:22:443
135989988,0cyclictest741-21lldpd20:21:443
135989988,0cyclictest741-21lldpd19:53:193
135989987,1cyclictest743-21snmpd22:12:093
135989987,1cyclictest743-21snmpd20:15:203
135989987,1cyclictest741-21lldpd19:34:593
135989987,1cyclictest23256-21gltestperf23:30:153
135989986,2cyclictest743-21snmpd00:22:003
135989985,3cyclictest743-21snmpd00:05:443
135939988,0cyclictest743-21snmpd23:35:372
135939988,0cyclictest741-21lldpd20:12:292
135939987,1cyclictest743-21snmpd22:00:512
135939987,1cyclictest743-21snmpd21:20:142
135939987,1cyclictest743-21snmpd19:30:192
135939987,1cyclictest743-21snmpd19:19:162
135939987,1cyclictest741-21lldpd23:30:502
135939987,1cyclictest741-21lldpd22:10:132
135939987,1cyclictest741-21lldpd20:28:402
135939986,2cyclictest743-21snmpd22:41:462
135939986,2cyclictest743-21snmpd21:51:132
135939986,2cyclictest743-21snmpd21:09:162
135939986,2cyclictest743-21snmpd00:37:092
135909987,1cyclictest743-21snmpd19:53:381
135909986,2cyclictest743-21snmpd20:40:391
135909986,2cyclictest717-21ntpd00:00:131
135909984,4cyclictest743-21snmpd22:52:391
135909983,5cyclictest17403-21memory23:15:141
135909980,7cyclictest24206-21taskset22:13:531
135909980,7cyclictest22895-21find23:30:111
135909980,7cyclictest0-21swapper/122:57:401
135909980,6cyclictest32076-21chrt21:10:221
135909980,6cyclictest25113-21cat22:15:141
135909980,6cyclictest25113-21cat22:15:131
135909980,6cyclictest20535-21chrt23:23:521
135909980,5cyclictest5257-21wc22:45:151
135909980,5cyclictest32651-21chrt23:54:061
135909980,5cyclictest3108-21chrt20:02:211
135909980,5cyclictest30628-21chrt23:48:561
135909980,5cyclictest28502-21chrt23:42:281
135909980,5cyclictest11940-21seq20:21:011
135909980,5cyclictest10115-21chrt21:39:331
135909980,5cyclictest0-21swapper/122:38:561
135909980,5cyclictest0-21swapper/119:30:061
135909980,4cyclictest3164-21ntpq21:20:161
135909980,4cyclictest17239-21ntpq21:55:161
135909980,4cyclictest11193-21cpu00:20:121
135909980,4cyclictest0-21swapper/121:40:351
135859988,0cyclictest65850irq/126-lan20:00:180
135989977,0cyclictest743-21snmpd23:54:173
135989977,0cyclictest743-21snmpd21:45:273
135989977,0cyclictest743-21snmpd21:27:023
135989977,0cyclictest743-21snmpd21:11:373
135989977,0cyclictest743-21snmpd00:02:403
135989977,0cyclictest741-21lldpd20:31:523
135989977,0cyclictest741-21lldpd00:35:063
135989977,0cyclictest506-21systemd-resolve22:53:113
135989976,1cyclictest743-21snmpd20:47:423
135989976,1cyclictest743-21snmpd19:44:223
135989976,1cyclictest26936-21cut21:00:143
135989976,1cyclictest21167-21fschecks_time23:25:133
135989976,1cyclictest11401-21proc_pri21:40:173
135989975,2cyclictest743-21snmpd23:57:133
135989975,2cyclictest743-21snmpd23:35:253
135989975,2cyclictest743-21snmpd22:41:103
135989975,2cyclictest743-21snmpd22:02:123
135989975,2cyclictest743-21snmpd21:34:063
135989975,2cyclictest743-21snmpd00:19:533
135939977,0cyclictest743-21snmpd23:05:082
135939977,0cyclictest743-21snmpd22:22:372
135939977,0cyclictest743-21snmpd21:47:422
135939977,0cyclictest743-21snmpd00:28:442
135939977,0cyclictest741-21lldpd23:03:072
135939977,0cyclictest741-21lldpd22:30:232
135939977,0cyclictest741-21lldpd21:55:572
135939977,0cyclictest741-21lldpd20:24:122
135939976,1cyclictest743-21snmpd21:19:572
135939976,1cyclictest743-21snmpd19:47:222
135939976,1cyclictest743-21snmpd00:11:382
135939976,1cyclictest741-21lldpd20:09:392
135939976,1cyclictest23945-21cpuspeed_turbos19:35:122
135939975,2cyclictest743-21snmpd23:58:222
135939975,2cyclictest743-21snmpd23:50:352
135939975,2cyclictest743-21snmpd21:29:442
135939975,2cyclictest743-21snmpd20:15:232
135909973,4cyclictest27169-21memory22:20:151
135909970,7cyclictest12630-21diskstats21:45:121
135909970,6cyclictest6693-21apt00:10:111
135909970,6cyclictest5520-21ntp_states00:05:181
135909970,6cyclictest3688-21grep20:05:111
135909970,6cyclictest19890-21cpu19:25:131
135909970,5cyclictest15176-21seq00:30:061
135909970,4cyclictest9532-21chrt20:16:461
135909970,4cyclictest26767-21ntpq19:40:161
135909970,4cyclictest13537-21/usr/sbin/munin23:05:171
135909970,4cyclictest11619-21ld23:00:171
135909970,4cyclictest0-21swapper/123:58:311
135909970,4cyclictest0-21swapper/123:35:201
135909970,4cyclictest0-21swapper/119:56:401
135989966,0cyclictest743-21snmpd23:46:263
135989966,0cyclictest741-21lldpd22:20:293
135989966,0cyclictest741-21lldpd19:24:453
135989965,1cyclictest743-21snmpd22:31:593
135989965,1cyclictest743-21snmpd21:54:063
135989965,1cyclictest743-21snmpd19:26:193
135989965,1cyclictest743-21snmpd00:14:263
135989965,1cyclictest28761-21cpuspeed_turbos21:05:123
135989964,2cyclictest743-21snmpd22:06:423
135989964,2cyclictest743-21snmpd20:59:343
135989964,2cyclictest743-21snmpd00:26:413
135989963,3cyclictest557-21NetworkManager23:10:213
135989963,3cyclictest32554-21sed19:55:173
135989961,4cyclictest13369-21memory23:05:153
135939966,0cyclictest743-21snmpd21:39:592
135939966,0cyclictest743-21snmpd20:04:112
135939966,0cyclictest741-21lldpd23:26:122
135939966,0cyclictest741-21lldpd22:51:002
135939966,0cyclictest741-21lldpd21:00:252
135939966,0cyclictest741-21lldpd00:03:332
135939966,0cyclictest506-21systemd-resolve23:48:122
135939965,1cyclictest743-21snmpd23:43:342
135939965,1cyclictest743-21snmpd19:25:042
135939965,1cyclictest522-21avahi-daemon20:48:202
135939965,1cyclictest522-21avahi-daemon20:35:152
135939964,2cyclictest743-21snmpd22:58:562
135939964,2cyclictest743-21snmpd20:41:452
135939964,2cyclictest743-21snmpd19:20:492
135939963,3cyclictest506-21systemd-resolve21:10:392
135939963,3cyclictest20243-21users23:20:192
135939962,3cyclictest11875-21ntp_192.168.11400:20:162
135989955,0cyclictest743-21snmpd23:40:183
135989955,0cyclictest743-21snmpd22:28:553
135989954,1cyclictest17327-21ntpq21:55:173
135989953,2cyclictest8993-21sed21:35:143
135989953,2cyclictest743-21snmpd20:37:153
135989951,3cyclictest568-21fw_conntrack21:15:133
135989951,3cyclictest16084-21cut00:30:173
135939955,0cyclictest522-21avahi-daemon19:57:052
135939953,2cyclictest9064-21tail00:15:132
135939953,2cyclictest743-21snmpd21:40:412
135939953,2cyclictest743-21snmpd20:50:372
135939952,2cyclictest6420-21cron00:10:002
135939952,2cyclictest4959-21grep22:45:132
135939952,2cyclictest25009-21sed20:55:142
135939952,2cyclictest244-20systemd-journal22:26:022
135939952,2cyclictest1794-21timerandwakeup22:35:192
135939951,3cyclictest26756-21ntp_states19:40:162
135939951,3cyclictest24736-21diskstats22:15:122
135939951,3cyclictest24736-21diskstats22:15:112
135989944,0cyclictest743-21snmpd19:35:433
135989942,2cyclictest1851-21sed22:35:193
135989941,3cyclictest24910-21grep22:15:133
135989941,3cyclictest24910-21grep22:15:123
135989941,2cyclictest4891-21df22:45:123
135989941,2cyclictest19697-21cat20:40:183
135989940,3cyclictest17016-21/usr/sbin/munin23:15:133
135989940,3cyclictest12991-21irqstats20:25:153
135939943,1cyclictest743-21snmpd19:10:062
135939941,3cyclictest6661-21perl21:30:122
135939941,2cyclictest30074-21grep19:50:122
135939940,3cyclictest14728-21/usr/sbin/munin20:30:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional