You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 04:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Jan 09, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5469993434,0cyclictest32707-21fwupd21:33:422
5469993434,0cyclictest32707-21fwupd21:33:412
5461991918,1cyclictest65850irq/126-lan00:25:160
5461991818,0cyclictest65850irq/126-lan22:50:200
5461991818,0cyclictest65850irq/126-lan00:35:110
5461991817,1cyclictest65850irq/126-lan23:20:000
5461991817,1cyclictest65850irq/126-lan23:00:160
5461991817,1cyclictest65850irq/126-lan21:26:020
5461991717,0cyclictest743-21snmpd20:17:310
5461991717,0cyclictest65850irq/126-lan23:25:140
5461991717,0cyclictest65850irq/126-lan22:00:150
5461991717,0cyclictest65850irq/126-lan20:55:270
5461991716,1cyclictest65850irq/126-lan23:45:130
5461991716,1cyclictest65850irq/126-lan23:42:380
5461991716,1cyclictest65850irq/126-lan22:20:100
5461991716,1cyclictest65850irq/126-lan19:35:120
5461991716,1cyclictest65850irq/126-lan19:15:130
5464991616,0cyclictest7222-21cat21:50:141
5461991616,0cyclictest743-21snmpd22:48:190
5461991616,0cyclictest743-21snmpd21:43:580
5461991616,0cyclictest743-21snmpd20:10:340
5461991616,0cyclictest65850irq/126-lan23:35:110
5461991616,0cyclictest65850irq/126-lan22:05:460
5461991616,0cyclictest65850irq/126-lan21:55:160
5461991616,0cyclictest65850irq/126-lan21:55:000
5461991616,0cyclictest65850irq/126-lan21:20:180
5461991616,0cyclictest65850irq/126-lan19:40:140
5461991616,0cyclictest65850irq/126-lan00:30:180
5461991616,0cyclictest65850irq/126-lan00:18:010
5461991616,0cyclictest5183-21cat21:45:140
5461991615,1cyclictest65850irq/126-lan23:20:150
5461991615,1cyclictest65850irq/126-lan22:35:590
5461991615,1cyclictest65850irq/126-lan22:25:210
5461991615,1cyclictest65850irq/126-lan21:05:180
5461991615,1cyclictest65850irq/126-lan21:00:160
5461991615,1cyclictest65850irq/126-lan19:10:140
5461991615,1cyclictest65850irq/126-lan00:10:190
5461991615,1cyclictest65850irq/126-lan00:10:000
5461991515,0cyclictest743-21snmpd22:12:350
5461991515,0cyclictest743-21snmpd19:33:480
5461991515,0cyclictest743-21snmpd19:27:030
5461991515,0cyclictest65850irq/126-lan23:32:150
5461991515,0cyclictest65850irq/126-lan23:05:150
5461991515,0cyclictest65850irq/126-lan21:30:110
5461991515,0cyclictest65850irq/126-lan21:30:110
5461991515,0cyclictest65850irq/126-lan20:52:450
5461991515,0cyclictest65850irq/126-lan20:30:240
5461991515,0cyclictest65850irq/126-lan20:25:130
5461991515,0cyclictest65850irq/126-lan19:55:160
5461991515,0cyclictest65850irq/126-lan19:24:250
5461991514,1cyclictest65850irq/126-lan22:40:150
5461991514,1cyclictest65850irq/126-lan21:15:160
5461991514,1cyclictest65850irq/126-lan21:10:150
5461991514,1cyclictest65850irq/126-lan20:40:100
5461991514,1cyclictest65850irq/126-lan20:20:190
5461991514,1cyclictest65850irq/126-lan20:00:010
5461991514,1cyclictest65850irq/126-lan19:50:200
5464991414,0cyclictest743-21snmpd22:14:241
5464991414,0cyclictest743-21snmpd00:11:341
5464991414,0cyclictest1133-21cat21:35:141
5461991414,0cyclictest743-21snmpd22:58:090
5461991414,0cyclictest65850irq/126-lan23:56:510
5461991414,0cyclictest65850irq/126-lan22:30:110
5461991414,0cyclictest65850irq/126-lan19:45:170
5461991414,0cyclictest65850irq/126-lan00:20:140
5461991414,0cyclictest17725-21cat22:15:150
5461991413,1cyclictest65850irq/126-lan23:51:530
5461991413,1cyclictest65850irq/126-lan21:35:110
5464991313,0cyclictest743-21snmpd23:54:331
5464991313,0cyclictest743-21snmpd23:04:461
5464991313,0cyclictest743-21snmpd22:15:091
5464991313,0cyclictest743-21snmpd21:01:181
5464991313,0cyclictest743-21snmpd20:31:201
5464991313,0cyclictest743-21snmpd20:22:161
5464991313,0cyclictest743-21snmpd20:07:421
5464991313,0cyclictest743-21snmpd19:59:311
5464991313,0cyclictest743-21snmpd00:39:441
5464991313,0cyclictest23443-21cat21:10:121
5461991313,0cyclictest65850irq/126-lan20:45:190
5461991313,0cyclictest65850irq/126-lan20:35:100
5461991313,0cyclictest65850irq/126-lan20:05:110
5464991212,0cyclictest743-21snmpd23:46:391
5464991212,0cyclictest743-21snmpd23:26:131
5464991212,0cyclictest743-21snmpd23:19:291
5464991212,0cyclictest743-21snmpd22:38:231
5464991212,0cyclictest743-21snmpd22:33:541
5464991212,0cyclictest743-21snmpd22:28:451
5464991212,0cyclictest743-21snmpd22:00:171
5464991212,0cyclictest743-21snmpd21:59:351
5464991212,0cyclictest743-21snmpd21:41:011
5464991212,0cyclictest743-21snmpd21:28:271
5464991212,0cyclictest743-21snmpd20:59:151
5464991212,0cyclictest743-21snmpd20:53:261
5464991212,0cyclictest743-21snmpd20:45:201
5464991212,0cyclictest743-21snmpd20:01:551
5464991212,0cyclictest743-21snmpd19:29:541
5464991212,0cyclictest743-21snmpd19:20:041
5464991212,0cyclictest743-21snmpd19:19:401
5464991212,0cyclictest743-21snmpd00:17:431
5464991212,0cyclictest1880-21cat22:55:121
5461991212,0cyclictest65850irq/126-lan00:00:200
5464991111,0cyclictest743-21snmpd22:47:551
5464991111,0cyclictest743-21snmpd21:19:071
5464991111,0cyclictest743-21snmpd19:50:031
54739998,1cyclictest743-21snmpd21:44:163
54739998,1cyclictest743-21snmpd21:24:423
54739998,1cyclictest743-21snmpd19:21:533
54739997,0cyclictest191rcu_preempt20:00:093
54699998,1cyclictest743-21snmpd21:07:592
54739988,0cyclictest743-21snmpd21:05:263
54739988,0cyclictest741-21lldpd23:09:563
54739988,0cyclictest741-21lldpd19:31:373
54739987,1cyclictest743-21snmpd23:10:563
54739987,1cyclictest743-21snmpd22:15:453
54739987,0cyclictest191rcu_preempt20:21:463
54739986,2cyclictest16944-21cat20:55:133
54739984,3cyclictest0-21swapper/322:52:173
54739984,2cyclictest15088-21cut22:10:003
54699988,0cyclictest743-21snmpd00:13:122
54699988,0cyclictest741-21lldpd21:25:522
54699988,0cyclictest741-21lldpd20:42:492
54699988,0cyclictest741-21lldpd20:24:122
54699988,0cyclictest741-21lldpd20:09:252
54699988,0cyclictest741-21lldpd19:57:382
54699987,1cyclictest743-21snmpd22:26:572
54699986,2cyclictest743-21snmpd23:30:382
54699986,2cyclictest743-21snmpd23:23:312
54699986,2cyclictest743-21snmpd22:10:412
54699986,2cyclictest743-21snmpd20:31:142
54649988,0cyclictest741-21lldpd22:07:171
54649988,0cyclictest522-21avahi-daemon22:50:301
54649987,1cyclictest743-21snmpd23:32:471
54649987,1cyclictest741-21lldpd23:22:391
54649987,1cyclictest522-21avahi-daemon23:39:521
54649986,2cyclictest743-21snmpd21:24:541
54649986,2cyclictest743-21snmpd00:32:141
54649985,3cyclictest743-21snmpd21:30:521
54649985,3cyclictest743-21snmpd21:30:521
54619988,0cyclictest65850irq/126-lan23:10:130
54739977,0cyclictest743-21snmpd21:51:023
54739977,0cyclictest743-21snmpd21:36:583
54739977,0cyclictest743-21snmpd20:17:153
54739977,0cyclictest743-21snmpd00:25:333
54739977,0cyclictest741-21lldpd22:10:363
54739977,0cyclictest741-21lldpd19:36:223
54739977,0cyclictest5455-21cyclictest21:48:243
54739976,1cyclictest743-21snmpd20:27:263
54739976,1cyclictest741-21lldpd23:53:383
54739976,1cyclictest27966-21kworker/3:0+events23:03:023
54739976,1cyclictest21216-21gltestperf23:40:143
54739976,0cyclictest191rcu_preempt20:00:013
54739975,2cyclictest7954-21gltestperf19:15:133
54739974,1cyclictest191rcu_preempt22:20:153
54739974,1cyclictest191rcu_preempt20:10:173
54739974,1cyclictest191rcu_preempt19:10:163
54739973,2cyclictest52-21ksoftirqd/322:45:003
54739973,2cyclictest52-21ksoftirqd/300:00:173
54739970,5cyclictest9273-21ntpq20:35:163
54739970,3cyclictest18885-21cat21:00:013
54699977,0cyclictest743-21snmpd23:58:442
54699977,0cyclictest743-21snmpd23:38:242
54699977,0cyclictest743-21snmpd23:04:012
54699977,0cyclictest743-21snmpd22:41:552
54699977,0cyclictest743-21snmpd21:38:102
54699977,0cyclictest743-21snmpd19:19:582
54699977,0cyclictest741-21lldpd23:52:062
54699976,1cyclictest743-21snmpd20:55:182
54699976,1cyclictest741-21lldpd20:25:592
54699975,2cyclictest743-21snmpd22:37:532
54699975,2cyclictest743-21snmpd21:17:452
54699975,2cyclictest743-21snmpd21:12:542
54699975,2cyclictest13688-21cat22:05:132
54699973,3cyclictest18322-21memory19:40:142
54649977,0cyclictest743-21snmpd20:13:191
54649977,0cyclictest743-21snmpd00:05:341
54649977,0cyclictest741-21lldpd23:11:491
54649977,0cyclictest741-21lldpd23:06:331
54649975,2cyclictest743-21snmpd20:40:561
54649975,2cyclictest743-21snmpd19:46:031
54649975,2cyclictest743-21snmpd19:44:301
54739966,0cyclictest743-21snmpd20:42:293
54739966,0cyclictest0-21swapper/321:15:183
54739965,1cyclictest743-21snmpd22:36:413
54739965,1cyclictest743-21snmpd20:47:593
54739965,0cyclictest191rcu_preempt22:30:213
54739965,0cyclictest191rcu_preempt00:35:193
54739964,2cyclictest5455-21cyclictest23:56:233
54739964,2cyclictest5455-21cyclictest22:45:063
54739964,2cyclictest5455-21cyclictest21:12:053
54739964,2cyclictest5455-21cyclictest20:33:403
54739964,2cyclictest5455-21cyclictest19:25:493
54739964,1cyclictest191rcu_preempt22:29:273
54739963,1cyclictest52-21ksoftirqd/321:30:163
54739963,1cyclictest52-21ksoftirqd/321:30:153
54739963,1cyclictest52-21ksoftirqd/319:45:153
54739963,1cyclictest191rcu_preempt22:55:133
54739963,1cyclictest11157-21ntpq23:15:173
54739962,4cyclictest557-21NetworkManager00:20:573
54739962,2cyclictest52-21ksoftirqd/321:29:483
54739962,2cyclictest0-21swapper/300:05:123
54739961,3cyclictest52-21ksoftirqd/321:55:153
54739961,3cyclictest16615-21diskstats23:30:123
54739961,2cyclictest52-21ksoftirqd/323:45:173
54739960,4cyclictest52-21ksoftirqd/319:45:013
54739960,4cyclictest4458-21ps00:15:203
54739960,4cyclictest29030-21gcc20:05:153
54739960,4cyclictest12044-21ntpq22:00:153
54739960,4cyclictest10098-21latency00:30:153
54739960,3cyclictest15247-21ntpq20:50:163
54739960,3cyclictest13230-21ntpq23:20:133
54699966,0cyclictest743-21snmpd22:03:142
54699966,0cyclictest743-21snmpd20:54:592
54699966,0cyclictest743-21snmpd00:19:342
54699966,0cyclictest743-21snmpd00:09:252
54699966,0cyclictest741-21lldpd22:32:502
54699966,0cyclictest741-21lldpd19:33:152
54699966,0cyclictest741-21lldpd00:26:392
54699965,1cyclictest522-21avahi-daemon23:44:372
54699965,1cyclictest522-21avahi-daemon19:13:472
54699965,1cyclictest31904-21cpuspeed_turbos22:50:112
54699964,2cyclictest743-21snmpd23:29:532
54699964,2cyclictest743-21snmpd22:45:372
54699964,2cyclictest743-21snmpd21:23:482
54699964,2cyclictest743-21snmpd20:03:572
54699964,2cyclictest743-21snmpd00:20:522
54699963,3cyclictest12002-21fw_forwarded_lo19:25:132
54699962,3cyclictest6227-21fw_conntrack23:05:122
54649965,1cyclictest743-21snmpd20:28:321
54649965,1cyclictest0-21swapper/119:30:181
54649962,3cyclictest29604-21entropy00:00:121
54739953,0cyclictest191rcu_preempt00:09:593
54739951,2cyclictest15542-21grep23:25:213
54739950,2cyclictest52-21ksoftirqd/323:35:113
54739950,2cyclictest52-21ksoftirqd/319:50:133
54699955,0cyclictest741-21lldpd00:38:462
54699955,0cyclictest522-21avahi-daemon21:47:182
54699955,0cyclictest522-21avahi-daemon21:44:312
54699954,1cyclictest9874-21gltestperf00:30:142
54699954,1cyclictest9110-21needreboot20:35:142
54699954,1cyclictest522-21avahi-daemon23:45:232
54699953,2cyclictest743-21snmpd19:21:012
54699952,2cyclictest9994-21ntp_kernel_pll_21:55:162
54699952,2cyclictest8646-21sed21:55:002
54699952,2cyclictest20323-21wc22:20:172
54699952,2cyclictest18428-21sed22:15:212
54699952,2cyclictest13841-21uptime20:45:222
54699951,3cyclictest8542-21diskstats23:10:122
54699951,3cyclictest244-20systemd-journal20:15:242
54699951,3cyclictest20547-21ntpq19:45:162
54649955,0cyclictest743-21snmpd19:10:051
54649955,0cyclictest522-21avahi-daemon21:06:351
54649954,1cyclictest0-21swapper/123:55:161
54649953,2cyclictest557-21NetworkManager22:40:061
54649952,2cyclictest5942-21smartctl00:20:121
54649952,2cyclictest5480-21ldconfig21:45:171
54649952,2cyclictest20413-21cat22:20:191
54649950,2cyclictest7696-21cpuspeed_turbos00:25:121
54649950,2cyclictest16462-21ld19:35:151
54699942,2cyclictest22217-21cat19:50:142
54699941,2cyclictest30886-21sed20:10:142
54699941,2cyclictest1432-21find22:55:102
54699940,4cyclictest19726-21ntpq21:00:162
54699940,4cyclictest16447-21ntpq19:35:152
54699940,3cyclictest30382-21proc_pri00:00:182
54699940,3cyclictest10556-21diskstats23:15:132
54649942,2cyclictest1070-21ntpq20:15:171
54649941,2cyclictest21343-21if_err_lan23:40:131
54649940,2cyclictest0-21swapper/120:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional