You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 21:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 24, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
557123523,0sleep10-21swapper/106:38:591
304450350,0irq/25-eth10-21swapper/306:38:573
589423425,0sleep20-21swapper/206:42:482
589723322,0sleep00-21swapper/006:42:500
59889976,0cyclictest0-21swapper/106:58:231
59869966,0cyclictest0-21swapper/007:13:170
59869960,0cyclictest0-21swapper/009:46:500
339960,0migration/39926-21sh10:26:353
339960,0migration/37154-21sh11:23:263
339960,0migration/332714-21sh11:22:043
339960,0migration/326358-21sh09:33:373
339960,0migration/319898-21sh08:51:413
339960,0migration/317940-21sh09:48:463
339960,0migration/315105-21munin-node07:13:153
339960,0migration/312151-21sh09:28:073
339960,0migration/310787-21sh09:03:303
29715060,0irq/26-eth0-rx-32075-21awk10:38:193
29715060,0irq/26-eth0-rx-26065-21rm10:15:523
29715060,0irq/26-eth0-rx-22023-21cut07:43:123
29715060,0irq/26-eth0-rx-19667-21tr11:53:133
8215050,0irq/24-0000:00:19322-21perf06:52:592
59899955,0cyclictest0-21swapper/209:09:362
59899954,0cyclictest13668-21grep08:48:142
59889955,0cyclictest0-21swapper/111:38:131
59889955,0cyclictest0-21swapper/108:58:211
59889955,0cyclictest0-21swapper/108:28:151
59869955,0cyclictest0-21swapper/009:37:040
59869954,0cyclictest13697-21ps09:08:140
59869950,0cyclictest25659-21munin-run10:57:580
59869950,0cyclictest0-21swapper/010:48:570
59869950,0cyclictest0-21swapper/009:49:030
4150,0ktimersoftd/00-21swapper/009:23:350
4150,0ktimersoftd/00-21swapper/008:47:240
339950,0migration/38493-21taskset10:43:563
339950,0migration/34730-21kthreadcore11:43:203
339950,0migration/34488-21kthreadcore07:28:163
339950,0migration/34460-21gltestperf09:43:173
339950,0migration/330422-21kthreadcore09:18:153
339950,0migration/328659-21kthreadcore11:38:153
339950,0migration/328096-21kthreadcore06:58:163
339950,0migration/327375-21aten_r1power_po07:23:103
339950,0migration/326710-21kthreadcore11:58:133
339950,0migration/323783-21kthreadcore06:53:173
339950,0migration/322138-21kthreadcore09:53:153
339950,0migration/321408-21taskset08:03:203
339950,0migration/321003-21taskset07:39:093
339950,0migration/319579-21if_eth1.210:33:163
339950,0migration/319252-21kthreadcore08:28:163
339950,0migration/311901-21hwlatdetect10:08:123
339950,0migration/311398-21kthreadcore12:08:153
339950,0migration/311300-21fschecks_time10:28:133
29725050,0irq/27-eth0-tx-7813-21munin-node12:08:102
29725050,0irq/27-eth0-tx-3514-21snmpd11:01:112
29725050,0irq/27-eth0-tx-26015-21perl11:18:092
29725050,0irq/27-eth0-tx-20121-21grep11:53:132
29725050,0irq/27-eth0-tx-19351-21gltestperf10:33:142
29725050,0irq/27-eth0-tx-16941-21telnet08:28:100
29725050,0irq/27-eth0-tx-0-21swapper/211:43:182
29725050,0irq/27-eth0-tx-0-21swapper/210:16:562
29725050,0irq/27-eth0-tx-0-21swapper/008:33:160
29725050,0irq/27-eth0-tx-0-21swapper/007:38:200
29715050,0irq/26-eth0-rx-32591-21diskstats12:03:143
29715050,0irq/26-eth0-rx-24796-21irqrtprio08:33:173
29715050,0irq/26-eth0-rx-23829-21cut08:53:163
29715050,0irq/26-eth0-rx-2148-21ssh10:22:313
29715050,0irq/26-eth0-rx-1641-21sed07:48:213
29715050,0irq/26-eth0-rx-15795-21kthreadcore09:08:163
29715050,0irq/26-eth0-rx-14630-21cut06:48:163
29715050,0irq/26-eth0-rx-10452-21df_abs10:48:083
29715050,0irq/26-eth0-rx-0-21swapper/311:33:153
29715050,0irq/26-eth0-rx-0-21swapper/311:28:393
29715050,0irq/26-eth0-rx-0-21swapper/310:58:153
29715050,0irq/26-eth0-rx-0-21swapper/309:23:143
29715050,0irq/26-eth0-rx-0-21swapper/309:15:433
29715050,0irq/26-eth0-rx-0-21swapper/308:08:163
259950,0migration/217781-21sh09:28:192
249950,0watchdog/229649-21ssh08:58:132
179950,0migration/16218-21kthreadcore11:23:171
179950,0migration/13220-21aten2.4-expect10:03:141
179950,0migration/131730-21switchtime10:58:201
179950,0migration/130066-21latency_hist08:37:591
179950,0migration/129282-21irqcore07:48:141
179950,0migration/125587-21sh10:14:251
179950,0migration/121351-21gltestperf09:13:111
179950,0migration/115433-21kthreadcore07:13:161
179950,0migration/115351-21fschecks_count07:38:101
179950,0migration/111894-21kthreadcore12:08:151
149950,0migration/09549-21aten2.4-expect11:08:090
149950,0migration/04784-21kthreadcore10:03:190
149950,0migration/03050-21sh09:20:400
149950,0migration/029515-21kernelversion07:48:150
149950,0migration/02859-21sh08:59:070
149950,0migration/01521-21aten_r1power_en11:03:130
149950,0migration/01260-21taskset10:41:250
8215040,0irq/24-0000:00:0-21swapper/211:47:582
59899944,0cyclictest0-21swapper/209:48:042
59899943,0cyclictest3652-21awk10:23:192
59899943,0cyclictest3241-21irqbalance11:33:072
59899943,0cyclictest3241-21irqbalance11:28:172
59899943,0cyclictest3241-21irqbalance08:43:072
59899943,0cyclictest3241-21irqbalance08:33:372
59899943,0cyclictest3241-21irqbalance08:28:072
59899943,0cyclictest3241-21irqbalance08:19:572
59899943,0cyclictest3241-21irqbalance08:13:072
59899943,0cyclictest3241-21irqbalance07:58:272
59899943,0cyclictest3241-21irqbalance07:48:382
59899943,0cyclictest3241-21irqbalance07:44:582
59899943,0cyclictest3241-21irqbalance07:38:082
59899943,0cyclictest3241-21irqbalance07:34:282
59899943,0cyclictest3241-21irqbalance07:28:082
59899943,0cyclictest3241-21irqbalance07:18:382
59899943,0cyclictest3241-21irqbalance07:08:382
59899943,0cyclictest3241-21irqbalance07:03:282
59899943,0cyclictest3241-21irqbalance06:58:182
59899943,0cyclictest31236-21awk08:38:162
59899943,0cyclictest28525-21awk09:58:132
59899943,0cyclictest20452-21awk06:53:142
59899943,0cyclictest16763-21awk08:03:142
59899943,0cyclictest11100-21awk08:23:122
59899941,0cyclictest0-21swapper/208:53:092
59889944,0cyclictest0-21swapper/109:28:281
59889944,0cyclictest0-21swapper/109:03:151
59889943,0cyclictest3514-21snmpd12:03:131
59889943,0cyclictest3514-21snmpd11:34:281
59889943,0cyclictest3514-21snmpd11:20:581
59889943,0cyclictest3514-21snmpd11:13:131
59889943,0cyclictest3514-21snmpd11:08:131
59889943,0cyclictest3514-21snmpd10:45:281
59889943,0cyclictest3514-21snmpd09:58:131
59889943,0cyclictest3514-21snmpd09:52:131
59889943,0cyclictest3514-21snmpd09:38:131
59889943,0cyclictest3241-21irqbalance09:18:071
59889943,0cyclictest27012-21sadc07:22:591
59889943,0cyclictest2423-21awk07:28:141
59889943,0cyclictest20476-21awk06:53:151
59889943,0cyclictest19311-21sadc06:52:591
59889943,0cyclictest16787-21awk08:03:151
59889943,0cyclictest1381-21awk11:43:181
59869944,0cyclictest0-21swapper/011:44:370
59869944,0cyclictest0-21swapper/011:19:320
59869943,0cyclictest8251-21irqcore07:08:150
59869943,0cyclictest717-21awk12:03:160
59869943,0cyclictest3556-21lldpd08:12:460
59869943,0cyclictest3514-21snmpd12:09:280
59869943,0cyclictest3514-21snmpd11:41:280
59869943,0cyclictest3514-21snmpd07:23:120
59869943,0cyclictest3241-21irqbalance10:35:070
59869943,0cyclictest3241-21irqbalance10:29:570
59869943,0cyclictest3241-21irqbalance09:13:370
59869943,0cyclictest3241-21irqbalance09:03:070
59869943,0cyclictest30085-21awk08:13:110
59869943,0cyclictest22441-21awk07:43:130
59869941,0cyclictest0-21swapper/007:03:100
339940,0migration/36110-21proc_pri07:03:193
339940,0migration/330415-21kthreadcore09:38:153
339940,0migration/32965-21kthreadcore11:03:183
29725040,0irq/27-eth0-tx-3657-21ssh09:43:052
29725040,0irq/27-eth0-tx-29380-21irqstats09:38:152
29725040,0irq/27-eth0-tx-24920-21perl11:58:102
29725040,0irq/27-eth0-tx-20929-21expr09:13:102
29725040,0irq/27-eth0-tx-2070-21munin-node10:43:242
29725040,0irq/27-eth0-tx-19607-21munin-node09:53:112
29725040,0irq/27-eth0-tx-11187-21ssh09:04:302
29725040,0irq/27-eth0-tx-10245-21munin-node08:23:090
29725040,0irq/27-eth0-tx-0-21swapper/212:04:342
29725040,0irq/27-eth0-tx-0-21swapper/211:38:012
29725040,0irq/27-eth0-tx-0-21swapper/211:03:012
29725040,0irq/27-eth0-tx-0-21swapper/210:53:102
29725040,0irq/27-eth0-tx-0-21swapper/210:28:182
29725040,0irq/27-eth0-tx-0-21swapper/210:08:242
29725040,0irq/27-eth0-tx-0-21swapper/210:03:132
29725040,0irq/27-eth0-tx-0-21swapper/209:23:192
29725040,0irq/27-eth0-tx-0-21swapper/209:18:112
29725040,0irq/27-eth0-tx-0-21swapper/008:18:200
29725040,0irq/27-eth0-tx-0-21swapper/007:28:110
29725040,0irq/27-eth0-tx-0-21swapper/007:18:200
29715040,0irq/26-eth0-rx-9770-21munin-node11:08:103
29715040,0irq/26-eth0-rx-14341-21unixbench-2d11:48:193
29715040,0irq/26-eth0-rx-0-21swapper/311:13:143
29715040,0irq/26-eth0-rx-0-21swapper/310:53:063
29715040,0irq/26-eth0-rx-0-21swapper/310:03:113
29715040,0irq/26-eth0-rx-0-21swapper/309:58:093
29715040,0irq/26-eth0-rx-0-21swapper/308:58:103
29715040,0irq/26-eth0-rx-0-21swapper/308:43:083
29715040,0irq/26-eth0-rx-0-21swapper/308:18:153
29715040,0irq/26-eth0-rx-0-21swapper/308:13:143
29715040,0irq/26-eth0-rx-0-21swapper/307:33:113
29715040,0irq/26-eth0-rx-0-21swapper/307:22:593
259940,0migration/27016-21taskset06:43:142
259940,0migration/25755-21kthreadcore07:53:162
259940,0migration/231388-21kthreadcore10:38:182
259940,0migration/230003-21kthreadcore10:18:142
259940,0migration/229486-21kthreadcore07:23:152
259940,0migration/218277-21munin-node11:13:122
259940,0migration/213923-21latency_hist07:12:592
259940,0migration/211676-21kthreadcore11:08:152
249940,0watchdog/25805-21grep11:23:162
249940,0watchdog/225463-21latency09:33:172
249940,0watchdog/214015-21kthreadcore10:48:132
249940,0watchdog/20-21swapper/208:08:212
179940,0migration/16915-21kthreadcore10:23:211
179940,0migration/16655-21kthreadcore08:43:141
179940,0migration/14962-21idleruntime09:23:121
179940,0migration/128699-21taskset08:09:541
179940,0migration/126185-21missed_timers08:53:171
179940,0migration/122266-21kthreadcore09:33:161
179940,0migration/121323-21kthreadcore10:53:141
179940,0migration/12079-21kthreadcore08:38:181
179940,0migration/116954-21ksmtuned10:28:521
179940,0migration/116638-21taskset08:27:551
179940,0migration/115353-21taskset11:29:151
179940,0migration/114510-21taskset07:36:161
179940,0migration/112852-21kthreadcore10:08:141
179940,0migration/112575-21kthreadcore10:48:121
169940,0watchdog/18190-21ssh11:04:491
169940,0watchdog/16841-21perl06:43:141
169940,0watchdog/128540-21grep10:38:171
169940,0watchdog/125312-21ssh10:35:051
169940,0watchdog/123511-21ssh11:56:281
169940,0watchdog/120447-21if_err_eth009:53:131
169940,0watchdog/113533-21if_err_eth1.209:08:131
169940,0watchdog/113531-21if_err_eth1.308:48:131
169940,0watchdog/10-21swapper/111:58:121
169940,0watchdog/10-21swapper/108:13:091
149940,0migration/09781-21kthreadcore07:33:160
149940,0migration/07344-21irqcore06:43:160
149940,0migration/05403-21kthreadcore07:53:160
149940,0migration/04311-21kthreadcore10:23:200
149940,0migration/030735-21kthreadcore09:58:150
149940,0migration/027279-21kthreadcore11:58:130
149940,0migration/026042-21aten_r1power_po10:58:090
149940,0migration/025983-21kthreadcore08:53:160
149940,0migration/020073-21kthreadcore11:13:140
149940,0migration/017418-21irqcore11:53:120
149940,0migration/016929-21aten_r1power_en11:33:090
149940,0migration/014984-21kthreadcore08:48:150
149940,0migration/014835-21timerandwakeup11:28:200
149940,0migration/012852-21kthreadcore07:58:160
59889932,0cyclictest3514-21snmpd08:18:121
59889932,0cyclictest3514-21snmpd07:08:121
59889932,0cyclictest27829-21sh10:18:111
59889932,0cyclictest22595-21grep07:43:151
59889932,0cyclictest1463-21awk07:03:141
59889932,0cyclictest13746-21cut07:58:161
59869933,0cyclictest5710-21kworker/0:008:03:160
59869932,0cyclictest3881-21unixbench_singl08:38:230
59869932,0cyclictest3556-21lldpd11:23:490
59869932,0cyclictest28993-21awk09:38:130
59869932,0cyclictest27948-21awk10:18:120
59869932,0cyclictest20491-21awk09:53:130
59869932,0cyclictest20329-21sed06:53:140
59869932,0cyclictest11056-21grep11:48:130
59869930,0cyclictest26242-21munin-node06:58:130
59869930,0cyclictest19691-21perl10:13:110
59869930,0cyclictest12030-21sh10:08:120
59869930,0cyclictest0-21swapper/010:43:120
29725030,0irq/27-eth0-tx-12936-21aten2.4-expect06:48:100
29715030,0irq/26-eth0-rx-0-21swapper/307:58:273
29715030,0irq/26-eth0-rx-0-21swapper/307:55:393
29715030,0irq/26-eth0-rx-0-21swapper/307:09:003
29715030,0irq/26-eth0-rx-0-21swapper/306:43:293
179930,0migration/13696-21irqrtprio07:53:151
179930,0migration/11212-21runrttasks07:27:361
169930,0watchdog/10-21swapper/111:48:201
169930,0watchdog/10-21swapper/109:43:171
149930,0migration/012117-21sh09:28:010
29715020,0irq/26-eth0-rx-0-21swapper/308:38:143
29715020,0irq/26-eth0-rx-0-21swapper/308:23:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional