You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 22:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Mon Aug 24, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3260229591,0sleep20-21swapper/206:44:412
304450380,0irq/25-eth10-21swapper/306:42:093
3267623324,0sleep10-21swapper/106:45:321
3235223228,0sleep00-21swapper/006:41:470
3139976,0cyclictest510-21kthreadcore10:46:130
35160,0ktimersoftd/30-21swapper/308:53:373
339960,0migration/326159-21sh11:22:583
339960,0migration/325948-21sh11:43:533
339960,0migration/321799-21sh09:18:453
339960,0migration/320703-21sh10:20:343
339960,0migration/320572-21sh09:58:253
339960,0migration/317672-21sh11:37:533
339960,0migration/31215-21sh12:09:353
3169960,0cyclictest0-21swapper/210:51:542
3159960,0cyclictest30989-21diskmemload09:50:461
3159960,0cyclictest30989-21diskmemload09:06:471
29715060,0irq/26-eth0-rx-8282-21tr09:31:133
29715060,0irq/26-eth0-rx-32008-21sh08:46:093
29715060,0irq/26-eth0-rx-30270-21aten_r1power_po09:46:073
29715060,0irq/26-eth0-rx-30007-21diskstats10:06:093
29715060,0irq/26-eth0-rx-19198-21ssh10:37:313
29715060,0irq/26-eth0-rx-0-21swapper/312:15:243
259960,0migration/24313-21turbostat08:25:562
35150,0ktimersoftd/30-21swapper/308:17:313
339950,0migration/38698-21kthreadcore09:51:103
339950,0migration/37590-21kthreadcore08:26:153
339950,0migration/36386-21kthreadcore08:01:143
339950,0migration/35595-21kthreadcore07:11:143
339950,0migration/34358-21munin-node11:31:133
339950,0migration/33477-21latency_hist11:10:553
339950,0migration/331492-21kthreadcore11:06:123
339950,0migration/330638-21kthreadcore07:56:133
339950,0migration/330498-21kthreadcore07:06:123
339950,0migration/326758-21kthreadcore09:01:133
339950,0migration/326651-21kthreadcore08:41:123
339950,0migration/322665-21munin-node09:41:093
339950,0migration/321529-21kthreadcore08:36:143
339950,0migration/320977-21kthreadcore07:46:143
339950,0migration/319581-21pmu-power06:56:183
339950,0migration/319549-21kthreadcore08:56:133
339950,0migration/315656-21kthreadcore08:31:143
339950,0migration/315429-21kthreadcore10:56:123
339950,0migration/311473-21kthreadcore07:16:113
3169950,0cyclictest0-21swapper/208:50:012
3159955,0cyclictest30989-21diskmemload09:16:431
3159950,0cyclictest0-21swapper/112:01:181
3159950,0cyclictest0-21swapper/110:58:521
3159950,0cyclictest0-21swapper/109:43:501
3159950,0cyclictest0-21swapper/109:34:411
3159950,0cyclictest0-21swapper/109:14:301
3159950,0cyclictest0-21swapper/109:01:531
29725050,0irq/27-eth0-tx-8260-21cat10:11:122
29725050,0irq/27-eth0-tx-7388-21munin-node08:51:092
29725050,0irq/27-eth0-tx-5982-21ssh09:09:032
29725050,0irq/27-eth0-tx-2989-21munin-node11:31:142
29725050,0irq/27-eth0-tx-23939-21kthreadcore11:41:142
29725050,0irq/27-eth0-tx-21942-21if_err_eth010:21:102
29725050,0irq/27-eth0-tx-16404-21kthreadcore10:56:132
29725050,0irq/27-eth0-tx-14111-21ssh09:14:312
29725050,0irq/27-eth0-tx-0-21swapper/212:03:042
29725050,0irq/27-eth0-tx-0-21swapper/210:38:282
29725050,0irq/27-eth0-tx-0-21swapper/209:57:452
29725050,0irq/27-eth0-tx-0-21swapper/208:56:502
29725050,0irq/27-eth0-tx-0-21swapper/008:47:420
29725050,0irq/27-eth0-tx-0-21swapper/006:56:180
29725050,0irq/27-eth0-tx-0-21swapper/006:55:560
29715050,0irq/26-eth0-rx-9661-21ssh11:54:143
29715050,0irq/26-eth0-rx-6913-21aten2.4-expect09:11:053
29715050,0irq/26-eth0-rx-6079-21if_err_eth1.310:11:103
29715050,0irq/26-eth0-rx-6007-21kthreadcore10:31:123
29715050,0irq/26-eth0-rx-3131-21ssh10:48:403
29715050,0irq/26-eth0-rx-21241-21basename10:21:073
29715050,0irq/26-eth0-rx-20646-21cut10:41:073
29715050,0irq/26-eth0-rx-16778-21ssh11:56:403
29715050,0irq/26-eth0-rx-10669-21ssh10:52:153
29715050,0irq/26-eth0-rx-0-21swapper/312:01:453
29715050,0irq/26-eth0-rx-0-21swapper/311:26:473
29715050,0irq/26-eth0-rx-0-21swapper/310:28:393
29715050,0irq/26-eth0-rx-0-21swapper/310:02:143
29715050,0irq/26-eth0-rx-0-21swapper/309:39:153
29715050,0irq/26-eth0-rx-0-21swapper/309:26:173
29715050,0irq/26-eth0-rx-0-21swapper/307:51:193
259950,0migration/232167-21kthreadcore09:26:132
259950,0migration/230977-21kthreadcore10:06:132
259950,0migration/228947-21latency_hist10:25:552
259950,0migration/226471-21timerandwakeup07:01:192
259950,0migration/223136-21aten_r1power_cu09:01:072
259950,0migration/215847-21kthreadcore09:36:132
259950,0migration/212676-21mdstat06:51:132
259950,0migration/212254-21kthreadcore07:41:142
259950,0migration/212183-21switchtime09:31:192
249950,0watchdog/28372-21kthreadcore11:11:132
249950,0watchdog/26909-21tr11:51:132
249950,0watchdog/221096-21munin-node10:41:102
249950,0watchdog/215819-21cut11:16:132
249950,0watchdog/20-21swapper/209:21:142
249950,0watchdog/20-21swapper/208:36:142
179950,0migration/14345-21gltestperf11:11:091
179950,0migration/13457-21kthreadcore07:11:131
179950,0migration/119515-21kthreadcore08:11:131
179950,0migration/116152-21kthreadcore10:36:141
179950,0migration/115574-21kthreadcore09:56:121
179950,0migration/114669-21munin-node07:41:151
179950,0migration/110262-21latency_hist08:05:561
169950,0watchdog/17350-21kthreadcore07:36:141
169950,0watchdog/16786-21kthreadcore11:31:131
169950,0watchdog/118112-21ssh12:00:451
169950,0watchdog/115042-21cut09:36:101
149950,0migration/08555-21kthreadcore10:11:120
149950,0migration/08475-21kthreadcore09:51:100
149950,0migration/07637-21kthreadcore11:31:140
149950,0migration/03626-21sh11:11:070
149950,0migration/03405-21kthreadcore12:11:120
149950,0migration/030124-21kthreadcore07:06:110
149950,0migration/029252-21sh09:22:200
149950,0migration/027929-21latency_hist11:05:550
149950,0migration/027644-21munin-node11:26:070
149950,0migration/027055-21taskset11:25:410
149950,0migration/026881-21taskset10:41:410
149950,0migration/025853-21kthreadcore09:41:130
149950,0migration/025024-21kthreadcore07:26:110
149950,0migration/024833-21cpuspeed_turbos08:41:070
149950,0migration/024150-21irqcore09:01:120
149950,0migration/020370-21kthreadcore07:46:140
149950,0migration/019911-21kthreadcore08:11:130
149950,0migration/017595-21unixbench_multi11:16:190
149950,0migration/010668-21aten2.4-expect11:56:060
149950,0migration/01030-21kthreadcore10:26:110
8215040,0irq/24-0000:00:23380-21idleruntime-cro08:15:562
8215040,0irq/24-0000:00:0-21swapper/208:00:562
8215040,0irq/24-0000:00:0-21swapper/207:20:562
339940,0migration/34704-21kthreadcore07:36:133
339940,0migration/330188-21kthreadcore07:31:123
339940,0migration/318610-21kthreadcore08:11:133
339940,0migration/316625-21taskset08:09:563
3169943,0cyclictest3660-21awk07:36:122
3169943,0cyclictest3514-21snmpd11:46:062
3169943,0cyclictest3514-21snmpd10:01:062
3169943,0cyclictest3514-21snmpd08:31:212
3169943,0cyclictest3514-21snmpd08:04:212
3169943,0cyclictest3514-21snmpd07:13:062
3169943,0cyclictest20353-21awk11:21:092
3159944,0cyclictest0-21swapper/112:15:201
3159943,0cyclictest7754-21awk08:51:101
3159943,0cyclictest4498-21awk08:01:111
3159943,0cyclictest3514-21snmpd10:26:211
3159943,0cyclictest3514-21snmpd10:13:511
3159943,0cyclictest3514-21snmpd06:47:511
3159943,0cyclictest32150-21awk08:46:101
3159943,0cyclictest30166-21awk07:56:111
3159943,0cyclictest28415-21awk11:26:111
3159943,0cyclictest27333-21awk12:06:101
3159943,0cyclictest25463-21awk08:41:101
3159943,0cyclictest23655-21awk07:51:111
3159943,0cyclictest22574-21awk10:01:111
3139943,0cyclictest5147-21awk10:51:110
3139943,0cyclictest3947-21sed08:01:090
3139943,0cyclictest3612-21awk07:36:120
3139943,0cyclictest3514-21snmpd10:25:510
3139943,0cyclictest3514-21snmpd09:50:210
3139943,0cyclictest3432-21awk11:51:100
3139943,0cyclictest32073-21awk09:06:100
3139943,0cyclictest21585-21awk07:01:120
3139943,0cyclictest15998-21awk07:21:120
3139943,0cyclictest15241-21awk09:36:110
3139943,0cyclictest13909-21kworker/0:210:16:370
3139943,0cyclictest11908-21awk11:36:110
3139943,0cyclictest11301-21kworker/0:112:07:320
3139943,0cyclictest11232-21munin-node08:31:140
3139940,0cyclictest0-21swapper/010:38:200
29725040,0irq/27-eth0-tx-31972-21kthreadcore09:46:122
29725040,0irq/27-eth0-tx-1819-21chrt11:06:362
29725040,0irq/27-eth0-tx-17172-21ssh11:36:242
29725040,0irq/27-eth0-tx-0-21swapper/212:11:032
29725040,0irq/27-eth0-tx-0-21swapper/212:06:482
29725040,0irq/27-eth0-tx-0-21swapper/210:46:242
29725040,0irq/27-eth0-tx-0-21swapper/210:31:072
29725040,0irq/27-eth0-tx-0-21swapper/210:16:002
29725040,0irq/27-eth0-tx-0-21swapper/209:50:572
29725040,0irq/27-eth0-tx-0-21swapper/209:41:072
29725040,0irq/27-eth0-tx-0-21swapper/209:17:262
29715040,0irq/26-eth0-rx-19707-21kthreadcore07:21:143
29715040,0irq/26-eth0-rx-0-21swapper/311:46:153
29715040,0irq/26-eth0-rx-0-21swapper/311:16:113
29715040,0irq/26-eth0-rx-0-21swapper/311:01:053
29715040,0irq/26-eth0-rx-0-21swapper/309:22:163
29715040,0irq/26-eth0-rx-0-21swapper/309:06:083
29715040,0irq/26-eth0-rx-0-21swapper/307:01:143
259940,0migration/230794-21kthreadcore07:06:122
259940,0migration/229100-21kthreadcore08:41:132
259940,0migration/228698-21df_abs07:31:082
259940,0migration/225332-21kthreadcore07:51:132
259940,0migration/211110-21idleruntime08:06:112
249940,0watchdog/223604-21munin-node08:16:062
249940,0watchdog/223070-21grep07:26:102
249940,0watchdog/220885-21basename11:01:092
249940,0watchdog/20-21swapper/211:56:132
249940,0watchdog/20-21swapper/211:26:132
249940,0watchdog/20-21swapper/207:46:102
249940,0watchdog/20-21swapper/206:56:142
179940,0migration/18161-21kthreadcore10:31:121
179940,0migration/16584-21sh09:51:071
179940,0migration/15928-21kthreadcore08:26:151
179940,0migration/131550-21kthreadcore10:06:131
179940,0migration/128341-21if_eth1.307:06:101
179940,0migration/125524-21kthreadcore07:26:111
179940,0migration/123575-21runrttasks08:36:181
179940,0migration/122214-21irqcore10:21:111
179940,0migration/116841-21kthreadcore07:21:131
179940,0migration/114372-21kthreadcore11:36:131
179940,0migration/114285-21irqcore10:16:131
179940,0migration/113553-21kthreadcore11:16:131
169940,0watchdog/14711-21ssh09:26:541
169940,0watchdog/127054-21tr09:21:141
169940,0watchdog/10-21swapper/111:51:131
169940,0watchdog/10-21swapper/111:41:131
169940,0watchdog/10-21swapper/111:01:091
169940,0watchdog/10-21swapper/110:41:101
169940,0watchdog/10-21swapper/107:46:141
149940,0migration/05268-21sh09:28:350
149940,0migration/028006-21runrttasks10:01:580
149940,0migration/019779-21turbostat11:05:500
149940,0migration/017593-21kthreadcore09:56:130
149940,0migration/016119-21irqrtprio09:16:130
149940,0migration/012133-21runrttasks10:56:000
3169932,0cyclictest3514-21snmpd08:26:212
3169932,0cyclictest12661-21kthreadcore07:16:122
3159932,0cyclictest3514-21snmpd10:49:001
3159932,0cyclictest3514-21snmpd08:16:361
3159932,0cyclictest3514-21snmpd07:16:511
3159932,0cyclictest27837-21awk11:46:111
3159932,0cyclictest20800-21basename07:01:081
3159932,0cyclictest15899-21awk08:56:101
3159932,0cyclictest12212-21awk08:31:111
3159931,0cyclictest3628-21sed08:21:201
3139933,0cyclictest13909-21kworker/0:211:45:570
3139933,0cyclictest13909-21kworker/0:211:41:130
3139933,0cyclictest13909-21kworker/0:210:31:030
3139933,0cyclictest13909-21kworker/0:210:06:010
3139933,0cyclictest13909-21kworker/0:209:11:070
3139933,0cyclictest13909-21kworker/0:208:50:570
3139933,0cyclictest13909-21kworker/0:208:26:210
3139933,0cyclictest13909-21kworker/0:208:21:090
3139933,0cyclictest13909-21kworker/0:208:06:070
3139933,0cyclictest13909-21kworker/0:207:56:090
3139933,0cyclictest13909-21kworker/0:207:51:070
3139933,0cyclictest13909-21kworker/0:207:31:080
3139933,0cyclictest13909-21kworker/0:207:11:220
3139933,0cyclictest11301-21kworker/0:112:01:040
3139932,0cyclictest10556-21kthreadcore09:31:140
3139932,0cyclictest0-21swapper/007:17:050
3139930,0cyclictest9768-21diskstats07:41:090
3139930,0cyclictest18468-21perl08:36:090
3139930,0cyclictest16293-21irqstats08:56:110
3139930,0cyclictest1242-21perl06:46:100
29725030,0irq/27-eth0-tx-23725-21aten2.4-expect08:16:070
29715030,0irq/26-eth0-rx-14650-21munin-node07:41:153
29715030,0irq/26-eth0-rx-0-21swapper/307:28:573
29715030,0irq/26-eth0-rx-0-21swapper/306:48:503
179930,0migration/14142-21diskmemload10:50:561
169930,0watchdog/10-21swapper/111:21:011
169930,0watchdog/10-21swapper/111:06:131
169930,0watchdog/10-21swapper/106:56:141
169930,0watchdog/10-21swapper/106:51:181
3169920,0cyclictest0-21swapper/206:45:582
3159920,0cyclictest28330-21latency_hist07:30:561
29715020,0irq/26-eth0-rx-0-21swapper/308:22:153
29715020,0irq/26-eth0-rx-0-21swapper/306:51:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional