You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 11:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 21, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3044501070,0irq/25-eth10-21swapper/318:43:533
2781727473,0sleep00-21swapper/018:45:350
2766923627,0sleep10-21swapper/118:43:511
2760623329,0sleep20-21swapper/218:43:042
2795099130,0cyclictest0-21swapper/020:48:040
279519980,0cyclictest0-21swapper/123:21:491
339970,0migration/324549-21sh21:22:323
279519973,0cyclictest722-21awk22:31:291
279519973,0cyclictest11130-21awk21:16:301
279519972,0cyclictest17398-21awk22:21:331
279519970,0cyclictest0-21swapper/120:53:461
4160,0ktimersoftd/00-21swapper/023:44:460
35160,0ktimersoftd/30-21swapper/321:16:313
339960,0migration/330875-21sh22:49:273
339960,0migration/328839-21sh00:10:363
339960,0migration/316430-21sh20:56:483
339960,0migration/31274-21kthreadcore00:11:333
339960,0migration/311726-21pmu-power23:36:363
29715060,0irq/26-eth0-rx-28893-21ssh23:27:173
279519963,0cyclictest3556-21lldpd21:08:231
279519963,0cyclictest3556-21lldpd18:52:201
279519963,0cyclictest3556-21lldpd00:15:261
279519963,0cyclictest27372-21awk20:46:301
279519963,0cyclictest16163-21awk23:01:291
279519962,0cyclictest6983-21awk23:36:301
279519962,0cyclictest32102-21awk20:01:301
279509960,0cyclictest0-21swapper/023:34:500
149960,0migration/028281-21sh23:47:140
149960,0migration/020464-21sh00:04:230
149960,0migration/015991-21munin-node20:56:370
149960,0migration/014461-21latency_hist23:21:150
4150,0ktimersoftd/00-21swapper/020:26:170
339950,0migration/36189-21kthreadcore19:16:323
339950,0migration/36036-21kthreadcore21:31:333
339950,0migration/34826-21taskset19:41:293
339950,0migration/332713-21sh21:06:593
339950,0migration/331138-21aten_r1power_cu23:11:283
339950,0migration/329004-21latency_hist19:11:163
339950,0migration/32872-21kthreadcore19:36:333
339950,0migration/326840-21kthreadcore19:56:323
339950,0migration/326782-21kthreadcore22:26:323
339950,0migration/325699-21unixbench-2d20:41:393
339950,0migration/32569-21kthreadcore22:31:323
339950,0migration/323935-21fschecks_count19:31:293
339950,0migration/323897-21fschecks_time23:06:293
339950,0migration/320939-21kthreadcore20:16:333
339950,0migration/320008-21mdstat23:21:353
339950,0migration/316525-21taskset19:25:533
339950,0migration/316015-21aten_r1power_po22:41:263
339950,0migration/315402-21kthreadcore23:41:343
339950,0migration/314501-21missed_timers18:56:343
339950,0migration/314487-21irqcore00:01:323
339950,0migration/312923-21taskset00:00:363
29725050,0irq/27-eth0-tx-5452-21munin-node20:06:300
29725050,0irq/27-eth0-tx-31148-21munin-node20:01:340
29725050,0irq/27-eth0-tx-2773-21perl21:11:302
29725050,0irq/27-eth0-tx-21366-21munin-node00:06:312
29725050,0irq/27-eth0-tx-13434-21munin-node00:01:302
29725050,0irq/27-eth0-tx-10344-21ssh22:56:312
29725050,0irq/27-eth0-tx-0-21swapper/223:36:202
29725050,0irq/27-eth0-tx-0-21swapper/222:41:432
29725050,0irq/27-eth0-tx-0-21swapper/221:41:382
29725050,0irq/27-eth0-tx-0-21swapper/221:01:372
29725050,0irq/27-eth0-tx-0-21swapper/220:56:522
29725050,0irq/27-eth0-tx-0-21swapper/020:21:250
29725050,0irq/27-eth0-tx-0-21swapper/019:46:340
29725050,0irq/27-eth0-tx-0-21swapper/019:11:270
29715050,0irq/26-eth0-rx-8773-21ssh22:36:303
29715050,0irq/26-eth0-rx-6559-21runrttasks20:48:213
29715050,0irq/26-eth0-rx-27361-21kthreadcore22:06:333
29715050,0irq/26-eth0-rx-19320-21kthreadcore21:41:343
29715050,0irq/26-eth0-rx-14128-21munin-node22:16:353
29715050,0irq/26-eth0-rx-0-21swapper/323:54:473
29715050,0irq/26-eth0-rx-0-21swapper/323:16:393
29715050,0irq/26-eth0-rx-0-21swapper/322:52:293
29715050,0irq/26-eth0-rx-0-21swapper/322:01:333
29715050,0irq/26-eth0-rx-0-21swapper/321:40:113
29715050,0irq/26-eth0-rx-0-21swapper/321:26:283
29715050,0irq/26-eth0-rx-0-21swapper/321:11:523
279529955,0cyclictest26253-21diskmemload22:09:002
279529955,0cyclictest0-21swapper/223:15:032
279529955,0cyclictest0-21swapper/223:09:422
279529950,0cyclictest0-21swapper/222:48:152
279529950,0cyclictest0-21swapper/222:29:202
279529950,0cyclictest0-21swapper/220:46:422
279529950,0cyclictest0-21swapper/219:16:412
279519955,0cyclictest0-21swapper/121:53:031
279519955,0cyclictest0-21swapper/121:32:431
279519955,0cyclictest0-21swapper/119:36:311
279519953,0cyclictest0-21swapper/122:05:111
279519952,0cyclictest24700-21awk22:46:291
279519950,0cyclictest0-21swapper/123:54:171
279519950,0cyclictest0-21swapper/123:43:341
279519950,0cyclictest0-21swapper/123:06:501
279519950,0cyclictest0-21swapper/121:46:161
279509955,0cyclictest0-21swapper/022:37:460
279509950,0cyclictest0-21swapper/023:21:170
279509950,0cyclictest0-21swapper/022:10:200
279509950,0cyclictest0-21swapper/021:51:250
279509950,0cyclictest0-21swapper/021:24:180
27150,0ktimersoftd/20-21swapper/222:14:412
259950,0migration/29758-21kthreadcore23:16:322
259950,0migration/2743-21sh21:08:232
259950,0migration/25488-21aten_r1power_cu23:56:272
259950,0migration/24166-21kthreadcore21:51:322
259950,0migration/228340-21sh23:47:242
259950,0migration/222473-21aten_r1power_cu19:06:262
259950,0migration/222162-21sendmail_mailqu22:21:392
259950,0migration/212143-21latency_hist20:11:162
259950,0migration/210461-21munin-node19:41:402
249950,0watchdog/23779-21head23:31:372
249950,0watchdog/232459-21kthreadcore00:11:332
249950,0watchdog/215582-21ntp_kernel_pll_19:21:342
149950,0migration/08724-21taskset18:54:040
149950,0migration/04460-21sh23:54:050
149950,0migration/031988-21cpu22:51:280
149950,0migration/030860-21kthreadcore21:26:340
149950,0migration/027380-21timerwakeupswit00:06:390
149950,0migration/026502-21if_eth121:46:310
149950,0migration/026171-21kthreadcore19:56:320
149950,0migration/025020-21kthreadcore23:26:330
149950,0migration/024603-21sh21:44:130
149950,0migration/023715-21cpuspeed_turbos19:31:280
149950,0migration/023542-21sh22:24:410
149950,0migration/023183-21taskset23:06:230
149950,0migration/022728-21taskset22:43:490
149950,0migration/020462-21kthreadcore21:01:350
149950,0migration/020020-21kthreadcore22:01:330
149950,0migration/015681-21munin-node23:01:270
149950,0migration/013955-21diskmemload22:58:040
149950,0migration/013132-21kthreadcore21:56:340
149950,0migration/013068-21taskset00:01:000
149950,0migration/010649-21kthreadcore18:56:320
339940,0migration/37309-21diskmemload22:56:213
339940,0migration/3585-21kthreadcore18:46:333
339940,0migration/35388-21latency_hist20:06:163
339940,0migration/34372-21diskmemload23:31:563
339940,0migration/330686-21latency20:21:353
339940,0migration/321408-21kthreadcore22:21:353
29725040,0irq/27-eth0-tx-6363-21ssh22:32:282
29725040,0irq/27-eth0-tx-31752-21ssh22:51:252
29725040,0irq/27-eth0-tx-26253-21diskmemload21:46:182
29725040,0irq/27-eth0-tx-0-21swapper/223:41:252
29725040,0irq/27-eth0-tx-0-21swapper/223:26:262
29725040,0irq/27-eth0-tx-0-21swapper/223:02:062
29725040,0irq/27-eth0-tx-0-21swapper/222:16:272
29725040,0irq/27-eth0-tx-0-21swapper/222:02:122
29725040,0irq/27-eth0-tx-0-21swapper/221:37:552
29725040,0irq/27-eth0-tx-0-21swapper/221:31:522
29725040,0irq/27-eth0-tx-0-21swapper/221:16:222
29725040,0irq/27-eth0-tx-0-21swapper/020:36:370
29725040,0irq/27-eth0-tx-0-21swapper/020:16:270
29725040,0irq/27-eth0-tx-0-21swapper/020:11:350
29715040,0irq/26-eth0-rx-28884-21kthreadcore21:46:343
29715040,0irq/26-eth0-rx-0-21swapper/323:48:283
29715040,0irq/26-eth0-rx-0-21swapper/323:01:373
29715040,0irq/26-eth0-rx-0-21swapper/322:12:353
29715040,0irq/26-eth0-rx-0-21swapper/321:56:533
29715040,0irq/26-eth0-rx-0-21swapper/321:53:403
29715040,0irq/26-eth0-rx-0-21swapper/321:01:203
29715040,0irq/26-eth0-rx-0-21swapper/320:51:413
29715040,0irq/26-eth0-rx-0-21swapper/320:31:323
29715040,0irq/26-eth0-rx-0-21swapper/320:05:083
29715040,0irq/26-eth0-rx-0-21swapper/319:01:333
29715040,0irq/26-eth0-rx-0-21swapper/318:51:343
279529943,0cyclictest571-21awk20:26:312
279529943,0cyclictest3514-21snmpd22:36:202
279529943,0cyclictest3514-21snmpd21:26:202
279529943,0cyclictest3514-21snmpd20:33:052
279529943,0cyclictest3514-21snmpd20:16:202
279529943,0cyclictest3514-21snmpd20:08:502
279529943,0cyclictest3514-21snmpd20:01:502
279529943,0cyclictest3514-21snmpd19:57:502
279529943,0cyclictest3514-21snmpd19:53:202
279529943,0cyclictest3514-21snmpd19:47:202
279529943,0cyclictest3514-21snmpd19:32:042
279529943,0cyclictest3310-21awk18:51:322
279529943,0cyclictest20805-21sed20:41:322
279529943,0cyclictest10033-21awk18:56:302
279519944,0cyclictest0-21swapper/123:58:141
279519943,0cyclictest9951-21sort18:56:291
279519943,0cyclictest3556-21lldpd22:53:551
279519943,0cyclictest3556-21lldpd21:22:241
279519943,0cyclictest3514-21snmpd23:29:051
279519943,0cyclictest3514-21snmpd23:18:351
279519943,0cyclictest3514-21snmpd23:11:501
279519943,0cyclictest3514-21snmpd22:57:051
279519943,0cyclictest3514-21snmpd22:19:351
279519943,0cyclictest3514-21snmpd20:46:051
279519943,0cyclictest3514-21snmpd20:30:351
279519943,0cyclictest3514-21snmpd20:18:051
279519943,0cyclictest3514-21snmpd19:51:201
279519943,0cyclictest3514-21snmpd19:30:341
279519943,0cyclictest3514-21snmpd19:06:191
279519943,0cyclictest3514-21snmpd19:02:341
279519943,0cyclictest3241-21irqbalance23:50:131
279519943,0cyclictest3241-21irqbalance22:41:341
279519943,0cyclictest3241-21irqbalance22:36:541
279519943,0cyclictest3241-21irqbalance22:26:441
279519943,0cyclictest3241-21irqbalance21:57:541
279519943,0cyclictest3241-21irqbalance21:37:441
279519943,0cyclictest3241-21irqbalance21:13:041
279519943,0cyclictest3241-21irqbalance20:57:241
279519943,0cyclictest30115-21awk19:11:291
279519943,0cyclictest29013-21awk18:46:301
279519943,0cyclictest26217-21sadc21:06:151
279519943,0cyclictest13118-21awk20:11:311
279509943,0cyclictest8155-21kworker/0:022:32:490
279509943,0cyclictest7421-21awk20:31:310
279509943,0cyclictest3556-21lldpd22:50:550
279509943,0cyclictest3514-21snmpd22:28:350
279509943,0cyclictest3241-21irqbalance21:08:440
279509943,0cyclictest3241-21irqbalance00:13:430
279509943,0cyclictest20702-21awk20:41:310
279509943,0cyclictest10476-21awk21:36:310
259940,0migration/29494-21fschecks_count21:56:302
259940,0migration/22132-21kthreadcore19:36:332
259940,0migration/218037-21kthreadcore20:36:332
259940,0migration/217202-21kthreadcore19:01:332
249940,0watchdog/230290-21df_inode23:51:292
249940,0watchdog/229525-21kthreadcore20:21:342
249940,0watchdog/22776-21hddtemp_smartct20:51:302
249940,0watchdog/224326-21ssh21:21:502
249940,0watchdog/216374-21grep23:21:332
249940,0watchdog/20-21swapper/218:46:382
169940,0watchdog/10-21swapper/100:06:331
149940,0migration/08290-21kthreadcore19:41:340
149940,0migration/07573-21kthreadcore23:36:320
149940,0migration/05023-21kthreadcore21:11:340
149940,0migration/04816-21kthreadcore22:11:320
149940,0migration/03133-21irqcore20:51:320
149940,0migration/018720-21kthreadcore19:26:330
149940,0migration/017734-21kthreadcore19:01:330
29715030,0irq/26-eth0-rx-0-21swapper/320:36:443
29715030,0irq/26-eth0-rx-0-21swapper/320:11:263
29715030,0irq/26-eth0-rx-0-21swapper/319:51:263
29715030,0irq/26-eth0-rx-0-21swapper/319:11:173
279529933,0cyclictest3556-21lldpd19:11:212
279529932,0cyclictest17651-21awk19:26:302
279519933,0cyclictest3556-21lldpd22:06:241
279519933,0cyclictest3556-21lldpd19:56:221
279519933,0cyclictest3514-21snmpd21:41:351
279519932,0cyclictest7373-21awk20:31:301
279519932,0cyclictest3556-21lldpd19:45:521
279519932,0cyclictest3514-21snmpd19:23:191
279519932,0cyclictest3514-21snmpd19:16:191
279519932,0cyclictest31393-21if_err_eth1.323:31:321
279519932,0cyclictest26052-21sh21:26:231
279519932,0cyclictest24431-21awk19:31:311
279519932,0cyclictest14320-21awk00:01:311
279519932,0cyclictest12003-21awk19:46:301
279519930,0cyclictest5847-21df_inode20:06:291
279519930,0cyclictest0-21swapper/120:37:041
279509933,0cyclictest9221-21kworker/0:222:16:210
279509933,0cyclictest9221-21kworker/0:221:31:190
279509933,0cyclictest9221-21kworker/0:221:16:410
279509933,0cyclictest8155-21kworker/0:023:11:230
279509933,0cyclictest3193-21kworker/0:019:21:260
279509933,0cyclictest3193-21kworker/0:019:16:200
279509933,0cyclictest3193-21kworker/0:019:06:260
279509933,0cyclictest24226-21kworker/0:219:36:170
279509933,0cyclictest15023-21kworker/0:019:51:170
279509933,0cyclictest12148-21kworker/0:118:46:180
169930,0watchdog/10-21swapper/122:11:301
169930,0watchdog/10-21swapper/120:21:341
339920,0migration/312123-21iostat_ios19:46:313
29715020,0irq/26-eth0-rx-0-21swapper/320:26:463
29715020,0irq/26-eth0-rx-0-21swapper/319:26:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional