You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 16:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Jul 30, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450830,0irq/25-eth10-21swapper/306:43:303
1187824028,0sleep20-21swapper/206:45:432
1173023829,0sleep10-21swapper/106:44:021
1192222824,0sleep00-21swapper/006:46:130
339970,0migration/32363-21munin-node07:53:313
29715070,0irq/26-eth0-rx-18988-21yum12:13:413
4160,0ktimersoftd/00-21swapper/010:49:220
339960,0migration/39297-21sh09:27:263
339960,0migration/38514-21latency_hist10:08:193
339960,0migration/37119-21kthreadcore12:08:353
339960,0migration/324662-21munin-node08:53:423
339960,0migration/319292-21hwlatdetect09:13:333
339960,0migration/319270-21munin-node11:53:393
29725060,0irq/27-eth0-tx-8684-21munin-node07:58:380
29725060,0irq/27-eth0-tx-0-21swapper/006:56:310
29715060,0irq/26-eth0-rx-23683-21df_abs10:58:293
29715060,0irq/26-eth0-rx-21851-21ssh11:16:373
27160,0ktimersoftd/20-21swapper/210:49:222
149960,0migration/022232-21sh10:55:520
149960,0migration/022232-21sh10:55:520
149960,0migration/014569-21sh11:53:330
121749966,0cyclictest10323-21diskmemload09:05:201
121739960,0cyclictest0-21swapper/009:18:430
8215050,0irq/24-0000:00:29076-21munin-run12:03:182
8215050,0irq/24-0000:00:14131-21perf07:38:192
4150,0ktimersoftd/00-21swapper/011:33:030
339950,0migration/38749-21kthreadcore11:08:363
339950,0migration/38033-21sh10:28:193
339950,0migration/33167-21kthreadcore09:43:353
339950,0migration/331616-21kthreadcore07:48:373
339950,0migration/331195-21kthreadcore12:03:323
339950,0migration/329824-21kthreadcore06:58:363
339950,0migration/32891-21kthreadcore10:03:343
339950,0migration/327591-21munin-node08:08:413
339950,0migration/322927-21hddtemp_smartct11:38:323
339950,0migration/322893-21taskset08:33:203
339950,0migration/322667-21kthreadcore09:33:373
339950,0migration/321807-21gltestperf07:43:323
339950,0migration/321463-21taskset08:05:153
339950,0migration/320791-21munin-node10:53:363
339950,0migration/320791-21munin-node10:53:363
339950,0migration/320327-21irqrtprio06:53:353
339950,0migration/318031-21munin-node09:53:313
339950,0migration/317675-21kthreadcore10:33:323
339950,0migration/317238-21fschecks_time10:13:323
339950,0migration/317082-21munin-node08:28:353
339950,0migration/316096-21munin-node09:08:403
339950,0migration/31440-21fschecks_count07:28:303
339950,0migration/311646-21kthreadcore07:58:363
339950,0migration/31125-21kthreadcore08:38:343
29725050,0irq/27-eth0-tx-3825-21kthreadcore09:43:352
29725050,0irq/27-eth0-tx-32460-21munin-node10:23:382
29725050,0irq/27-eth0-tx-31079-21ssh10:41:372
29725050,0irq/27-eth0-tx-2883-21munin-node08:18:380
29725050,0irq/27-eth0-tx-28256-21ntp_kernel_err11:18:392
29725050,0irq/27-eth0-tx-23351-21ntp_kernel_pll_09:33:382
29725050,0irq/27-eth0-tx-21067-21munin-node07:43:300
29725050,0irq/27-eth0-tx-10323-21diskmemload11:14:002
29725050,0irq/27-eth0-tx-0-21swapper/211:52:402
29725050,0irq/27-eth0-tx-0-21swapper/211:05:042
29725050,0irq/27-eth0-tx-0-21swapper/210:35:212
29725050,0irq/27-eth0-tx-0-21swapper/210:20:462
29725050,0irq/27-eth0-tx-0-21swapper/209:13:412
29725050,0irq/27-eth0-tx-0-21swapper/209:05:342
29725050,0irq/27-eth0-tx-0-21swapper/008:23:360
29725050,0irq/27-eth0-tx-0-21swapper/007:53:510
29725050,0irq/27-eth0-tx-0-21swapper/007:38:340
29725050,0irq/27-eth0-tx-0-21swapper/007:03:390
29725050,0irq/27-eth0-tx-0-21swapper/006:58:340
29715050,0irq/26-eth0-rx-9274-21aten_r1power_cu09:48:293
29715050,0irq/26-eth0-rx-4694-21ssh11:46:223
29715050,0irq/26-eth0-rx-32477-21sshd09:40:303
29715050,0irq/26-eth0-rx-30913-21cut11:23:283
29715050,0irq/26-eth0-rx-25961-21if_err_eth109:58:333
29715050,0irq/26-eth0-rx-14976-21hostname11:33:323
29715050,0irq/26-eth0-rx-10291-21kthreadcore11:48:363
29715050,0irq/26-eth0-rx-0-21swapper/311:58:213
29715050,0irq/26-eth0-rx-0-21swapper/311:32:353
29715050,0irq/26-eth0-rx-0-21swapper/311:21:183
29715050,0irq/26-eth0-rx-0-21swapper/311:07:213
29715050,0irq/26-eth0-rx-0-21swapper/310:52:443
29715050,0irq/26-eth0-rx-0-21swapper/310:41:253
29715050,0irq/26-eth0-rx-0-21swapper/310:25:183
29715050,0irq/26-eth0-rx-0-21swapper/310:21:583
29715050,0irq/26-eth0-rx-0-21swapper/309:31:333
29715050,0irq/26-eth0-rx-0-21swapper/309:07:043
29715050,0irq/26-eth0-rx-0-21swapper/308:58:313
29715050,0irq/26-eth0-rx-0-21swapper/308:52:553
259950,0migration/23618-21kthreadcore10:43:372
259950,0migration/232714-21munin-node08:58:432
259950,0migration/226170-21kthreadcore10:58:332
259950,0migration/224125-21munin-node08:53:372
259950,0migration/222017-21missed_timers10:13:372
259950,0migration/216150-21latency_hist08:28:192
259950,0migration/21249-21cpuspeed_turbos07:28:292
249950,0watchdog/27689-21tr08:18:372
249950,0watchdog/229742-21entropy12:03:282
249950,0watchdog/216655-21diskstats08:28:332
249950,0watchdog/214137-21unixbench-2d10:28:452
249950,0watchdog/211630-21cut11:08:362
19150,0ktimersoftd/10-21swapper/110:49:221
179950,0migration/124420-21missed_timers06:53:381
179950,0migration/120359-21sh12:17:531
169950,0watchdog/118166-21if_eth1.209:53:331
169950,0watchdog/115241-21cut08:48:371
149950,0migration/07486-21sh10:05:430
149950,0migration/07225-21taskset07:30:250
149950,0migration/06741-21sh10:25:070
149950,0migration/05291-21sh11:04:350
149950,0migration/04052-21munin-node11:23:380
149950,0migration/03483-21switchtime11:43:410
149950,0migration/031598-21taskset09:59:470
149950,0migration/03071-21unixbench_multi08:38:390
149950,0migration/025690-21kthreadcore08:33:370
149950,0migration/022311-21taskset08:29:090
149950,0migration/019038-21fschecks_time09:13:320
149950,0migration/018930-21irqcore09:33:350
149950,0migration/018608-21taskset06:50:550
149950,0migration/017403-21kthreadcore10:33:320
149950,0migration/016397-21taskset09:29:430
149950,0migration/014873-21fschecks_time11:33:320
149950,0migration/012134-21sh11:49:500
149950,0migration/011396-21if_eth009:08:350
121749955,0cyclictest0-21swapper/109:42:521
121749955,0cyclictest0-21swapper/109:27:251
121749954,0cyclictest22234-21cut07:43:341
121749950,0cyclictest0-21swapper/110:04:281
121749950,0cyclictest0-21swapper/109:52:001
121739954,0cyclictest5678-21kthreadcore09:03:350
121739950,0cyclictest14542-21munin-run11:13:190
121739950,0cyclictest0-21swapper/008:43:430
339940,0migration/32166-21kthreadcore10:43:363
339940,0migration/31806-21kthreadcore07:03:353
339940,0migration/314782-21fschecks_count07:38:323
29725040,0irq/27-eth0-tx-8592-21ssh10:08:252
29725040,0irq/27-eth0-tx-2779-21if_err_eth1.209:23:362
29725040,0irq/27-eth0-tx-25683-21ssh09:38:192
29725040,0irq/27-eth0-tx-1555-21if_eth110:03:322
29725040,0irq/27-eth0-tx-0-21swapper/212:13:222
29725040,0irq/27-eth0-tx-0-21swapper/211:54:032
29725040,0irq/27-eth0-tx-0-21swapper/211:43:542
29725040,0irq/27-eth0-tx-0-21swapper/210:53:342
29725040,0irq/27-eth0-tx-0-21swapper/210:53:342
29725040,0irq/27-eth0-tx-0-21swapper/209:59:422
29725040,0irq/27-eth0-tx-0-21swapper/209:54:222
29725040,0irq/27-eth0-tx-0-21swapper/209:19:302
29725040,0irq/27-eth0-tx-0-21swapper/209:08:362
29725040,0irq/27-eth0-tx-0-21swapper/008:10:300
29715040,0irq/26-eth0-rx-0-21swapper/309:20:453
259940,0migration/27095-21kthreadcore12:08:352
259940,0migration/23749-21kthreadcore07:03:362
259940,0migration/23286-21kernelversion07:53:352
259940,0migration/225070-21kthreadcore11:38:362
259940,0migration/223267-21df_abs08:33:322
259940,0migration/217644-21kthreadcore07:13:362
259940,0migration/216485-21timerandwakeup08:48:422
259940,0migration/215834-21fschecks_count08:03:302
259940,0migration/214210-21kthreadcore09:48:362
259940,0migration/211480-21kthreadcore07:58:362
249940,0watchdog/23914-21aten_r1power_en08:43:292
249940,0watchdog/232395-21kthreadcore11:23:322
249940,0watchdog/20-21swapper/208:38:332
249940,0watchdog/20-21swapper/208:08:372
179940,0migration/15743-21kthreadcore07:53:361
179940,0migration/15386-21missed_timers07:03:371
179940,0migration/14934-21munin-node10:43:371
179940,0migration/132461-21irqrtprio11:03:341
179940,0migration/132117-21kthreadcore12:03:321
179940,0migration/129665-21kthreadcore06:58:361
179940,0migration/127945-21kthreadcore09:18:351
179940,0migration/124581-21timerwakeupswit08:53:421
179940,0migration/119559-21kthreadcore09:33:361
179940,0migration/118929-21fschecks_count09:13:311
179940,0migration/117729-21kthreadcore10:53:351
179940,0migration/117729-21kthreadcore10:53:351
179940,0migration/116147-21kthreadcore11:33:351
179940,0migration/11513-21fschecks_time07:28:301
179940,0migration/11354-21kthreadcore08:13:361
179940,0migration/112577-21kthreadcore09:28:361
179940,0migration/111350-21kthreadcore08:23:371
169940,0watchdog/14196-21ssh11:44:521
169940,0watchdog/127464-21kthreadcore08:33:371
169940,0watchdog/125324-21kthreadcore08:08:371
169940,0watchdog/114138-21unixbench-2d10:28:451
169940,0watchdog/113864-21rm11:11:161
169940,0watchdog/113842-21ssh11:33:081
169940,0watchdog/10-21swapper/111:48:321
169940,0watchdog/10-21swapper/110:33:331
169940,0watchdog/10-21swapper/108:38:331
169940,0watchdog/10-21swapper/108:18:371
149940,0migration/02903-21if_eth1.309:23:360
149940,0migration/026460-21kthreadcore10:18:330
149940,0migration/02362-21needreboot12:03:340
149940,0migration/019053-21kthreadcore10:13:350
149940,0migration/016222-21if_err_eth1.308:03:310
149940,0migration/012096-21kthreadcore10:08:350
149940,0migration/01105-21kthreadcore08:13:360
149940,0migration/010878-21kthreadcore09:48:350
149940,0migration/010672-21aten_r1power_fr08:48:310
121769943,0cyclictest7583-21awk07:08:332
121769943,0cyclictest7165-21awk11:28:342
121769943,0cyclictest3514-21snmpd11:33:212
121769943,0cyclictest3514-21snmpd07:39:512
121769943,0cyclictest3514-21snmpd07:23:362
121769943,0cyclictest29466-21awk08:13:332
121769943,0cyclictest28543-21awk07:48:342
121769943,0cyclictest20881-21awk07:18:332
121769943,0cyclictest13222-21awk06:48:322
121769943,0cyclictest10729-21awk09:28:332
121749944,0cyclictest0-21swapper/112:12:001
121749944,0cyclictest0-21swapper/111:54:591
121749944,0cyclictest0-21swapper/110:24:481
121749943,0cyclictest9856-21ps07:58:351
121749943,0cyclictest9478-21awk10:08:321
121749943,0cyclictest7687-21awk07:08:341
121749943,0cyclictest3556-21lldpd11:23:221
121749943,0cyclictest3556-21lldpd11:22:221
121749943,0cyclictest3556-21lldpd09:59:221
121749943,0cyclictest3556-21lldpd09:46:521
121749943,0cyclictest3556-21lldpd08:43:201
121749943,0cyclictest3556-21lldpd07:19:511
121749943,0cyclictest27677-21awk07:23:341
121749943,0cyclictest24208-21awk10:58:311
121749943,0cyclictest23100-21awk11:38:341
121749943,0cyclictest17542-21awk10:13:341
121749943,0cyclictest16246-21awk08:03:311
121749943,0cyclictest15241-21awk07:38:341
121749943,0cyclictest11473-21awk09:08:351
121739943,0cyclictest9009-21awk10:28:360
121739943,0cyclictest7663-21awk07:08:340
121739943,0cyclictest3556-21lldpd10:39:520
121739943,0cyclictest3514-21snmpd11:38:210
121739943,0cyclictest3514-21snmpd08:53:360
121739943,0cyclictest3514-21snmpd07:16:360
121739943,0cyclictest3241-21irqbalance12:16:060
121739943,0cyclictest3241-21irqbalance11:02:570
121739943,0cyclictest3241-21irqbalance09:53:470
121739943,0cyclictest3241-21irqbalance09:48:170
121739943,0cyclictest3241-21irqbalance09:41:170
121739943,0cyclictest3241-21irqbalance08:58:570
121739943,0cyclictest28508-21kworker/0:210:44:240
121739943,0cyclictest22320-21awk11:58:320
339930,0migration/311469-21kthreadcore07:33:363
29715030,0irq/26-eth0-rx-0-21swapper/308:23:323
29715030,0irq/26-eth0-rx-0-21swapper/308:18:333
29715030,0irq/26-eth0-rx-0-21swapper/308:17:113
29715030,0irq/26-eth0-rx-0-21swapper/307:23:413
29715030,0irq/26-eth0-rx-0-21swapper/307:13:493
29715030,0irq/26-eth0-rx-0-21swapper/307:10:553
179930,0migration/117753-21taskset08:28:371
169930,0watchdog/10-21swapper/111:58:281
169930,0watchdog/10-21swapper/111:13:281
169930,0watchdog/10-21swapper/110:18:331
169930,0watchdog/10-21swapper/108:58:331
169930,0watchdog/10-21swapper/107:48:211
169930,0watchdog/10-21swapper/107:33:331
121769932,0cyclictest3556-21lldpd06:59:212
121769932,0cyclictest3556-21lldpd06:57:212
121769932,0cyclictest3514-21snmpd07:44:362
121749932,0cyclictest3556-21lldpd10:38:221
121739933,0cyclictest28508-21kworker/0:211:13:200
121739933,0cyclictest28508-21kworker/0:207:48:380
121739933,0cyclictest28508-21kworker/0:207:33:200
121739933,0cyclictest28508-21kworker/0:207:23:210
121739933,0cyclictest28508-21kworker/0:207:18:210
121739933,0cyclictest22386-21kworker/0:111:18:220
121739933,0cyclictest14973-21kworker/0:012:08:230
29715020,0irq/26-eth0-rx-16257-21tr06:48:353
29715020,0irq/26-eth0-rx-0-21swapper/308:43:273
29715020,0irq/26-eth0-rx-0-21swapper/307:18:203
169920,0watchdog/10-21swapper/106:48:291
121749920,0cyclictest13376-21date07:13:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional